-- Logs begin at Mon 2022-07-04 08:35:06 UTC, end at Mon 2022-07-04 09:33:40 UTC. -- Jul 04 09:03:40.219384 dv-cinder-844563-4-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 04 09:03:40.229191 dv-cinder-844563-4-smb devstack@keystone.service[80170]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 04 09:03:40.231028 dv-cinder-844563-4-smb devstack@keystone.service[80170]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 4 09:03:40 2022] *** Jul 04 09:03:40.231028 dv-cinder-844563-4-smb devstack@keystone.service[80170]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 04 09:03:40.231028 dv-cinder-844563-4-smb devstack@keystone.service[80170]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 04 09:03:40.231028 dv-cinder-844563-4-smb devstack@keystone.service[80170]: nodename: dv-cinder-844563-4-smb Jul 04 09:03:40.231028 dv-cinder-844563-4-smb devstack@keystone.service[80170]: machine: x86_64 Jul 04 09:03:40.231028 dv-cinder-844563-4-smb devstack@keystone.service[80170]: clock source: unix Jul 04 09:03:40.231028 dv-cinder-844563-4-smb devstack@keystone.service[80170]: pcre jit disabled Jul 04 09:03:40.231028 dv-cinder-844563-4-smb devstack@keystone.service[80170]: detected number of CPU cores: 4 Jul 04 09:03:40.231028 dv-cinder-844563-4-smb devstack@keystone.service[80170]: current working directory: / Jul 04 09:03:40.231028 dv-cinder-844563-4-smb devstack@keystone.service[80170]: detected binary path: /usr/bin/uwsgi-core Jul 04 09:03:40.231028 dv-cinder-844563-4-smb devstack@keystone.service[80170]: your processes number limit is 47680 Jul 04 09:03:40.231620 dv-cinder-844563-4-smb devstack@keystone.service[80170]: your memory page size is 4096 bytes Jul 04 09:03:40.231620 dv-cinder-844563-4-smb devstack@keystone.service[80170]: detected max file descriptor number: 2048 Jul 04 09:03:40.231620 dv-cinder-844563-4-smb devstack@keystone.service[80170]: lock engine: pthread robust mutexes Jul 04 09:03:40.231620 dv-cinder-844563-4-smb devstack@keystone.service[80170]: thunder lock: enabled Jul 04 09:03:40.231620 dv-cinder-844563-4-smb devstack@keystone.service[80170]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 04 09:03:40.231620 dv-cinder-844563-4-smb devstack@keystone.service[80170]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 04 09:03:40.274790 dv-cinder-844563-4-smb devstack@keystone.service[80170]: Python main interpreter initialized at 0x5573009a89c0 Jul 04 09:03:40.274790 dv-cinder-844563-4-smb devstack@keystone.service[80170]: python threads support enabled Jul 04 09:03:40.274790 dv-cinder-844563-4-smb devstack@keystone.service[80170]: your server socket listen backlog is limited to 100 connections Jul 04 09:03:40.274790 dv-cinder-844563-4-smb devstack@keystone.service[80170]: your mercy for graceful operations on workers is 90 seconds Jul 04 09:03:40.275146 dv-cinder-844563-4-smb devstack@keystone.service[80170]: mapped 403077 bytes (393 KB) for 2 cores Jul 04 09:03:40.275146 dv-cinder-844563-4-smb devstack@keystone.service[80170]: *** Operational MODE: preforking *** Jul 04 09:03:40.275461 dv-cinder-844563-4-smb devstack@keystone.service[80170]: *** uWSGI is running in multiple interpreter mode *** Jul 04 09:03:40.275461 dv-cinder-844563-4-smb devstack@keystone.service[80170]: spawned uWSGI master process (pid: 80170) Jul 04 09:03:40.275650 dv-cinder-844563-4-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 04 09:03:40.277496 dv-cinder-844563-4-smb devstack@keystone.service[80170]: spawned uWSGI worker 1 (pid: 80181, cores: 1) Jul 04 09:03:40.277496 dv-cinder-844563-4-smb devstack@keystone.service[80170]: spawned uWSGI worker 2 (pid: 80182, cores: 1) Jul 04 09:03:40.277496 dv-cinder-844563-4-smb devstack@keystone.service[80170]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 04 09:03:45.594482 dv-cinder-844563-4-smb devstack@keystone.service[80181]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 04 09:03:45.594482 dv-cinder-844563-4-smb devstack@keystone.service[80181]: from cryptography.utils import int_from_bytes Jul 04 09:03:45.595320 dv-cinder-844563-4-smb devstack@keystone.service[80181]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 04 09:03:45.595320 dv-cinder-844563-4-smb devstack@keystone.service[80181]: from cryptography.utils import int_from_bytes Jul 04 09:03:45.597323 dv-cinder-844563-4-smb devstack@keystone.service[80182]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 04 09:03:45.597323 dv-cinder-844563-4-smb devstack@keystone.service[80182]: from cryptography.utils import int_from_bytes Jul 04 09:03:45.597827 dv-cinder-844563-4-smb devstack@keystone.service[80182]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 04 09:03:45.597827 dv-cinder-844563-4-smb devstack@keystone.service[80182]: from cryptography.utils import int_from_bytes Jul 04 09:03:45.644468 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 04 09:03:45.644666 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 04 09:03:45.644758 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 04 09:03:45.644837 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 04 09:03:45.644904 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] command line args: [] {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 04 09:03:45.644964 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] command line args: [] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 04 09:03:45.645102 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 04 09:03:45.645247 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 04 09:03:45.645317 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] ================================================================================ {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 04 09:03:45.645383 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ================================================================================ {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 04 09:03:45.645544 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] admin_token = **** {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.645628 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] admin_token = **** {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.645696 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] config_dir = [] {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.645768 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] config_dir = [] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.645898 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.645985 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.646065 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] config_source = [] {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.646143 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] config_source = [] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.646232 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] debug = True {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.646319 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] debug = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.646394 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.646672 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.646771 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.646834 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.646971 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.647058 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.647180 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.647266 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.647408 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.647503 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.648410 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] list_limit = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.648515 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] list_limit = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.648579 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] log_config_append = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.648638 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] log_config_append = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.648705 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.648772 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.648832 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] log_dir = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.648890 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] log_dir = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.648954 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] log_file = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.649013 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] log_file = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.649082 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.649147 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.649207 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.649270 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.649336 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.649399 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.649469 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.649538 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.649600 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.649660 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.649724 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.649795 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.649864 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.649925 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.649988 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.650054 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.650267 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.650358 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.650427 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.650492 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.650649 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.650743 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.650916 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.651051 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.651133 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.651270 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.651355 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.651428 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.651641 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.651781 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.652160 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.42/identity {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.652307 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.42/identity {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.652307 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] publish_errors = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.652474 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] publish_errors = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.652551 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.652686 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.652771 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.652856 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.652929 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.653047 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.653131 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.653223 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.653306 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.653385 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.653569 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] standard_threads = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.653693 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] standard_threads = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.653783 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.653864 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.654000 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.654076 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.654149 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.654227 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.654300 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] use_journal = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.654371 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] use_journal = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.654451 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] use_json = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.654523 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] use_json = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.654622 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] use_stderr = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.654706 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] use_stderr = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.654778 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] use_syslog = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.654850 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] use_syslog = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.655030 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.655164 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:03:45.655245 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.655318 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.655496 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.655639 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.655728 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.655808 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.655999 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.656121 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.656202 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.656295 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.656467 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.656591 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.656671 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.656754 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.656925 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.657063 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.657151 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.657227 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.657401 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.657525 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.657605 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.657741 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.657855 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.657941 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.658128 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.658251 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.658343 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.658427 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.658594 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.658719 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.658798 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.658871 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.659038 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.659250 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.659336 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.659416 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.659492 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.659570 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.659729 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.659824 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.659968 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.660054 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.660230 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.660318 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.660479 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.660578 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.660734 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.660819 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.660979 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.661063 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.661207 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.661299 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.661432 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.661521 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.661659 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.661743 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.661887 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.661980 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.662130 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.662213 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.662370 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.662452 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.662594 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.662683 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.662813 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.662896 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.663053 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.663137 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.663292 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.663375 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.663522 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.663612 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.663743 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.663822 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.663988 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.664071 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.664220 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.664299 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.664449 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.664527 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.664679 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.664758 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.664884 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.664963 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.665106 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.665213 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.665330 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.665445 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.665560 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.665681 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.665805 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.665928 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.666016 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.666156 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.666236 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.666393 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.666472 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.666620 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.666711 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.666856 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.666935 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.667093 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.667171 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.667338 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.667429 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.667568 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.667647 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.667800 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.667954 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.668109 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.668241 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.668343 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.668441 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.668539 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.668636 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.668733 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.668838 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.668938 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.669036 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.669134 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.669232 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.669366 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.669495 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.669625 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.669751 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.669876 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.669992 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.670116 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.670233 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.670347 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.670473 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.670591 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.670707 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.670821 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.670935 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.671049 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.671172 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.671280 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.671393 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.671507 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.671621 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.671734 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.671856 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.672026 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.672142 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.672256 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.672370 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.672485 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.672621 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.672739 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.672853 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.672966 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.673080 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.673203 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.673316 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.675796 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.675948 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.676068 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.676197 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.676328 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.676452 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.676569 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.676685 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.676799 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.676913 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.677036 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.677159 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.677275 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.677390 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.677504 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.677626 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.677751 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.677868 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.678041 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.678166 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.678282 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.678397 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.678589 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.678709 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.678822 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.678936 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.679050 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.679171 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.679303 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.679428 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.679552 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.679668 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.679783 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.679939 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.680056 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.680171 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.680299 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.680416 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.680530 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.680644 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.680760 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.680874 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.680997 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.681241 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.681362 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.681476 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.681601 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.681718 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.681843 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.681960 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.682075 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.682197 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.682313 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] auth.external = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.682428 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.682552 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.682668 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] auth.external = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.682668 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.682893 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.682893 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.683150 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.683269 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] auth.password = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.683393 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.683511 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] auth.token = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.683627 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] auth.password = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.683742 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.683859 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] auth.token = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.684019 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.684149 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.684267 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.684382 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.684498 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.684613 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.684728 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.684852 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.684979 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.685096 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.685212 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.685335 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.685452 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] credential.caching = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.685577 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.685695 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.685811 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] credential.caching = True {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.685927 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.686043 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.686158 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.686282 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.686412 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.686530 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.686646 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.686762 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.686877 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.687006 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.687124 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.687247 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.687363 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.687479 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.687594 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.687719 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.687836 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.687990 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.688119 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.688237 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.688353 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.688482 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.688599 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.688599 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.688824 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.688939 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.688939 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] federation.caching = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.689173 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.689290 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.689290 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.689507 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.689631 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.689631 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.689858 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.689976 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.689976 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.690195 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] federation.caching = True {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.690310 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.690310 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.690537 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.690537 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.690764 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.690880 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.690995 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.691110 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.691237 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.691354 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.691469 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] identity.caching = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.691585 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.691700 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.691815 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.691981 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.692102 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.692219 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.692335 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.692464 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.692581 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.692776 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.692896 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.693012 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.693128 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] identity.caching = True {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.693244 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.693361 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.693488 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.693606 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.693723 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.693839 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.693955 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.694079 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.694196 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.694313 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.694436 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.694553 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.694669 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.694669 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.694898 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.695013 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.695013 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.695229 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.695344 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.695344 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.695562 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.695677 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.695677 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.695936 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.696051 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.696051 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.696251 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.696368 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.696368 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.696587 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.696701 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.696701 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.696928 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.697044 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.697159 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.697440 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.697604 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.697746 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.697868 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.697986 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.698103 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.698220 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.698336 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.698462 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.698581 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.698698 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.698814 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.698929 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.699045 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.699175 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.699294 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.699410 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.699525 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.699643 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.699766 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.699911 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.700032 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.700032 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.700250 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.700366 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.700481 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.700613 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.700732 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.700848 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.700848 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.701065 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.701180 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.701180 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.701409 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.701524 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.701524 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.701742 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.701948 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.701948 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.702179 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.702295 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.702295 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.702510 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.702625 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.702625 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.702859 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.702975 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.703090 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.703212 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.703212 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.703212 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.703543 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.703660 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.703776 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.703921 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.704051 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.704179 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.704296 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.704412 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.704527 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.704741 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.704863 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.704989 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.705107 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.705223 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.user = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.705339 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.705454 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.705569 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.705693 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.705811 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.705928 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.706043 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.706159 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.706284 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.706401 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.706517 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.706632 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.706632 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.706849 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.706975 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.707092 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.707208 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.707323 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.707439 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.707562 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.707686 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.707803 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.707934 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.708054 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.708170 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.708285 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.708414 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.708533 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.708650 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.708765 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.708881 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.708997 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.709122 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.709240 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.709356 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.709472 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.709587 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.709703 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.709828 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.709945 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.710062 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.710179 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.710294 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.710410 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.710534 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.710652 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.710769 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.710901 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.711024 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.711141 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.711267 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.711385 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.711500 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.711617 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.711739 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.711857 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.712001 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.712122 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.712241 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.712356 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.712472 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.712588 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.712712 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.712836 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.712953 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.713069 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] resource.caching = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.713185 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.713301 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.713425 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.713543 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.713659 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.713775 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.713890 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] resource.caching = True {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.714007 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.714137 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.714257 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.714257 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.714474 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.714474 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.714692 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.714692 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.714925 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.715041 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.715159 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.715275 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] role.caching = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.715392 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.715587 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] role.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.715707 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.715825 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.715992 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.716121 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.716239 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.716366 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.716485 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] role.caching = True {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.716600 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.716717 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] role.driver = sql {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.716717 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.716936 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.716936 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.717174 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.717291 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.717408 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.717528 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.717644 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.717768 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.717885 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.718008 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.718125 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.718241 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.718364 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.718483 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.718600 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.718716 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.718838 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.718955 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.719079 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.719079 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.719300 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.719416 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.719533 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.719648 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.719773 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.719910 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.720028 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.720028 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.720246 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.720361 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.720489 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.720608 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.720724 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.720840 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.720956 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.721072 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.721197 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.721314 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.721430 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.721545 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.721663 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.721779 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.721903 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.722021 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.722136 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.722252 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.722367 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.722482 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.722607 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.722726 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.722841 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.722957 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.723072 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.723197 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.723314 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.723430 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.723545 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.723661 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] token.caching = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.723777 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.723959 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.724080 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.724196 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.724312 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.724428 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.724543 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.724667 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.724786 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] token.caching = True {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.724901 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.725017 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.725133 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.725248 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.725372 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.725490 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.725605 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.725720 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.725838 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.725953 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.726077 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.726194 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.726309 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.726425 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.726542 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.726657 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.726782 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.726901 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.727017 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.727132 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.727247 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.727362 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.727491 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.727610 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.727727 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.727842 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.727976 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] database.connection = **** {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.728106 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.728233 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.728351 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.728476 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.728595 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.728711 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.728827 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.728944 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.729059 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] database.connection = **** {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.729187 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.729319 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.729437 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.729552 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.729675 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.729792 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.729908 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.730033 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.730151 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.730151 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.730370 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.730370 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.730586 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.730711 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.730835 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.730953 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.731069 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.731184 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.731299 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.731423 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.731541 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.731541 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.731758 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.731892 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.732011 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.732141 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.732260 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.732376 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 04 09:03:45.732493 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.732493 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.732493 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.732493 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.732493 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:03:45.732493 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 04 09:03:45.760436 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:03:45.760609 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:03:45.760755 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:03:45.760861 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:03:45.760990 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:03:45.761074 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:03:45.769203 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:03:45.769331 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:03:45.796982 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:03:45.797206 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:03:45.797331 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:03:45.797473 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:03:45.939402 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:03:45.939859 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:03:45.987137 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:03:45.987363 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:03:45.987968 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:03:45.988204 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:03:46.049856 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:03:46.050092 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:03:46.050206 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:03:46.050311 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:03:46.050438 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:03:46.050529 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:03:46.050608 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:03:46.050692 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:03:46.050770 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:03:46.050846 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:03:46.050931 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:03:46.051008 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:03:46.076983 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:03:46.077174 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:03:46.077396 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:03:46.077620 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:03:46.077821 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:03:46.078062 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:03:46.078192 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:03:46.078316 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:03:46.078416 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:03:46.078545 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:03:46.078750 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:03:46.079156 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:03:46.079371 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:03:46.079599 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:03:46.089548 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:03:46.089888 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:03:46.102479 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:03:46.102685 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:03:46.102827 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:03:46.102968 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:03:46.103052 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:03:46.103116 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:03:46.103239 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:03:46.103313 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:03:46.103438 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:03:46.103529 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:03:46.103676 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:03:46.103802 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:03:46.103967 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:03:46.104082 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:03:46.121305 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.121515 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 04 09:03:46.121640 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.121781 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 04 09:03:46.122010 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.122151 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.122293 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 04 09:03:46.122377 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 04 09:03:46.122501 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.122583 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.122698 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.122791 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.122930 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.123020 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.123208 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.123348 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.134007 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.134136 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.134277 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.134360 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.134526 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.134652 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.134814 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.134900 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.143059 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:03:46.143266 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:03:46.146261 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:03:46.146532 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.146657 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:03:46.146801 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.146918 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.147064 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.147169 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.147371 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.147496 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.147634 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.147715 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.147793 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.147898 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.148094 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.148221 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.148360 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.148444 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.148611 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.148737 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.148822 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.148900 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.149122 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.174879 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.175316 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.176487 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:03:46.176755 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.176953 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:03:46.177224 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.181920 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:03:46.182192 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.182491 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:03:46.182617 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.182757 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.183028 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.189772 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:03:46.190050 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.190449 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:03:46.190730 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.194455 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:03:46.194735 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.195007 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.195132 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:03:46.195274 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.195416 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.195509 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.195718 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.195845 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.196008 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.196093 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.196235 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.196319 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.196531 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.196814 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.197070 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.214631 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.214896 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.215568 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.215839 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.219489 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:03:46.220712 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:03:46.223116 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.223403 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.224338 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.224628 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.228485 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:03:46.229725 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:03:46.232083 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:03:46.233315 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:03:46.235637 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.235998 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.236616 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.236891 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.237167 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.237293 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.237452 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.237617 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.237899 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.238183 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.238471 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.238738 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.256625 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:03:46.256901 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.257151 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.257412 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.258066 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:03:46.258345 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.258608 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.258871 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.265204 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.266701 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.266915 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.267191 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.268488 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.268760 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.270389 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:03:46.270660 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.270934 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.271210 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.271492 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.271909 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:03:46.272200 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.272475 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.272751 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.273020 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.284564 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:03:46.284832 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.285106 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.285376 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.285646 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.286183 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:03:46.286455 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.286730 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.287008 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.287134 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.287275 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.287477 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.287616 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.287783 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.305226 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:03:46.306792 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:03:46.308484 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:03:46.310073 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:03:46.311736 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.313380 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.313521 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.315079 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:03:46.315226 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.315314 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.315620 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.317017 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:03:46.317295 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.317574 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.322850 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.324473 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:03:46.324792 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.326405 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:03:46.327612 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.327900 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.328299 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.328573 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.329644 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.329930 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.330208 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.330484 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.337586 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:03:46.337860 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.338137 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.339642 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:03:46.339916 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.340213 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.345945 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:03:46.346218 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.346486 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.346754 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.347015 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.347387 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.347658 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.347965 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.348110 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:03:46.348263 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.348349 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.348473 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.348555 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.348757 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.348899 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.348984 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.349071 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.349265 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.349441 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.349530 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.349607 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.349869 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.350216 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.350492 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.350764 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.351025 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.351293 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.351551 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:03:46.387211 dv-cinder-844563-4-smb devstack@keystone.service[80181]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5573009a89c0 pid: 80181 (default app) Jul 04 09:03:46.389260 dv-cinder-844563-4-smb devstack@keystone.service[80182]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5573009a89c0 pid: 80182 (default app) Jul 04 09:03:46.390597 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd2454b-6f80-4879-b440-7056d653ac02 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:03:46.390881 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd2454b-6f80-4879-b440-7056d653ac02 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:03:46.391161 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd2454b-6f80-4879-b440-7056d653ac02 None None] PATH_INFO: `/v3` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:03:46.395544 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1/1] 10.222.0.42 () {50 vars in 791 bytes} [Mon Jul 4 09:03:46 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:03:53.992396 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689caadc-f0a6-4978-9a47-f8e088549dc1 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:03:53.992972 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689caadc-f0a6-4978-9a47-f8e088549dc1 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:03:53.992972 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689caadc-f0a6-4978-9a47-f8e088549dc1 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:03:53.997299 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1/2] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:03:53 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:03:54.003849 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5628192-766f-402a-9240-a5b011dce188 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:03:54.004633 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5628192-766f-402a-9240-a5b011dce188 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:03:54.004758 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5628192-766f-402a-9240-a5b011dce188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:03:54.083352 dv-cinder-844563-4-smb devstack@keystone.service[80181]: INFO dbcounter [None req-f5628192-766f-402a-9240-a5b011dce188 None None] Registered counter for database keystone Jul 04 09:03:54.107690 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG oslo_db.sqlalchemy.engines [None req-f5628192-766f-402a-9240-a5b011dce188 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80181) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 09:03:54.121763 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writer thread running {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 09:03:54.304047 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG passlib.handlers.bcrypt [None req-f5628192-766f-402a-9240-a5b011dce188 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80181) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 04 09:03:54.304442 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG passlib.handlers.bcrypt [None req-f5628192-766f-402a-9240-a5b011dce188 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80181) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 04 09:03:54.359310 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-f5628192-766f-402a-9240-a5b011dce188 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:03:54.361340 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f5628192-766f-402a-9240-a5b011dce188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:03:54.489882 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 2/3] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:03:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 488 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 04 09:03:54.719829 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689caadc-f0a6-4978-9a47-f8e088549dc1 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:03:54.796662 dv-cinder-844563-4-smb devstack@keystone.service[80182]: INFO dbcounter [None req-689caadc-f0a6-4978-9a47-f8e088549dc1 None None] Registered counter for database keystone Jul 04 09:03:54.818025 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG oslo_db.sqlalchemy.engines [None req-689caadc-f0a6-4978-9a47-f8e088549dc1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80182) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 09:03:54.830128 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writer thread running {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 09:03:54.955201 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689caadc-f0a6-4978-9a47-f8e088549dc1 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:03:54.960626 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d923e4-8120-450d-b957-823ee56c4774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:03:54.961287 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d923e4-8120-450d-b957-823ee56c4774 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:03:54.961574 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d923e4-8120-450d-b957-823ee56c4774 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:03:54.961850 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d923e4-8120-450d-b957-823ee56c4774 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:03:54.971120 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d923e4-8120-450d-b957-823ee56c4774 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:03:55.022376 dv-cinder-844563-4-smb devstack@keystone.service[80182]: WARNING keystone.common.rbac_enforcer.enforcer [None req-12d923e4-8120-450d-b957-823ee56c4774 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 04 09:03:55.022949 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d923e4-8120-450d-b957-823ee56c4774 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:03:55.033391 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 2/4] 10.222.0.42 () {58 vars in 1324 bytes} [Mon Jul 4 09:03:54 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 04 09:03:55.040550 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5628192-766f-402a-9240-a5b011dce188 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:03:55.064368 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5628192-766f-402a-9240-a5b011dce188 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:03:55.070842 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe6ba59-8d92-426d-950e-71b6a176d4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:03:55.072016 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe6ba59-8d92-426d-950e-71b6a176d4ce admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:03:55.072304 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe6ba59-8d92-426d-950e-71b6a176d4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:03:55.072580 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe6ba59-8d92-426d-950e-71b6a176d4ce admin admin] PATH_INFO: `/v3/projects/bd20857aebd945c0a3035c21bf5f767e` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:03:55.076965 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe6ba59-8d92-426d-950e-71b6a176d4ce admin admin] RBAC: Authorizing `identity:get_project(project_id=bd20857aebd945c0a3035c21bf5f767e)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:03:55.127430 dv-cinder-844563-4-smb devstack@keystone.service[80181]: WARNING keystone.common.rbac_enforcer.enforcer [None req-dbe6ba59-8d92-426d-950e-71b6a176d4ce admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 04 09:03:55.127750 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe6ba59-8d92-426d-950e-71b6a176d4ce admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:03:55.132486 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 3/5] 10.222.0.42 () {56 vars in 1207 bytes} [Mon Jul 4 09:03:55 2022] GET /identity/v3/projects/bd20857aebd945c0a3035c21bf5f767e => generated 344 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:03:57.116245 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e93af0-ed19-4b38-8162-33296bee57eb None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:03:57.117060 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e93af0-ed19-4b38-8162-33296bee57eb None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:03:57.117242 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e93af0-ed19-4b38-8162-33296bee57eb None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:03:57.123983 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 3/6] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:03:57 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:03:57.131675 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9063b-5a3e-486d-bd4e-a96563fb19ae None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:03:57.132173 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9063b-5a3e-486d-bd4e-a96563fb19ae None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:03:57.132259 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9063b-5a3e-486d-bd4e-a96563fb19ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:03:57.161402 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-adb9063b-5a3e-486d-bd4e-a96563fb19ae None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:03:57.162901 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-adb9063b-5a3e-486d-bd4e-a96563fb19ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:03:57.173001 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 4/7] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:03:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 04 09:03:57.196313 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e93af0-ed19-4b38-8162-33296bee57eb None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:03:57.219229 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e93af0-ed19-4b38-8162-33296bee57eb None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:03:57.225248 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86faa63-a593-4829-8414-a69fed7d0e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:03:57.225880 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86faa63-a593-4829-8414-a69fed7d0e54 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:03:57.226167 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86faa63-a593-4829-8414-a69fed7d0e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:03:57.226441 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86faa63-a593-4829-8414-a69fed7d0e54 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:03:57.234994 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86faa63-a593-4829-8414-a69fed7d0e54 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:03:57.237168 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86faa63-a593-4829-8414-a69fed7d0e54 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:03:57.246458 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 4/8] 10.222.0.42 () {58 vars in 1324 bytes} [Mon Jul 4 09:03:57 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 04 09:03:57.252910 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb9063b-5a3e-486d-bd4e-a96563fb19ae None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:03:57.267690 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb9063b-5a3e-486d-bd4e-a96563fb19ae None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:03:57.276514 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc86ddf-339c-45b8-80c2-3c01d2b46afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:03:57.277870 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc86ddf-339c-45b8-80c2-3c01d2b46afa admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:03:57.278288 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc86ddf-339c-45b8-80c2-3c01d2b46afa admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:03:57.278740 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc86ddf-339c-45b8-80c2-3c01d2b46afa admin admin] PATH_INFO: `/v3/users/04cf7e50af2f41cdb2f3d808072f7c87` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:03:57.281200 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc86ddf-339c-45b8-80c2-3c01d2b46afa admin admin] RBAC: Authorizing `identity:get_user(user_id=04cf7e50af2f41cdb2f3d808072f7c87)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:03:57.283609 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc86ddf-339c-45b8-80c2-3c01d2b46afa admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:03:57.285212 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 5/9] 10.222.0.42 () {56 vars in 1198 bytes} [Mon Jul 4 09:03:57 2022] GET /identity/v3/users/04cf7e50af2f41cdb2f3d808072f7c87 => generated 247 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:03:59.334263 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd80a83c-a6ca-49a7-8144-e021773d0079 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:03:59.334820 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd80a83c-a6ca-49a7-8144-e021773d0079 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:03:59.334820 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd80a83c-a6ca-49a7-8144-e021773d0079 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:03:59.336235 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 5/10] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:03:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:03:59.341567 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ab05b-6cf6-4696-893e-413deac67c07 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:03:59.341996 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ab05b-6cf6-4696-893e-413deac67c07 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:03:59.342078 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ab05b-6cf6-4696-893e-413deac67c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:03:59.356258 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc83269-7337-4baf-9201-94e6a67247a2 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:03:59.356544 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc83269-7337-4baf-9201-94e6a67247a2 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:03:59.356822 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc83269-7337-4baf-9201-94e6a67247a2 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:03:59.358162 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 6/11] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:03:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:03:59.359493 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-dc7ab05b-6cf6-4696-893e-413deac67c07 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:03:59.360802 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-dc7ab05b-6cf6-4696-893e-413deac67c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:03:59.363647 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc331e-0ada-482b-a0e9-cc2fc88516df None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:03:59.363971 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc331e-0ada-482b-a0e9-cc2fc88516df None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:03:59.364224 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc331e-0ada-482b-a0e9-cc2fc88516df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:03:59.403644 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG passlib.handlers.bcrypt [None req-3dfc331e-0ada-482b-a0e9-cc2fc88516df None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80182) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 04 09:03:59.404953 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG passlib.handlers.bcrypt [None req-3dfc331e-0ada-482b-a0e9-cc2fc88516df None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80182) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 04 09:03:59.445601 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 6/12] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:03:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 09:03:59.449879 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-3dfc331e-0ada-482b-a0e9-cc2fc88516df None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:03:59.451493 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-3dfc331e-0ada-482b-a0e9-cc2fc88516df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:03:59.468742 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ab05b-6cf6-4696-893e-413deac67c07 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:03:59.494674 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:03:59.555897 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 7/13] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:03:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 09:03:59.578121 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfc331e-0ada-482b-a0e9-cc2fc88516df None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:03:59.583629 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ab05b-6cf6-4696-893e-413deac67c07 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:03:59.617745 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba3ad4-c590-4ae5-ba8c-5fc33d439b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:03:59.618475 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba3ad4-c590-4ae5-ba8c-5fc33d439b54 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:03:59.618748 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba3ad4-c590-4ae5-ba8c-5fc33d439b54 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:03:59.619022 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba3ad4-c590-4ae5-ba8c-5fc33d439b54 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:03:59.629963 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ba3ad4-c590-4ae5-ba8c-5fc33d439b54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:03:59.641071 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-18ba3ad4-c590-4ae5-ba8c-5fc33d439b54 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:03:59.641071 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:03:59.641071 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:03:59.641071 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:03:59.641071 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:03:59.641071 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:03:59.641071 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:03:59.641071 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:03:59.641071 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:03:59.641071 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:03:59.641071 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:03:59.641071 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:03:59.641071 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:03:59.641071 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:03:59.641071 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:03:59.641071 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:03:59.642070 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:03:59.642070 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:03:59.642070 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:03:59.642070 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:03:59.642070 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:03:59.642070 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:03:59.642070 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:03:59.642070 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:03:59.642070 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:03:59.642070 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:03:59.642070 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:03:59.642070 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:03:59.642070 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:03:59.642070 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:03:59.642070 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:03:59.642070 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:03:59.642916 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:03:59.642916 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:03:59.642916 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:03:59.642916 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:03:59.642916 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:03:59.642916 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:03:59.642916 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:03:59.642916 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:03:59.642916 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:03:59.642916 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:03:59.642916 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:03:59.642916 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:03:59.642916 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 7/14] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Jul 4 09:03:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:03:59.649821 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba3ad4-c590-4ae5-ba8c-5fc33d439b54 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:03:59.686047 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfc331e-0ada-482b-a0e9-cc2fc88516df None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:03:59.688343 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:03:59.722841 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098186e2-a4e0-443e-ac1a-02216ec66b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:03:59.723751 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098186e2-a4e0-443e-ac1a-02216ec66b3a None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:03:59.724065 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098186e2-a4e0-443e-ac1a-02216ec66b3a None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:03:59.724347 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098186e2-a4e0-443e-ac1a-02216ec66b3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:03:59.730429 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:03:59.749656 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba3ad4-c590-4ae5-ba8c-5fc33d439b54 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:03:59.783663 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b94dfc-4202-42df-b0b4-79334a74bc62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:03:59.784362 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b94dfc-4202-42df-b0b4-79334a74bc62 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:03:59.784646 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b94dfc-4202-42df-b0b4-79334a74bc62 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:03:59.784917 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b94dfc-4202-42df-b0b4-79334a74bc62 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:03:59.785763 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b94dfc-4202-42df-b0b4-79334a74bc62 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:03:59.785964 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b94dfc-4202-42df-b0b4-79334a74bc62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:03:59.787395 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b94dfc-4202-42df-b0b4-79334a74bc62 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:03:59.788843 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098186e2-a4e0-443e-ac1a-02216ec66b3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:03:59.790393 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098186e2-a4e0-443e-ac1a-02216ec66b3a None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:03:59.799395 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 8/15] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jul 4 09:03:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:03:59.804966 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b94dfc-4202-42df-b0b4-79334a74bc62 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:03:59.888952 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 8/16] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jul 4 09:03:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 04 09:03:59.894814 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098186e2-a4e0-443e-ac1a-02216ec66b3a None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:03:59.897871 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:03:59.912401 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b94dfc-4202-42df-b0b4-79334a74bc62 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:03:59.946548 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4047834d-e6f3-4bae-8919-b366600f8d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:03:59.947423 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4047834d-e6f3-4bae-8919-b366600f8d2a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:03:59.947712 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4047834d-e6f3-4bae-8919-b366600f8d2a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:03:59.948023 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4047834d-e6f3-4bae-8919-b366600f8d2a None admin] PATH_INFO: `/v3/users/04cf7e50af2f41cdb2f3d808072f7c87` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:03:59.949241 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4047834d-e6f3-4bae-8919-b366600f8d2a None admin] RBAC: Authorizing `identity:get_user(user_id=04cf7e50af2f41cdb2f3d808072f7c87)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:03:59.950784 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4047834d-e6f3-4bae-8919-b366600f8d2a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:03:59.952711 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 9/17] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Jul 4 09:03:59 2022] GET /identity/v3/users/04cf7e50af2f41cdb2f3d808072f7c87 => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:03:59.957980 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4047834d-e6f3-4bae-8919-b366600f8d2a None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:03:59.972240 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:03:59.992970 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098186e2-a4e0-443e-ac1a-02216ec66b3a None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:00.025579 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5cb78f-38da-40ab-a72b-7f424ef22b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:00.026377 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5cb78f-38da-40ab-a72b-7f424ef22b7a None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:00.026664 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5cb78f-38da-40ab-a72b-7f424ef22b7a None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:00.026939 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5cb78f-38da-40ab-a72b-7f424ef22b7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:00.045735 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5cb78f-38da-40ab-a72b-7f424ef22b7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:00.047251 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5cb78f-38da-40ab-a72b-7f424ef22b7a None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:00.056977 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4047834d-e6f3-4bae-8919-b366600f8d2a None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:00.070283 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-2d5cb78f-38da-40ab-a72b-7f424ef22b7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:04:00.070283 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:04:00.070283 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:04:00.070283 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:04:00.070283 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:04:00.070283 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:04:00.070283 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:04:00.070283 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:04:00.070283 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:04:00.070283 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:04:00.070283 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:04:00.070283 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:04:00.070283 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:04:00.070283 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:04:00.070283 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:04:00.071135 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:04:00.071135 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:04:00.071135 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:04:00.071135 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:04:00.071135 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:04:00.071135 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:04:00.071135 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:04:00.071135 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:04:00.071135 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:04:00.071135 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:04:00.071135 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:04:00.071135 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:04:00.071135 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:04:00.071135 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:04:00.071135 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:04:00.071135 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:04:00.071135 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:04:00.071977 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:04:00.071977 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:04:00.071977 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:04:00.071977 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:04:00.071977 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 9/18] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:03:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:04:00.077518 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5cb78f-38da-40ab-a72b-7f424ef22b7a None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:00.094987 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f552f3e-9f3f-4491-be79-e2c2b4ff02a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:00.095773 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f552f3e-9f3f-4491-be79-e2c2b4ff02a8 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:00.096086 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f552f3e-9f3f-4491-be79-e2c2b4ff02a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:00.096358 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f552f3e-9f3f-4491-be79-e2c2b4ff02a8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:00.097571 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f552f3e-9f3f-4491-be79-e2c2b4ff02a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:00.099054 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f552f3e-9f3f-4491-be79-e2c2b4ff02a8 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:00.100904 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 10/19] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:03:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:04:00.106431 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f552f3e-9f3f-4491-be79-e2c2b4ff02a8 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:00.135519 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:00.183856 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5cb78f-38da-40ab-a72b-7f424ef22b7a None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:00.187919 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:00.207848 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f552f3e-9f3f-4491-be79-e2c2b4ff02a8 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:00.217330 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0bb363-0cad-4af4-b492-a9400d76c5f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:00.217997 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0bb363-0cad-4af4-b492-a9400d76c5f7 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:00.218288 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0bb363-0cad-4af4-b492-a9400d76c5f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:00.218560 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0bb363-0cad-4af4-b492-a9400d76c5f7 None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:00.219303 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0bb363-0cad-4af4-b492-a9400d76c5f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:04:00.219617 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0bb363-0cad-4af4-b492-a9400d76c5f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:00.221135 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0bb363-0cad-4af4-b492-a9400d76c5f7 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:00.238630 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 10/20] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jul 4 09:04:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:00.244423 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886a54c3-44ce-4455-81a6-c9ba9d7c1e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:00.245102 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a54c3-44ce-4455-81a6-c9ba9d7c1e5a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:00.245385 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a54c3-44ce-4455-81a6-c9ba9d7c1e5a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:00.245655 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a54c3-44ce-4455-81a6-c9ba9d7c1e5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:00.246510 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886a54c3-44ce-4455-81a6-c9ba9d7c1e5a None admin] RBAC: Adding query filter params (role.id=965049e7ce6144aaad23c15f3a5e37c3, scope.domain.id=default, user.id=04cf7e50af2f41cdb2f3d808072f7c87) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:04:00.246822 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886a54c3-44ce-4455-81a6-c9ba9d7c1e5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:00.248363 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886a54c3-44ce-4455-81a6-c9ba9d7c1e5a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:00.256686 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 11/21] 10.222.0.42 () {56 vars in 1322 bytes} [Mon Jul 4 09:04:00 2022] GET /identity/v3/role_assignments?user.id=04cf7e50af2f41cdb2f3d808072f7c87&scope.domain.id=default&role.id=965049e7ce6144aaad23c15f3a5e37c3 => generated 233 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:04:02.563940 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a908bcb4-15dc-4587-ace4-80e68a65c303 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:02.564476 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a908bcb4-15dc-4587-ace4-80e68a65c303 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:02.564476 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a908bcb4-15dc-4587-ace4-80e68a65c303 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:02.566041 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 11/22] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:04:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:04:02.573244 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e8f42-9a18-4422-92cd-febb63657991 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:02.573663 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e8f42-9a18-4422-92cd-febb63657991 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:02.573794 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e8f42-9a18-4422-92cd-febb63657991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:02.596870 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-239e8f42-9a18-4422-92cd-febb63657991 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:04:02.598305 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-239e8f42-9a18-4422-92cd-febb63657991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:04:02.682291 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e6531-9a34-40b7-b917-83df236951ae None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:02.682921 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e6531-9a34-40b7-b917-83df236951ae None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:02.683401 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e6531-9a34-40b7-b917-83df236951ae None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:02.685005 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 12/23] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:04:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:04:02.690183 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f5210-14a6-4995-8f05-7133ae4eee32 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:02.690742 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f5210-14a6-4995-8f05-7133ae4eee32 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:02.690854 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 12/24] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:04:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:04:02.691338 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f5210-14a6-4995-8f05-7133ae4eee32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:02.708996 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-f40f5210-14a6-4995-8f05-7133ae4eee32 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:04:02.710491 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-f40f5210-14a6-4995-8f05-7133ae4eee32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:04:02.725273 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239e8f42-9a18-4422-92cd-febb63657991 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:02.811396 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 13/25] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:04:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 09:04:02.813089 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e77d6a-64eb-48a0-8358-ab706f59e1e5 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:02.813608 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e77d6a-64eb-48a0-8358-ab706f59e1e5 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:02.816936 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e77d6a-64eb-48a0-8358-ab706f59e1e5 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:02.818461 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 14/26] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:04:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:04:02.824761 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a44f9-a7a9-413c-a063-98038383e626 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:02.825290 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a44f9-a7a9-413c-a063-98038383e626 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:02.825771 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a44f9-a7a9-413c-a063-98038383e626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:02.849610 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-c48a44f9-a7a9-413c-a063-98038383e626 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:04:02.851294 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-c48a44f9-a7a9-413c-a063-98038383e626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:04:02.868268 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:02.911661 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239e8f42-9a18-4422-92cd-febb63657991 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:02.935382 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:02.963433 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53c7945-23aa-47a8-a561-2ff104b9c350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:02.964799 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c7945-23aa-47a8-a561-2ff104b9c350 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:02.965297 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c7945-23aa-47a8-a561-2ff104b9c350 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:02.965838 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c7945-23aa-47a8-a561-2ff104b9c350 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:02.978612 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53c7945-23aa-47a8-a561-2ff104b9c350 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:02.980472 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53c7945-23aa-47a8-a561-2ff104b9c350 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:02.987454 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 15/27] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:04:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 09:04:02.988691 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48a44f9-a7a9-413c-a063-98038383e626 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:03.006799 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-f53c7945-23aa-47a8-a561-2ff104b9c350 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:04:03.006799 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:04:03.006799 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:04:03.006799 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:04:03.006799 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:04:03.006799 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:04:03.006799 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:04:03.006799 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:04:03.006799 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:04:03.006799 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:04:03.006799 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:04:03.006799 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:04:03.006799 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:04:03.006799 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:04:03.006799 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:04:03.007682 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:04:03.007682 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:04:03.007682 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:04:03.007682 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:04:03.007682 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:04:03.007682 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:04:03.007682 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:04:03.007682 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:04:03.007682 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:04:03.007682 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:04:03.007682 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:04:03.007682 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:04:03.007682 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:04:03.007682 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:04:03.007682 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:04:03.007682 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:04:03.007682 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:04:03.008529 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:04:03.008529 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:04:03.008529 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:04:03.008529 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:04:03.010908 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 13/28] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:04:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:04:03.017098 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53c7945-23aa-47a8-a561-2ff104b9c350 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:03.113794 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48a44f9-a7a9-413c-a063-98038383e626 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:03.158183 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d73d8-8f6e-4968-9cf8-b0c9c869542d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:03.158864 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d73d8-8f6e-4968-9cf8-b0c9c869542d None admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:03.159148 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d73d8-8f6e-4968-9cf8-b0c9c869542d None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:03.159423 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d73d8-8f6e-4968-9cf8-b0c9c869542d None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:03.160210 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967d73d8-8f6e-4968-9cf8-b0c9c869542d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:03.161615 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967d73d8-8f6e-4968-9cf8-b0c9c869542d None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:03.192007 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53c7945-23aa-47a8-a561-2ff104b9c350 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:03.223185 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:03.232766 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32f65d7-7460-4cff-afb7-058c4122d6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:03.233428 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f65d7-7460-4cff-afb7-058c4122d6f7 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:03.233712 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f65d7-7460-4cff-afb7-058c4122d6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:03.234034 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f65d7-7460-4cff-afb7-058c4122d6f7 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:03.234811 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32f65d7-7460-4cff-afb7-058c4122d6f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:04:03.235120 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32f65d7-7460-4cff-afb7-058c4122d6f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:03.236948 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32f65d7-7460-4cff-afb7-058c4122d6f7 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:03.255152 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 14/29] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jul 4 09:04:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:03.256058 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32f65d7-7460-4cff-afb7-058c4122d6f7 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:03.299360 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 16/30] 10.222.0.42 () {60 vars in 1131 bytes} [Mon Jul 4 09:04:02 2022] POST /identity/v3/roles => generated 219 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:04:03.305852 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f5724-e346-4b36-aa40-c4fe9d902532 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:03.306334 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f5724-e346-4b36-aa40-c4fe9d902532 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:03.306770 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f5724-e346-4b36-aa40-c4fe9d902532 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:03.312578 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 17/31] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:04:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:04:03.314005 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2f5724-e346-4b36-aa40-c4fe9d902532 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:03.379802 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32f65d7-7460-4cff-afb7-058c4122d6f7 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:03.419548 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:03.424126 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd00f3-d007-4d83-9df6-ebed6ec3f431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:03.425078 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd00f3-d007-4d83-9df6-ebed6ec3f431 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:03.425360 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd00f3-d007-4d83-9df6-ebed6ec3f431 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:03.425869 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd00f3-d007-4d83-9df6-ebed6ec3f431 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:03.439621 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cd00f3-d007-4d83-9df6-ebed6ec3f431 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:04:03.448560 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-14cd00f3-d007-4d83-9df6-ebed6ec3f431 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:04:03.448560 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:04:03.448560 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:04:03.448560 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:04:03.448560 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:04:03.448560 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:04:03.448560 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:04:03.448560 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:04:03.448560 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:04:03.448560 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:04:03.448560 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:04:03.448560 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:04:03.448560 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:04:03.448560 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:04:03.448560 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:04:03.448560 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:04:03.449778 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:04:03.449778 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:04:03.449778 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:04:03.449778 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:04:03.449778 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:04:03.449778 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:04:03.449778 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:04:03.449778 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:04:03.449778 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:04:03.449778 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:04:03.449778 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:04:03.449778 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:04:03.449778 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:04:03.449778 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:04:03.449778 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:04:03.449778 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:04:03.450801 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:04:03.450801 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:04:03.450801 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:04:03.450801 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:04:03.450801 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:04:03.450801 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:04:03.450801 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:04:03.450801 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:04:03.450801 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:04:03.450801 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:04:03.450801 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:04:03.450801 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:04:03.450801 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 15/32] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Jul 4 09:04:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:04:03.451485 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe7cd3-226b-401c-9e69-25531375d712 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:03.451645 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe7cd3-226b-401c-9e69-25531375d712 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:03.452044 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe7cd3-226b-401c-9e69-25531375d712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:03.474111 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-c6fe7cd3-226b-401c-9e69-25531375d712 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:04:03.475367 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c6fe7cd3-226b-401c-9e69-25531375d712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:04:03.527659 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:03.564025 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 16/33] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:04:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:04:03.565278 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fe7cd3-226b-401c-9e69-25531375d712 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:03.590451 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2f5724-e346-4b36-aa40-c4fe9d902532 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:03.631998 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56bfde2-14d5-48d6-a3b4-3b9c36f793a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:03.632589 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56bfde2-14d5-48d6-a3b4-3b9c36f793a4 None admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:03.632870 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56bfde2-14d5-48d6-a3b4-3b9c36f793a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:03.633145 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56bfde2-14d5-48d6-a3b4-3b9c36f793a4 None admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:03.634147 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56bfde2-14d5-48d6-a3b4-3b9c36f793a4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:03.636297 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56bfde2-14d5-48d6-a3b4-3b9c36f793a4 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:03.680039 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 18/34] 10.222.0.42 () {60 vars in 1141 bytes} [Mon Jul 4 09:04:03 2022] POST /identity/v3/projects => generated 301 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:04:03.682532 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56bfde2-14d5-48d6-a3b4-3b9c36f793a4 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:03.726624 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fe7cd3-226b-401c-9e69-25531375d712 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:03.776420 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bebfcb-dbb9-4d39-bfaa-82349c84d806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:03.777138 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bebfcb-dbb9-4d39-bfaa-82349c84d806 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:03.777420 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bebfcb-dbb9-4d39-bfaa-82349c84d806 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:03.777689 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bebfcb-dbb9-4d39-bfaa-82349c84d806 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:03.778554 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bebfcb-dbb9-4d39-bfaa-82349c84d806 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:04:03.778821 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bebfcb-dbb9-4d39-bfaa-82349c84d806 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:03.780445 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bebfcb-dbb9-4d39-bfaa-82349c84d806 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:03.795198 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 17/35] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jul 4 09:04:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:03.805242 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bebfcb-dbb9-4d39-bfaa-82349c84d806 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:03.805419 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:03.823923 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56bfde2-14d5-48d6-a3b4-3b9c36f793a4 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:03.857429 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48cc126-9c8c-46b7-ac8f-66487cf8ee34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:03.858216 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48cc126-9c8c-46b7-ac8f-66487cf8ee34 None admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:03.858570 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48cc126-9c8c-46b7-ac8f-66487cf8ee34 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:03.858918 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48cc126-9c8c-46b7-ac8f-66487cf8ee34 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:03.859800 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48cc126-9c8c-46b7-ac8f-66487cf8ee34 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:03.861688 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48cc126-9c8c-46b7-ac8f-66487cf8ee34 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:03.884203 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 19/36] 10.222.0.42 () {60 vars in 1131 bytes} [Mon Jul 4 09:04:03 2022] POST /identity/v3/roles => generated 225 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:04:03.900493 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:03.980321 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bebfcb-dbb9-4d39-bfaa-82349c84d806 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:04.014392 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7cbdf6-fe6d-4c8f-b59f-28449115158e None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:04.014723 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7cbdf6-fe6d-4c8f-b59f-28449115158e None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:04.014963 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7cbdf6-fe6d-4c8f-b59f-28449115158e None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:04.016468 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 20/37] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:04:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:04:04.023767 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e90bc-76d3-4961-a4ef-497ee0e4e524 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:04.024093 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e90bc-76d3-4961-a4ef-497ee0e4e524 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:04.024364 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e90bc-76d3-4961-a4ef-497ee0e4e524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:04.027147 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa6391d-2447-4af7-9bdf-73f05656f300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:04.028113 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa6391d-2447-4af7-9bdf-73f05656f300 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:04.028397 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa6391d-2447-4af7-9bdf-73f05656f300 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:04.028681 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa6391d-2447-4af7-9bdf-73f05656f300 None admin] PATH_INFO: `/v3/users/04cf7e50af2f41cdb2f3d808072f7c87` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:04.030433 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa6391d-2447-4af7-9bdf-73f05656f300 None admin] RBAC: Authorizing `identity:get_user(user_id=04cf7e50af2f41cdb2f3d808072f7c87)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:04.032294 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa6391d-2447-4af7-9bdf-73f05656f300 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:04.034544 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 18/38] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Jul 4 09:04:03 2022] GET /identity/v3/users/04cf7e50af2f41cdb2f3d808072f7c87 => generated 247 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:04.040367 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa6391d-2447-4af7-9bdf-73f05656f300 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:04.043510 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-877e90bc-76d3-4961-a4ef-497ee0e4e524 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:04:04.045199 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-877e90bc-76d3-4961-a4ef-497ee0e4e524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:04:04.138696 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 21/39] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:04:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 09:04:04.163275 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa6391d-2447-4af7-9bdf-73f05656f300 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:04.164452 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877e90bc-76d3-4961-a4ef-497ee0e4e524 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:04.175422 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:04.208427 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f1a8e2-4d94-4666-8e09-6c1e55a76cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:04.209232 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f1a8e2-4d94-4666-8e09-6c1e55a76cf6 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:04.209515 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f1a8e2-4d94-4666-8e09-6c1e55a76cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:04.209790 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f1a8e2-4d94-4666-8e09-6c1e55a76cf6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:04.211002 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f1a8e2-4d94-4666-8e09-6c1e55a76cf6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:04.212689 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f1a8e2-4d94-4666-8e09-6c1e55a76cf6 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:04.214541 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 19/40] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:04:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:04:04.221018 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f1a8e2-4d94-4666-8e09-6c1e55a76cf6 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:04.264412 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:04.290075 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877e90bc-76d3-4961-a4ef-497ee0e4e524 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:04.328134 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225bb59e-84ce-4f02-aa83-488cafc27ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:04.328751 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225bb59e-84ce-4f02-aa83-488cafc27ba4 None admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:04.329071 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225bb59e-84ce-4f02-aa83-488cafc27ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:04.329345 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225bb59e-84ce-4f02-aa83-488cafc27ba4 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:04.330098 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225bb59e-84ce-4f02-aa83-488cafc27ba4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:04.331501 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225bb59e-84ce-4f02-aa83-488cafc27ba4 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:04.339932 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f1a8e2-4d94-4666-8e09-6c1e55a76cf6 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:04.346305 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 22/41] 10.222.0.42 () {60 vars in 1131 bytes} [Mon Jul 4 09:04:04 2022] POST /identity/v3/roles => generated 223 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:04:04.350235 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f0154-22cc-44c4-b72c-f2799874fc44 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:04.350537 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f0154-22cc-44c4-b72c-f2799874fc44 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:04.350825 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f0154-22cc-44c4-b72c-f2799874fc44 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:04.352497 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 23/42] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:04:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:04:04.357832 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0eaeff-4a6d-418d-b6b4-72d01d56fc46 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:04.358128 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0eaeff-4a6d-418d-b6b4-72d01d56fc46 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:04.358419 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0eaeff-4a6d-418d-b6b4-72d01d56fc46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:04.378301 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-ac0eaeff-4a6d-418d-b6b4-72d01d56fc46 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:04:04.379537 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-ac0eaeff-4a6d-418d-b6b4-72d01d56fc46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:04:04.387252 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f793d1-e89a-409e-8183-0e1f31489231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:04.388186 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f793d1-e89a-409e-8183-0e1f31489231 None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:04.388471 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f793d1-e89a-409e-8183-0e1f31489231 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:04.388802 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f793d1-e89a-409e-8183-0e1f31489231 None admin] PATH_INFO: `/v3/domains/default/users/04cf7e50af2f41cdb2f3d808072f7c87/roles/965049e7ce6144aaad23c15f3a5e37c3` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:04.390871 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f793d1-e89a-409e-8183-0e1f31489231 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=04cf7e50af2f41cdb2f3d808072f7c87, role_id=965049e7ce6144aaad23c15f3a5e37c3)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:04.392521 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f793d1-e89a-409e-8183-0e1f31489231 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:04.462350 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 24/43] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:04:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 09:04:04.488830 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0eaeff-4a6d-418d-b6b4-72d01d56fc46 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:04.571996 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:04.608776 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0eaeff-4a6d-418d-b6b4-72d01d56fc46 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:04.617034 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 20/44] 10.222.0.42 () {58 vars in 1361 bytes} [Mon Jul 4 09:04:04 2022] PUT /identity/v3/domains/default/users/04cf7e50af2f41cdb2f3d808072f7c87/roles/965049e7ce6144aaad23c15f3a5e37c3 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:04:04.647396 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141c71a0-af5a-47ef-910c-f7ad2941423c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:04.648159 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141c71a0-af5a-47ef-910c-f7ad2941423c None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:04.648446 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141c71a0-af5a-47ef-910c-f7ad2941423c None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:04.648722 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141c71a0-af5a-47ef-910c-f7ad2941423c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:04.650069 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141c71a0-af5a-47ef-910c-f7ad2941423c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:04.651715 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141c71a0-af5a-47ef-910c-f7ad2941423c None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:04.653584 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 25/45] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:04:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:04:04.660352 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f793d1-e89a-409e-8183-0e1f31489231 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:04.701743 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:04.775982 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f793d1-e89a-409e-8183-0e1f31489231 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:04.809702 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41f0978-6177-4e9c-a282-ee26acd93f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:04.810365 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41f0978-6177-4e9c-a282-ee26acd93f88 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:04.810650 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41f0978-6177-4e9c-a282-ee26acd93f88 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:04.810929 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41f0978-6177-4e9c-a282-ee26acd93f88 None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:04.811642 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41f0978-6177-4e9c-a282-ee26acd93f88 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:04.813412 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41f0978-6177-4e9c-a282-ee26acd93f88 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:04.843335 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 21/46] 10.222.0.42 () {60 vars in 1141 bytes} [Mon Jul 4 09:04:04 2022] POST /identity/v3/projects => generated 312 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:04:06.605536 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6134e7-9865-4388-a2e8-0347daa46740 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:06.606070 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6134e7-9865-4388-a2e8-0347daa46740 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:06.606070 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6134e7-9865-4388-a2e8-0347daa46740 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:06.607459 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 26/47] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:04:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:04:06.613250 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ed68f-4244-44cf-a717-8533b5cd83de None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:06.613647 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ed68f-4244-44cf-a717-8533b5cd83de None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:06.613846 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ed68f-4244-44cf-a717-8533b5cd83de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:06.631862 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-249ed68f-4244-44cf-a717-8533b5cd83de None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:04:06.633483 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-249ed68f-4244-44cf-a717-8533b5cd83de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:04:06.702633 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 22/48] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:04:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:04:06.725666 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6134e7-9865-4388-a2e8-0347daa46740 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:06.825597 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a88f78-a8b0-45f7-bd2b-71052114b30a None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:06.825883 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a88f78-a8b0-45f7-bd2b-71052114b30a None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:06.826161 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a88f78-a8b0-45f7-bd2b-71052114b30a None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:06.827550 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 23/49] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:04:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:04:06.830578 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6134e7-9865-4388-a2e8-0347daa46740 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:06.832332 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12da1cf-31f7-4a23-97da-87226a71d48d None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:06.832549 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12da1cf-31f7-4a23-97da-87226a71d48d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:06.832840 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12da1cf-31f7-4a23-97da-87226a71d48d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:06.849282 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-d12da1cf-31f7-4a23-97da-87226a71d48d None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:04:06.850471 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d12da1cf-31f7-4a23-97da-87226a71d48d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:04:06.861672 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:06.865573 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c9add4-c69a-4029-8b2b-8a735392f6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:06.866566 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c9add4-c69a-4029-8b2b-8a735392f6fc None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:06.866886 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c9add4-c69a-4029-8b2b-8a735392f6fc None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:06.867164 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c9add4-c69a-4029-8b2b-8a735392f6fc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:06.870943 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:06.880002 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c9add4-c69a-4029-8b2b-8a735392f6fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:04:06.888142 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-16c9add4-c69a-4029-8b2b-8a735392f6fc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:04:06.888142 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:04:06.888142 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:04:06.888142 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:04:06.888142 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:04:06.888142 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:04:06.888142 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:04:06.888142 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:04:06.888142 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:04:06.888142 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:04:06.888142 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:04:06.888142 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:04:06.888142 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:04:06.888142 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:04:06.888142 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:04:06.888142 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:04:06.889096 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:04:06.889096 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:04:06.889096 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:04:06.889096 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:04:06.889096 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:04:06.889096 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:04:06.889096 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:04:06.889096 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:04:06.889096 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:04:06.889096 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:04:06.889096 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:04:06.889096 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:04:06.889096 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:04:06.889096 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:04:06.889096 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:04:06.889096 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:04:06.889866 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:04:06.889866 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:04:06.889866 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:04:06.889866 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:04:06.889866 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:04:06.889866 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:04:06.889866 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:04:06.889866 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:04:06.889866 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:04:06.889866 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:04:06.889866 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:04:06.889866 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:04:06.889866 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 27/50] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Jul 4 09:04:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:04:06.895049 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c9add4-c69a-4029-8b2b-8a735392f6fc None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:06.922321 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 24/51] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:04:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 09:04:06.944572 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12da1cf-31f7-4a23-97da-87226a71d48d None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:06.994999 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c9add4-c69a-4029-8b2b-8a735392f6fc None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:07.028339 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9994900d-75bf-4345-93ed-4293708484f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:07.029005 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9994900d-75bf-4345-93ed-4293708484f5 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:07.029290 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9994900d-75bf-4345-93ed-4293708484f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:07.029564 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9994900d-75bf-4345-93ed-4293708484f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:07.030322 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9994900d-75bf-4345-93ed-4293708484f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:04:07.030631 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9994900d-75bf-4345-93ed-4293708484f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:07.032091 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9994900d-75bf-4345-93ed-4293708484f5 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:07.043745 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 28/52] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jul 4 09:04:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:04:07.044063 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12da1cf-31f7-4a23-97da-87226a71d48d None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:07.049399 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9994900d-75bf-4345-93ed-4293708484f5 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:07.077146 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bb060d-3c1e-4466-9945-2d9fa64c2199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:07.077932 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb060d-3c1e-4466-9945-2d9fa64c2199 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:07.078210 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb060d-3c1e-4466-9945-2d9fa64c2199 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:07.078483 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb060d-3c1e-4466-9945-2d9fa64c2199 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:07.079743 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bb060d-3c1e-4466-9945-2d9fa64c2199 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:07.081226 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bb060d-3c1e-4466-9945-2d9fa64c2199 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:07.082848 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 25/53] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:04:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:04:07.088213 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bb060d-3c1e-4466-9945-2d9fa64c2199 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:07.102957 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:07.106798 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:07.150206 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9994900d-75bf-4345-93ed-4293708484f5 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:07.183880 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeee8de-ad5c-4a14-977f-d98cbafd8bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:07.184792 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeee8de-ad5c-4a14-977f-d98cbafd8bc5 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:07.185080 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeee8de-ad5c-4a14-977f-d98cbafd8bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:07.185357 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeee8de-ad5c-4a14-977f-d98cbafd8bc5 None admin] PATH_INFO: `/v3/users/04cf7e50af2f41cdb2f3d808072f7c87` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:07.186810 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeee8de-ad5c-4a14-977f-d98cbafd8bc5 None admin] RBAC: Authorizing `identity:get_user(user_id=04cf7e50af2f41cdb2f3d808072f7c87)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:07.186924 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bb060d-3c1e-4466-9945-2d9fa64c2199 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:07.188331 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeee8de-ad5c-4a14-977f-d98cbafd8bc5 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:07.190145 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 29/54] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Jul 4 09:04:07 2022] GET /identity/v3/users/04cf7e50af2f41cdb2f3d808072f7c87 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:04:07.195423 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeee8de-ad5c-4a14-977f-d98cbafd8bc5 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:07.221556 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872faf5a-0e99-431c-80e6-db77e827878a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:07.222220 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872faf5a-0e99-431c-80e6-db77e827878a None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:07.222488 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872faf5a-0e99-431c-80e6-db77e827878a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:07.222785 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872faf5a-0e99-431c-80e6-db77e827878a None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:07.223499 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872faf5a-0e99-431c-80e6-db77e827878a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:07.225018 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872faf5a-0e99-431c-80e6-db77e827878a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:07.251850 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 26/55] 10.222.0.42 () {60 vars in 1140 bytes} [Mon Jul 4 09:04:07 2022] POST /identity/v3/projects => generated 298 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:04:07.300109 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeee8de-ad5c-4a14-977f-d98cbafd8bc5 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:07.327371 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:07.337122 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9add381-692f-4e07-a9a7-c879c1207bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:07.337939 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9add381-692f-4e07-a9a7-c879c1207bd4 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:07.338227 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9add381-692f-4e07-a9a7-c879c1207bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:07.338500 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9add381-692f-4e07-a9a7-c879c1207bd4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:07.339731 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9add381-692f-4e07-a9a7-c879c1207bd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:07.341250 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9add381-692f-4e07-a9a7-c879c1207bd4 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:07.342909 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 30/56] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:04:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:07.349085 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872faf5a-0e99-431c-80e6-db77e827878a None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:07.417968 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:07.455065 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872faf5a-0e99-431c-80e6-db77e827878a None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:07.488319 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1630c61f-f1fd-4ea0-ab63-fb4d089d34c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:07.488979 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1630c61f-f1fd-4ea0-ab63-fb4d089d34c3 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:07.489266 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1630c61f-f1fd-4ea0-ab63-fb4d089d34c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:07.489546 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1630c61f-f1fd-4ea0-ab63-fb4d089d34c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:07.490415 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1630c61f-f1fd-4ea0-ab63-fb4d089d34c3 None admin] RBAC: Adding query filter params (role.id=965049e7ce6144aaad23c15f3a5e37c3, scope.domain.id=default, user.id=04cf7e50af2f41cdb2f3d808072f7c87) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:04:07.490728 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1630c61f-f1fd-4ea0-ab63-fb4d089d34c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:07.492237 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1630c61f-f1fd-4ea0-ab63-fb4d089d34c3 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:07.498588 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 27/57] 10.222.0.42 () {56 vars in 1322 bytes} [Mon Jul 4 09:04:07 2022] GET /identity/v3/role_assignments?user.id=04cf7e50af2f41cdb2f3d808072f7c87&scope.domain.id=default&role.id=965049e7ce6144aaad23c15f3a5e37c3 => generated 530 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:04:09.257959 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04675680-ba46-4626-af0b-2145a17187e4 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:09.258781 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04675680-ba46-4626-af0b-2145a17187e4 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:09.258867 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04675680-ba46-4626-af0b-2145a17187e4 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:09.261053 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 31/58] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:04:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:04:09.267097 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e43f7-480d-475c-ad85-0d66814666b3 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:09.267506 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e43f7-480d-475c-ad85-0d66814666b3 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:09.267829 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e43f7-480d-475c-ad85-0d66814666b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:09.292063 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-234e43f7-480d-475c-ad85-0d66814666b3 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:04:09.293331 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-234e43f7-480d-475c-ad85-0d66814666b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:04:09.366158 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 28/59] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:04:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 09:04:09.392355 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04675680-ba46-4626-af0b-2145a17187e4 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:09.607521 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04675680-ba46-4626-af0b-2145a17187e4 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:09.642323 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d50737-06f2-4cbd-a0aa-62131bb4a9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:09.643104 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d50737-06f2-4cbd-a0aa-62131bb4a9c3 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:09.643391 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d50737-06f2-4cbd-a0aa-62131bb4a9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:09.643666 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d50737-06f2-4cbd-a0aa-62131bb4a9c3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:09.644870 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d50737-06f2-4cbd-a0aa-62131bb4a9c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:09.646321 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d50737-06f2-4cbd-a0aa-62131bb4a9c3 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:09.647950 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 32/60] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:04:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:09.656743 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234e43f7-480d-475c-ad85-0d66814666b3 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:09.721026 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:09.775188 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234e43f7-480d-475c-ad85-0d66814666b3 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:09.814565 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886579ef-5767-4a6a-854a-9bc94499f56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:09.815228 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886579ef-5767-4a6a-854a-9bc94499f56c None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:09.815514 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886579ef-5767-4a6a-854a-9bc94499f56c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:09.815793 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886579ef-5767-4a6a-854a-9bc94499f56c None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:09.816528 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886579ef-5767-4a6a-854a-9bc94499f56c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:09.818017 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886579ef-5767-4a6a-854a-9bc94499f56c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:09.845509 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 29/61] 10.222.0.42 () {60 vars in 1132 bytes} [Mon Jul 4 09:04:09 2022] POST /identity/v3/users => generated 275 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:04:12.902508 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b6bb9c-260d-4515-b0df-69d1dba7941d None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:12.903471 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b6bb9c-260d-4515-b0df-69d1dba7941d None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:12.904011 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b6bb9c-260d-4515-b0df-69d1dba7941d None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:12.905844 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 33/62] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:04:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:04:12.910830 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4665c62f-c02e-45ce-a385-0ca58ef7b437 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:12.911620 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4665c62f-c02e-45ce-a385-0ca58ef7b437 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:12.912130 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4665c62f-c02e-45ce-a385-0ca58ef7b437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:12.933616 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-4665c62f-c02e-45ce-a385-0ca58ef7b437 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:04:12.935147 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-4665c62f-c02e-45ce-a385-0ca58ef7b437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:04:13.019935 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 30/63] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:04:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:04:13.042307 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b6bb9c-260d-4515-b0df-69d1dba7941d None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:13.114831 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:13.172639 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b6bb9c-260d-4515-b0df-69d1dba7941d None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:13.216131 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a326ac6-b2ab-4ea6-82b3-ac2241d40948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:13.216941 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a326ac6-b2ab-4ea6-82b3-ac2241d40948 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:13.217224 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a326ac6-b2ab-4ea6-82b3-ac2241d40948 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:13.217498 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a326ac6-b2ab-4ea6-82b3-ac2241d40948 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:13.235617 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a326ac6-b2ab-4ea6-82b3-ac2241d40948 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:04:13.241452 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd57b5-5a95-40d9-86d4-db36b2d3d24c None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:13.241969 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd57b5-5a95-40d9-86d4-db36b2d3d24c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:13.242450 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd57b5-5a95-40d9-86d4-db36b2d3d24c None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:13.244064 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 31/64] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:04:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:04:13.246241 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-5a326ac6-b2ab-4ea6-82b3-ac2241d40948 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:04:13.246241 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:04:13.246241 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:04:13.246241 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:04:13.246241 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:04:13.246241 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:04:13.246241 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:04:13.246241 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:04:13.246241 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:04:13.246241 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:04:13.246241 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:04:13.246241 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:04:13.246241 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:04:13.246241 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:04:13.246241 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:04:13.246241 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:04:13.247070 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:04:13.247070 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:04:13.247070 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:04:13.247070 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:04:13.247070 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:04:13.247070 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:04:13.247070 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:04:13.247070 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:04:13.247070 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:04:13.247070 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:04:13.247070 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:04:13.247070 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:04:13.247070 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:04:13.247070 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:04:13.247070 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:04:13.247070 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:04:13.247840 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:04:13.247840 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:04:13.247840 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:04:13.247840 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:04:13.247840 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:04:13.247840 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:04:13.247840 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:04:13.247840 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:04:13.247840 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:04:13.247840 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:04:13.247840 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:04:13.247840 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:04:13.247840 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 34/65] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jul 4 09:04:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:04:13.251687 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd57b5-5a95-40d9-86d4-db36b2d3d24c None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:13.253740 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d114a-5a5d-4dcd-a09a-f6f25e69d67a None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:13.254036 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d114a-5a5d-4dcd-a09a-f6f25e69d67a None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:13.254325 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d114a-5a5d-4dcd-a09a-f6f25e69d67a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:13.284027 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-b33d114a-5a5d-4dcd-a09a-f6f25e69d67a None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:04:13.285606 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-b33d114a-5a5d-4dcd-a09a-f6f25e69d67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:04:13.322954 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:13.379624 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 35/66] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:04:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 09:04:13.381312 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d235a50-cb95-45a9-b499-44af843364a9 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:13.381739 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d235a50-cb95-45a9-b499-44af843364a9 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:13.382255 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d235a50-cb95-45a9-b499-44af843364a9 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:13.383667 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 36/67] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:04:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:04:13.393403 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea89173-a179-4d6a-9a0e-0e67c6960972 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:13.393872 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea89173-a179-4d6a-9a0e-0e67c6960972 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:13.394286 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea89173-a179-4d6a-9a0e-0e67c6960972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:13.406185 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd57b5-5a95-40d9-86d4-db36b2d3d24c None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:13.411589 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-fea89173-a179-4d6a-9a0e-0e67c6960972 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:04:13.412953 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-fea89173-a179-4d6a-9a0e-0e67c6960972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:04:13.446636 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68696589-05bb-4c0b-9df5-0242a6b57936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:13.447522 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68696589-05bb-4c0b-9df5-0242a6b57936 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:13.447993 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68696589-05bb-4c0b-9df5-0242a6b57936 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:13.448408 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68696589-05bb-4c0b-9df5-0242a6b57936 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:13.449469 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68696589-05bb-4c0b-9df5-0242a6b57936 None admin] RBAC: Adding query filter params (name=member) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:04:13.450689 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68696589-05bb-4c0b-9df5-0242a6b57936 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:13.452320 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68696589-05bb-4c0b-9df5-0242a6b57936 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:13.465491 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 32/68] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Jul 4 09:04:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:13.465491 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68696589-05bb-4c0b-9df5-0242a6b57936 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:13.467768 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:13.488393 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 37/69] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:04:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:04:13.489608 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0030b83b-b90d-4622-a307-0007b63c9b09 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:13.489908 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0030b83b-b90d-4622-a307-0007b63c9b09 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:13.490193 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0030b83b-b90d-4622-a307-0007b63c9b09 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:13.491457 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 38/70] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:04:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:04:13.495637 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0030b83b-b90d-4622-a307-0007b63c9b09 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:13.580705 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68696589-05bb-4c0b-9df5-0242a6b57936 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:13.590336 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:13.608831 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0030b83b-b90d-4622-a307-0007b63c9b09 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:13.617582 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1ccf14-97c0-4cf8-8d7c-4268c9281603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:13.618384 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1ccf14-97c0-4cf8-8d7c-4268c9281603 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:13.618673 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1ccf14-97c0-4cf8-8d7c-4268c9281603 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:13.618951 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1ccf14-97c0-4cf8-8d7c-4268c9281603 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:13.628966 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1ccf14-97c0-4cf8-8d7c-4268c9281603 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:04:13.636538 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-8a1ccf14-97c0-4cf8-8d7c-4268c9281603 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:04:13.636538 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:04:13.636538 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:04:13.636538 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:04:13.636538 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:04:13.636538 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:04:13.636538 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:04:13.636538 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:04:13.636538 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:04:13.636538 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:04:13.636538 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:04:13.636538 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:04:13.636538 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:04:13.636538 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:04:13.636538 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:04:13.636538 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:04:13.637374 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:04:13.637374 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:04:13.637374 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:04:13.637374 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:04:13.637374 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:04:13.637374 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:04:13.637374 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:04:13.637374 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:04:13.637374 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:04:13.637374 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:04:13.637374 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:04:13.637374 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:04:13.637374 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:04:13.637374 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:04:13.637374 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:04:13.637374 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:04:13.638141 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:04:13.638141 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:04:13.638141 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:04:13.638141 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:04:13.638141 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:04:13.638141 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:04:13.638141 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:04:13.638141 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:04:13.638141 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:04:13.638141 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:04:13.638141 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:04:13.638141 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:04:13.638141 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 33/71] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Jul 4 09:04:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:04:13.639277 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124fa3ff-7fed-4d2e-bb9e-9fba510f9db6 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:13.639711 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124fa3ff-7fed-4d2e-bb9e-9fba510f9db6 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:13.640004 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124fa3ff-7fed-4d2e-bb9e-9fba510f9db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:13.644757 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64c27e5-58cc-494c-a537-6c9993524062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:13.645641 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c27e5-58cc-494c-a537-6c9993524062 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:13.645924 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c27e5-58cc-494c-a537-6c9993524062 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:13.646203 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c27e5-58cc-494c-a537-6c9993524062 None admin] PATH_INFO: `/v3/users/cbeb03f2771e4aac8c0ee7d37e9ad2e0` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:13.656254 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-124fa3ff-7fed-4d2e-bb9e-9fba510f9db6 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:04:13.657491 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-124fa3ff-7fed-4d2e-bb9e-9fba510f9db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:04:13.661684 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64c27e5-58cc-494c-a537-6c9993524062 None admin] RBAC: Authorizing `identity:get_user(user_id=cbeb03f2771e4aac8c0ee7d37e9ad2e0)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:13.663157 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64c27e5-58cc-494c-a537-6c9993524062 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:13.664894 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 39/72] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Jul 4 09:04:13 2022] GET /identity/v3/users/cbeb03f2771e4aac8c0ee7d37e9ad2e0 => generated 275 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:13.665667 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64c27e5-58cc-494c-a537-6c9993524062 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:13.706443 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:13.728994 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 34/73] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:04:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:04:13.730620 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2045524c-bc89-4f72-8211-516a6882c633 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:13.730919 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2045524c-bc89-4f72-8211-516a6882c633 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:13.731202 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2045524c-bc89-4f72-8211-516a6882c633 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:13.732690 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 35/74] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:04:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:04:13.733254 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2045524c-bc89-4f72-8211-516a6882c633 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:13.778650 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64c27e5-58cc-494c-a537-6c9993524062 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:13.814630 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939ec5ae-fccf-4ee7-be22-6239f0dd35e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:13.815454 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ec5ae-fccf-4ee7-be22-6239f0dd35e2 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:13.815744 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ec5ae-fccf-4ee7-be22-6239f0dd35e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:13.816108 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ec5ae-fccf-4ee7-be22-6239f0dd35e2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:13.827202 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939ec5ae-fccf-4ee7-be22-6239f0dd35e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:04:13.835501 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-939ec5ae-fccf-4ee7-be22-6239f0dd35e2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 09:04:13.835501 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:04:13.835501 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:04:13.835501 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:04:13.835501 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:04:13.835501 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:04:13.835501 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:04:13.835501 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:04:13.835501 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:04:13.835501 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:04:13.835501 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:04:13.835501 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:04:13.835501 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:04:13.835501 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:04:13.835501 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:04:13.835501 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:04:13.836440 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:04:13.836440 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:04:13.836440 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:04:13.836440 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:04:13.836440 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:04:13.836440 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:04:13.836440 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:04:13.836440 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:04:13.836440 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:04:13.836440 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:04:13.836440 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:04:13.836440 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:04:13.836440 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:04:13.836440 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:04:13.836440 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:04:13.836440 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:04:13.837230 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:04:13.837230 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:04:13.837230 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:04:13.837230 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:04:13.837230 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:04:13.837230 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:04:13.837230 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:04:13.837230 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:04:13.837230 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:04:13.837230 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:04:13.837230 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 09:04:13.837230 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:04:13.837230 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 40/75] 10.222.0.42 () {56 vars in 1114 bytes} [Mon Jul 4 09:04:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:04:13.837873 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939ec5ae-fccf-4ee7-be22-6239f0dd35e2 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:13.843227 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:13.848619 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2045524c-bc89-4f72-8211-516a6882c633 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:13.885888 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b64185-f104-4777-b348-9ffc9bdeca42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:13.886701 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b64185-f104-4777-b348-9ffc9bdeca42 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:13.886992 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b64185-f104-4777-b348-9ffc9bdeca42 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:13.887298 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b64185-f104-4777-b348-9ffc9bdeca42 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:13.888473 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b64185-f104-4777-b348-9ffc9bdeca42 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:04:13.889062 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b64185-f104-4777-b348-9ffc9bdeca42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:13.890692 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b64185-f104-4777-b348-9ffc9bdeca42 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:13.900602 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 36/76] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jul 4 09:04:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:13.901961 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4969b3-69de-46d1-9f73-ecbd0eea5aa9 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:13.902246 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4969b3-69de-46d1-9f73-ecbd0eea5aa9 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:13.902525 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4969b3-69de-46d1-9f73-ecbd0eea5aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:13.919538 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-ad4969b3-69de-46d1-9f73-ecbd0eea5aa9 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:04:13.920769 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ad4969b3-69de-46d1-9f73-ecbd0eea5aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:04:13.942056 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:13.945253 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939ec5ae-fccf-4ee7-be22-6239f0dd35e2 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:13.985645 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c08f68d-85e4-4917-b302-963824a952e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:13.986685 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08f68d-85e4-4917-b302-963824a952e3 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:13.987028 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08f68d-85e4-4917-b302-963824a952e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:13.987292 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08f68d-85e4-4917-b302-963824a952e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:13.993826 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 37/77] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:04:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:04:13.994553 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4969b3-69de-46d1-9f73-ecbd0eea5aa9 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:14.063196 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c08f68d-85e4-4917-b302-963824a952e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:14.064719 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c08f68d-85e4-4917-b302-963824a952e3 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:14.088428 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:14.098354 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4969b3-69de-46d1-9f73-ecbd0eea5aa9 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:14.134224 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d367655-d07e-47b0-b483-49108266d3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:14.135015 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d367655-d07e-47b0-b483-49108266d3c1 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:14.135318 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d367655-d07e-47b0-b483-49108266d3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:14.135591 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d367655-d07e-47b0-b483-49108266d3c1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:14.136808 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d367655-d07e-47b0-b483-49108266d3c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:14.138289 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d367655-d07e-47b0-b483-49108266d3c1 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:14.139928 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 38/78] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:04:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:14.140696 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d367655-d07e-47b0-b483-49108266d3c1 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:14.167969 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:14.176561 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 41/79] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jul 4 09:04:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:04:14.176561 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c08f68d-85e4-4917-b302-963824a952e3 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:14.245319 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d367655-d07e-47b0-b483-49108266d3c1 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:14.273023 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c08f68d-85e4-4917-b302-963824a952e3 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:14.285395 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a5faf5-dbf9-41c6-9000-5ca657493711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:14.286103 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a5faf5-dbf9-41c6-9000-5ca657493711 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:14.286364 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a5faf5-dbf9-41c6-9000-5ca657493711 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:14.286637 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a5faf5-dbf9-41c6-9000-5ca657493711 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:14.287388 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a5faf5-dbf9-41c6-9000-5ca657493711 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:04:14.287693 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a5faf5-dbf9-41c6-9000-5ca657493711 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:14.289143 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a5faf5-dbf9-41c6-9000-5ca657493711 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:14.297395 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 39/80] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jul 4 09:04:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:14.298244 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a5faf5-dbf9-41c6-9000-5ca657493711 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:14.312037 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd7f596-8291-4354-9186-ac3959a4387e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:14.313060 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7f596-8291-4354-9186-ac3959a4387e None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:14.313353 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7f596-8291-4354-9186-ac3959a4387e None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:14.313624 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7f596-8291-4354-9186-ac3959a4387e None admin] PATH_INFO: `/v3/users/04cf7e50af2f41cdb2f3d808072f7c87` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:14.314803 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd7f596-8291-4354-9186-ac3959a4387e None admin] RBAC: Authorizing `identity:get_user(user_id=04cf7e50af2f41cdb2f3d808072f7c87)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:14.316302 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd7f596-8291-4354-9186-ac3959a4387e None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:14.323140 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 42/81] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Jul 4 09:04:14 2022] GET /identity/v3/users/04cf7e50af2f41cdb2f3d808072f7c87 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:14.323140 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd7f596-8291-4354-9186-ac3959a4387e None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:14.323411 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:14.385784 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:14.403013 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a5faf5-dbf9-41c6-9000-5ca657493711 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:14.419203 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd7f596-8291-4354-9186-ac3959a4387e None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:14.435768 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2830c7ba-9729-4d30-ad85-5d868b61df0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:14.436589 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2830c7ba-9729-4d30-ad85-5d868b61df0a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:14.436871 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2830c7ba-9729-4d30-ad85-5d868b61df0a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:14.437148 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2830c7ba-9729-4d30-ad85-5d868b61df0a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:14.446950 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2830c7ba-9729-4d30-ad85-5d868b61df0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:04:14.452716 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778f5f7f-1465-4c9a-8698-2d38c94a58f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:14.453390 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f5f7f-1465-4c9a-8698-2d38c94a58f3 None admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:14.453772 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f5f7f-1465-4c9a-8698-2d38c94a58f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:14.454050 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f5f7f-1465-4c9a-8698-2d38c94a58f3 None admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:14.454771 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778f5f7f-1465-4c9a-8698-2d38c94a58f3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:14.454856 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-2830c7ba-9729-4d30-ad85-5d868b61df0a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:04:14.454856 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:04:14.454856 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:04:14.454856 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:04:14.454856 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:04:14.454856 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:04:14.454856 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:04:14.454856 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:04:14.454856 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:04:14.454856 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:04:14.454856 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:04:14.454856 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:04:14.454856 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:04:14.454856 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:04:14.454856 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:04:14.454856 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:04:14.455825 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:04:14.455825 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:04:14.455825 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:04:14.455825 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:04:14.455825 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:04:14.455825 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:04:14.455825 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:04:14.455825 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:04:14.455825 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:04:14.455825 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:04:14.455825 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:04:14.455825 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:04:14.455825 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:04:14.455825 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:04:14.455825 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:04:14.455825 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:04:14.456830 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:04:14.456830 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:04:14.456830 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:04:14.456830 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:04:14.456830 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:04:14.456830 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:04:14.456830 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:04:14.456830 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:04:14.456830 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:04:14.456830 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:04:14.456830 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:04:14.456830 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:04:14.456830 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 40/82] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jul 4 09:04:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:04:14.456830 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2830c7ba-9729-4d30-ad85-5d868b61df0a None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:14.461110 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778f5f7f-1465-4c9a-8698-2d38c94a58f3 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:14.489598 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 43/83] 10.222.0.42 () {60 vars in 1132 bytes} [Mon Jul 4 09:04:14 2022] POST /identity/v3/users => generated 289 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:04:14.490461 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778f5f7f-1465-4c9a-8698-2d38c94a58f3 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:14.561020 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:14.583476 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2830c7ba-9729-4d30-ad85-5d868b61df0a None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:14.608448 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778f5f7f-1465-4c9a-8698-2d38c94a58f3 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:14.621001 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4d5b8f-63c0-448b-bd00-f9f2ed273c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:14.622213 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d5b8f-63c0-448b-bd00-f9f2ed273c70 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:14.622669 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d5b8f-63c0-448b-bd00-f9f2ed273c70 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:14.623110 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d5b8f-63c0-448b-bd00-f9f2ed273c70 None admin] PATH_INFO: `/v3/projects/4dd04e5b7dd24f0e8050b45d6060f68c` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:14.624571 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4d5b8f-63c0-448b-bd00-f9f2ed273c70 None admin] RBAC: Authorizing `identity:get_project(project_id=4dd04e5b7dd24f0e8050b45d6060f68c)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:14.626058 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4d5b8f-63c0-448b-bd00-f9f2ed273c70 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:14.632602 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 41/84] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jul 4 09:04:14 2022] GET /identity/v3/projects/4dd04e5b7dd24f0e8050b45d6060f68c => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:14.632602 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4d5b8f-63c0-448b-bd00-f9f2ed273c70 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:14.642561 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:14.658032 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b28ded0-f850-4efc-b0cb-38ba08ccee37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:14.659100 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b28ded0-f850-4efc-b0cb-38ba08ccee37 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:14.660009 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b28ded0-f850-4efc-b0cb-38ba08ccee37 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:14.660294 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b28ded0-f850-4efc-b0cb-38ba08ccee37 None admin] PATH_INFO: `/v3/users/cbeb03f2771e4aac8c0ee7d37e9ad2e0` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:14.661950 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b28ded0-f850-4efc-b0cb-38ba08ccee37 None admin] RBAC: Authorizing `identity:get_user(user_id=cbeb03f2771e4aac8c0ee7d37e9ad2e0)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:14.663431 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b28ded0-f850-4efc-b0cb-38ba08ccee37 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:14.665134 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 44/85] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Jul 4 09:04:14 2022] GET /identity/v3/users/cbeb03f2771e4aac8c0ee7d37e9ad2e0 => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:14.665920 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b28ded0-f850-4efc-b0cb-38ba08ccee37 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:14.749633 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4d5b8f-63c0-448b-bd00-f9f2ed273c70 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:14.796553 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8cc4c9-dc01-4f7d-9608-a096c4e6224f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:14.797269 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8cc4c9-dc01-4f7d-9608-a096c4e6224f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:14.797921 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8cc4c9-dc01-4f7d-9608-a096c4e6224f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:14.797921 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8cc4c9-dc01-4f7d-9608-a096c4e6224f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:14.799981 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b28ded0-f850-4efc-b0cb-38ba08ccee37 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:14.820839 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:14.850601 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e438f30f-b357-42a1-b2c1-b623fb8dcbb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:14.852602 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e438f30f-b357-42a1-b2c1-b623fb8dcbb6 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:14.853288 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e438f30f-b357-42a1-b2c1-b623fb8dcbb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:14.853922 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e438f30f-b357-42a1-b2c1-b623fb8dcbb6 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:14.855261 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e438f30f-b357-42a1-b2c1-b623fb8dcbb6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:04:14.856273 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e438f30f-b357-42a1-b2c1-b623fb8dcbb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:14.858125 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e438f30f-b357-42a1-b2c1-b623fb8dcbb6 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:14.872549 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 45/86] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Jul 4 09:04:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:14.873845 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e438f30f-b357-42a1-b2c1-b623fb8dcbb6 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:14.877868 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8cc4c9-dc01-4f7d-9608-a096c4e6224f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:14.882329 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8cc4c9-dc01-4f7d-9608-a096c4e6224f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:14.956952 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:15.014328 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 42/87] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jul 4 09:04:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:04:15.015830 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8cc4c9-dc01-4f7d-9608-a096c4e6224f None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:15.015960 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e438f30f-b357-42a1-b2c1-b623fb8dcbb6 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:15.054942 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486bdfb0-078f-44e3-9fb5-bf02a253df84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:15.056167 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486bdfb0-078f-44e3-9fb5-bf02a253df84 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:15.056706 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486bdfb0-078f-44e3-9fb5-bf02a253df84 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:15.057152 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486bdfb0-078f-44e3-9fb5-bf02a253df84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:15.058093 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486bdfb0-078f-44e3-9fb5-bf02a253df84 None admin] RBAC: Adding query filter params (role.id=81634e7812344f84afcb29b0dba2687c, scope.project.id=4dd04e5b7dd24f0e8050b45d6060f68c, user.id=cbeb03f2771e4aac8c0ee7d37e9ad2e0) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:04:15.058478 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486bdfb0-078f-44e3-9fb5-bf02a253df84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:15.060231 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486bdfb0-078f-44e3-9fb5-bf02a253df84 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:15.072042 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 46/88] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Jul 4 09:04:14 2022] GET /identity/v3/role_assignments?user.id=cbeb03f2771e4aac8c0ee7d37e9ad2e0&scope.project.id=4dd04e5b7dd24f0e8050b45d6060f68c&role.id=81634e7812344f84afcb29b0dba2687c => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:15.076615 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486bdfb0-078f-44e3-9fb5-bf02a253df84 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:15.093018 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:15.200784 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486bdfb0-078f-44e3-9fb5-bf02a253df84 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:15.224282 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:15.239186 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808abf40-43f4-44bc-b718-3c5a3c0d1b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:15.240878 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808abf40-43f4-44bc-b718-3c5a3c0d1b9d None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:15.241351 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808abf40-43f4-44bc-b718-3c5a3c0d1b9d None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:15.241804 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808abf40-43f4-44bc-b718-3c5a3c0d1b9d None admin] PATH_INFO: `/v3/users/cbeb03f2771e4aac8c0ee7d37e9ad2e0` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:15.243354 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808abf40-43f4-44bc-b718-3c5a3c0d1b9d None admin] RBAC: Authorizing `identity:get_user(user_id=cbeb03f2771e4aac8c0ee7d37e9ad2e0)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:15.246003 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808abf40-43f4-44bc-b718-3c5a3c0d1b9d None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:15.247983 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 47/89] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Jul 4 09:04:15 2022] GET /identity/v3/users/cbeb03f2771e4aac8c0ee7d37e9ad2e0 => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:15.249079 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808abf40-43f4-44bc-b718-3c5a3c0d1b9d None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:15.253860 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8cc4c9-dc01-4f7d-9608-a096c4e6224f None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:15.323554 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdf5a64-274a-4a43-97a9-2953adabd6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:15.324155 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf5a64-274a-4a43-97a9-2953adabd6dc None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:15.324444 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf5a64-274a-4a43-97a9-2953adabd6dc None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:15.324717 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf5a64-274a-4a43-97a9-2953adabd6dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:15.367986 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808abf40-43f4-44bc-b718-3c5a3c0d1b9d None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:15.405251 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da99b342-7e63-43d1-aefc-8f10f4ee9bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:15.406441 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99b342-7e63-43d1-aefc-8f10f4ee9bf2 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:15.407344 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99b342-7e63-43d1-aefc-8f10f4ee9bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:15.407808 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99b342-7e63-43d1-aefc-8f10f4ee9bf2 None admin] PATH_INFO: `/v3/projects/4dd04e5b7dd24f0e8050b45d6060f68c` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:15.412665 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da99b342-7e63-43d1-aefc-8f10f4ee9bf2 None admin] RBAC: Authorizing `identity:get_project(project_id=4dd04e5b7dd24f0e8050b45d6060f68c)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:15.414854 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da99b342-7e63-43d1-aefc-8f10f4ee9bf2 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:15.416910 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 48/90] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jul 4 09:04:15 2022] GET /identity/v3/projects/4dd04e5b7dd24f0e8050b45d6060f68c => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:15.417881 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da99b342-7e63-43d1-aefc-8f10f4ee9bf2 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:15.484263 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:15.526433 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da99b342-7e63-43d1-aefc-8f10f4ee9bf2 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:15.536726 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdf5a64-274a-4a43-97a9-2953adabd6dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:15.538260 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdf5a64-274a-4a43-97a9-2953adabd6dc None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:15.564104 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da39cb-aacb-4668-8712-002cfc00798c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:15.565112 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da39cb-aacb-4668-8712-002cfc00798c None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:15.565596 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da39cb-aacb-4668-8712-002cfc00798c None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:15.566092 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da39cb-aacb-4668-8712-002cfc00798c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:15.642404 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4da39cb-aacb-4668-8712-002cfc00798c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:15.644336 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4da39cb-aacb-4668-8712-002cfc00798c None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:15.706128 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:15.731156 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:15.759170 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 49/91] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jul 4 09:04:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:04:15.760392 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da39cb-aacb-4668-8712-002cfc00798c None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:15.854799 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 43/92] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jul 4 09:04:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 839 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:04:15.855506 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdf5a64-274a-4a43-97a9-2953adabd6dc None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:15.878443 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da39cb-aacb-4668-8712-002cfc00798c None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:15.923209 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cfa3fa-63e9-43a7-b428-8f0618833aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:15.924247 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cfa3fa-63e9-43a7-b428-8f0618833aee None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:15.925989 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cfa3fa-63e9-43a7-b428-8f0618833aee None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:15.926472 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cfa3fa-63e9-43a7-b428-8f0618833aee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:15.927556 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cfa3fa-63e9-43a7-b428-8f0618833aee None admin] RBAC: Adding query filter params (role.id=965049e7ce6144aaad23c15f3a5e37c3, scope.project.id=4dd04e5b7dd24f0e8050b45d6060f68c, user.id=04cf7e50af2f41cdb2f3d808072f7c87) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:04:15.929038 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cfa3fa-63e9-43a7-b428-8f0618833aee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:15.931897 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cfa3fa-63e9-43a7-b428-8f0618833aee None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:15.946285 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 50/93] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Jul 4 09:04:15 2022] GET /identity/v3/role_assignments?user.id=04cf7e50af2f41cdb2f3d808072f7c87&scope.project.id=4dd04e5b7dd24f0e8050b45d6060f68c&role.id=965049e7ce6144aaad23c15f3a5e37c3 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:15.947435 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cfa3fa-63e9-43a7-b428-8f0618833aee None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:15.992170 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:16.082000 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdf5a64-274a-4a43-97a9-2953adabd6dc None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:16.123267 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e152c9-1450-4b44-970e-fc3270f8b8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:16.124539 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e152c9-1450-4b44-970e-fc3270f8b8ec None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:16.125816 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e152c9-1450-4b44-970e-fc3270f8b8ec None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:16.126362 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e152c9-1450-4b44-970e-fc3270f8b8ec None admin] PATH_INFO: `/v3/projects/dc815f286d5a4fccb6f44401eb037eb6` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:16.128044 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e152c9-1450-4b44-970e-fc3270f8b8ec None admin] RBAC: Authorizing `identity:get_project(project_id=dc815f286d5a4fccb6f44401eb037eb6)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:16.130212 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e152c9-1450-4b44-970e-fc3270f8b8ec None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:16.132671 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 44/94] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jul 4 09:04:15 2022] GET /identity/v3/projects/dc815f286d5a4fccb6f44401eb037eb6 => generated 312 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:16.140889 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e152c9-1450-4b44-970e-fc3270f8b8ec None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:16.174357 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:16.186005 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cfa3fa-63e9-43a7-b428-8f0618833aee None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:16.255787 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8695bb6d-ba21-48eb-a71d-f8ef431e92d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:16.256684 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8695bb6d-ba21-48eb-a71d-f8ef431e92d8 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:16.256964 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8695bb6d-ba21-48eb-a71d-f8ef431e92d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:16.257236 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8695bb6d-ba21-48eb-a71d-f8ef431e92d8 None admin] PATH_INFO: `/v3/projects/4dd04e5b7dd24f0e8050b45d6060f68c` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:16.258455 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8695bb6d-ba21-48eb-a71d-f8ef431e92d8 None admin] RBAC: Authorizing `identity:get_project(project_id=4dd04e5b7dd24f0e8050b45d6060f68c)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:16.260142 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8695bb6d-ba21-48eb-a71d-f8ef431e92d8 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:16.261853 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 51/95] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jul 4 09:04:15 2022] GET /identity/v3/projects/4dd04e5b7dd24f0e8050b45d6060f68c => generated 298 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:16.267926 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8695bb6d-ba21-48eb-a71d-f8ef431e92d8 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:16.326677 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e152c9-1450-4b44-970e-fc3270f8b8ec None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:16.388633 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7022d65b-b11d-49cc-8436-e6026dc2cb1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:16.389296 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022d65b-b11d-49cc-8436-e6026dc2cb1a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:16.389576 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022d65b-b11d-49cc-8436-e6026dc2cb1a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:16.389851 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022d65b-b11d-49cc-8436-e6026dc2cb1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:16.391837 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7022d65b-b11d-49cc-8436-e6026dc2cb1a None admin] RBAC: Adding query filter params (role.id=81634e7812344f84afcb29b0dba2687c, scope.project.id=dc815f286d5a4fccb6f44401eb037eb6, user.id=cbeb03f2771e4aac8c0ee7d37e9ad2e0) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:04:16.392182 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7022d65b-b11d-49cc-8436-e6026dc2cb1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:16.393664 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7022d65b-b11d-49cc-8436-e6026dc2cb1a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:16.406343 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 45/96] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Jul 4 09:04:16 2022] GET /identity/v3/role_assignments?user.id=cbeb03f2771e4aac8c0ee7d37e9ad2e0&scope.project.id=dc815f286d5a4fccb6f44401eb037eb6&role.id=81634e7812344f84afcb29b0dba2687c => generated 259 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:16.412777 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:16.434413 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8695bb6d-ba21-48eb-a71d-f8ef431e92d8 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:16.485004 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649b5360-d6e5-4f63-8799-6ae2c286c745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:16.486042 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b5360-d6e5-4f63-8799-6ae2c286c745 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:16.486327 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b5360-d6e5-4f63-8799-6ae2c286c745 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:16.486647 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b5360-d6e5-4f63-8799-6ae2c286c745 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:16.487492 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649b5360-d6e5-4f63-8799-6ae2c286c745 None admin] RBAC: Adding query filter params (role.id=157d1a80161e43a3ad84446eeca98e0b, scope.project.id=4dd04e5b7dd24f0e8050b45d6060f68c, user.id=cbeb03f2771e4aac8c0ee7d37e9ad2e0) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:04:16.487802 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649b5360-d6e5-4f63-8799-6ae2c286c745 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:16.489299 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649b5360-d6e5-4f63-8799-6ae2c286c745 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:16.498474 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 52/97] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Jul 4 09:04:16 2022] GET /identity/v3/role_assignments?user.id=cbeb03f2771e4aac8c0ee7d37e9ad2e0&scope.project.id=4dd04e5b7dd24f0e8050b45d6060f68c&role.id=157d1a80161e43a3ad84446eeca98e0b => generated 259 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:16.860449 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75083378-99d8-42a8-bfbe-d7650eac2d2f None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:16.861140 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75083378-99d8-42a8-bfbe-d7650eac2d2f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:16.861556 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75083378-99d8-42a8-bfbe-d7650eac2d2f None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:16.863520 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 46/98] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:04:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:04:16.866052 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94732a-0db5-4432-b63e-addb71605aaf None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:16.866349 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94732a-0db5-4432-b63e-addb71605aaf None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:16.866635 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94732a-0db5-4432-b63e-addb71605aaf None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:16.868496 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 53/99] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:04:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:04:16.868920 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d4f7f-3c6d-449b-a4d3-34d8366f63cc None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:16.869207 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d4f7f-3c6d-449b-a4d3-34d8366f63cc None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:16.869642 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d4f7f-3c6d-449b-a4d3-34d8366f63cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:16.874002 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99eabe1-552f-4c4b-9d45-7f35ec99bf14 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:16.874292 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99eabe1-552f-4c4b-9d45-7f35ec99bf14 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:16.874572 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99eabe1-552f-4c4b-9d45-7f35ec99bf14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:16.888847 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-a67d4f7f-3c6d-449b-a4d3-34d8366f63cc None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:04:16.890233 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a67d4f7f-3c6d-449b-a4d3-34d8366f63cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:04:16.907493 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-e99eabe1-552f-4c4b-9d45-7f35ec99bf14 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:04:16.909456 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-e99eabe1-552f-4c4b-9d45-7f35ec99bf14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:04:16.963277 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 47/100] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:04:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 09:04:16.987796 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67d4f7f-3c6d-449b-a4d3-34d8366f63cc None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:16.992830 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 54/101] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:04:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 09:04:17.001725 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:17.023233 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99eabe1-552f-4c4b-9d45-7f35ec99bf14 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:17.158869 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67d4f7f-3c6d-449b-a4d3-34d8366f63cc None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:17.173967 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:17.207083 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99eabe1-552f-4c4b-9d45-7f35ec99bf14 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:17.223385 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754168c3-99ee-4cba-ac65-69ab785b3dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:17.224209 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754168c3-99ee-4cba-ac65-69ab785b3dcd None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:17.224485 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754168c3-99ee-4cba-ac65-69ab785b3dcd None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:17.224757 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754168c3-99ee-4cba-ac65-69ab785b3dcd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:17.225973 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754168c3-99ee-4cba-ac65-69ab785b3dcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:17.227454 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754168c3-99ee-4cba-ac65-69ab785b3dcd None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:17.229402 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 48/102] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:04:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:04:17.236379 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754168c3-99ee-4cba-ac65-69ab785b3dcd None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:17.292603 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74c96a9-bfe6-44c5-90bd-5b600d668ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:17.293424 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c96a9-bfe6-44c5-90bd-5b600d668ab0 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:17.293716 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c96a9-bfe6-44c5-90bd-5b600d668ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:17.293987 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c96a9-bfe6-44c5-90bd-5b600d668ab0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:17.319170 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:17.324870 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74c96a9-bfe6-44c5-90bd-5b600d668ab0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:04:17.340899 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-c74c96a9-bfe6-44c5-90bd-5b600d668ab0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 09:04:17.340899 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:04:17.340899 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:04:17.340899 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:04:17.340899 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:04:17.340899 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:04:17.340899 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:04:17.340899 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:04:17.340899 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:04:17.340899 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:04:17.340899 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:04:17.340899 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:04:17.340899 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:04:17.340899 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:04:17.340899 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:04:17.340899 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:04:17.341834 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:04:17.341834 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:04:17.341834 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:04:17.341834 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:04:17.341834 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:04:17.341834 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:04:17.341834 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:04:17.341834 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:04:17.341834 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:04:17.341834 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:04:17.341834 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:04:17.341834 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:04:17.341834 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:04:17.341834 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:04:17.341834 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:04:17.341834 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:04:17.342599 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:04:17.342599 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:04:17.342599 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:04:17.342599 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:04:17.342599 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:04:17.342599 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:04:17.342599 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:04:17.342599 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:04:17.342599 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:04:17.342599 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:04:17.342599 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 09:04:17.342599 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:04:17.342599 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 55/103] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jul 4 09:04:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:04:17.349701 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74c96a9-bfe6-44c5-90bd-5b600d668ab0 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:17.381865 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754168c3-99ee-4cba-ac65-69ab785b3dcd None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:17.464835 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083918b4-e0f1-4563-a92c-c32a72ea20a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:17.465878 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083918b4-e0f1-4563-a92c-c32a72ea20a7 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:17.466378 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083918b4-e0f1-4563-a92c-c32a72ea20a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:17.466845 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083918b4-e0f1-4563-a92c-c32a72ea20a7 None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:17.467771 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083918b4-e0f1-4563-a92c-c32a72ea20a7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:17.469527 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083918b4-e0f1-4563-a92c-c32a72ea20a7 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:17.524347 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 49/104] 10.222.0.42 () {60 vars in 1141 bytes} [Mon Jul 4 09:04:17 2022] POST /identity/v3/projects => generated 302 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:04:17.565055 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74c96a9-bfe6-44c5-90bd-5b600d668ab0 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:17.613305 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ad0772-910a-4a49-a36c-b7c2c37b29f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:17.614338 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad0772-910a-4a49-a36c-b7c2c37b29f8 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:17.614817 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad0772-910a-4a49-a36c-b7c2c37b29f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:17.615289 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad0772-910a-4a49-a36c-b7c2c37b29f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:17.616366 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ad0772-910a-4a49-a36c-b7c2c37b29f8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:04:17.616889 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ad0772-910a-4a49-a36c-b7c2c37b29f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:17.618488 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ad0772-910a-4a49-a36c-b7c2c37b29f8 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:17.631856 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 56/105] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Jul 4 09:04:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:17.637771 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083918b4-e0f1-4563-a92c-c32a72ea20a7 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:17.760781 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083918b4-e0f1-4563-a92c-c32a72ea20a7 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:17.792391 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:17.800536 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d15190e-b662-480e-9675-0ddeeda8e6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:17.801825 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d15190e-b662-480e-9675-0ddeeda8e6e2 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:17.802305 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d15190e-b662-480e-9675-0ddeeda8e6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:17.802821 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d15190e-b662-480e-9675-0ddeeda8e6e2 None admin] PATH_INFO: `/v3/users/afc1d34c7c80418b81e9282d3853696f` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:17.820184 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d15190e-b662-480e-9675-0ddeeda8e6e2 None admin] RBAC: Authorizing `identity:get_user(user_id=afc1d34c7c80418b81e9282d3853696f)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:17.823036 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d15190e-b662-480e-9675-0ddeeda8e6e2 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:17.825113 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 50/106] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Jul 4 09:04:17 2022] GET /identity/v3/users/afc1d34c7c80418b81e9282d3853696f => generated 289 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:17.831000 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ad0772-910a-4a49-a36c-b7c2c37b29f8 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:17.834324 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:17.886638 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71c604-94de-4ca8-ad62-45074a4b5c7c None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:17.892786 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71c604-94de-4ca8-ad62-45074a4b5c7c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:17.893435 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71c604-94de-4ca8-ad62-45074a4b5c7c None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:17.895212 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 51/107] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:04:17 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:04:17.901407 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50a9a8-ab8b-4c34-9f7d-05bf59d61fad None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:17.901982 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50a9a8-ab8b-4c34-9f7d-05bf59d61fad None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:17.902450 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50a9a8-ab8b-4c34-9f7d-05bf59d61fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:17.920786 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-1a50a9a8-ab8b-4c34-9f7d-05bf59d61fad None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:04:17.922415 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-1a50a9a8-ab8b-4c34-9f7d-05bf59d61fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:04:17.987422 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ad0772-910a-4a49-a36c-b7c2c37b29f8 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:18.022835 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f44548-2095-48de-bc50-6704515f0f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:18.023412 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f44548-2095-48de-bc50-6704515f0f40 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:18.023710 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f44548-2095-48de-bc50-6704515f0f40 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:18.023962 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f44548-2095-48de-bc50-6704515f0f40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:18.044161 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 52/108] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:04:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 09:04:18.080556 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a50a9a8-ab8b-4c34-9f7d-05bf59d61fad None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:18.123292 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f44548-2095-48de-bc50-6704515f0f40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:18.124803 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f44548-2095-48de-bc50-6704515f0f40 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:18.127828 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:18.254650 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a50a9a8-ab8b-4c34-9f7d-05bf59d61fad None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:18.269883 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 57/109] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jul 4 09:04:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:04:18.281038 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f44548-2095-48de-bc50-6704515f0f40 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:18.281419 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:18.298683 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa21db75-d758-4206-a957-a99bacc394c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:18.299574 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa21db75-d758-4206-a957-a99bacc394c3 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:18.308303 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa21db75-d758-4206-a957-a99bacc394c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:18.308588 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa21db75-d758-4206-a957-a99bacc394c3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:18.325696 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa21db75-d758-4206-a957-a99bacc394c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:04:18.341720 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-aa21db75-d758-4206-a957-a99bacc394c3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:04:18.341720 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:04:18.341720 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:04:18.341720 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:04:18.341720 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:04:18.341720 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:04:18.341720 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:04:18.341720 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:04:18.341720 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:04:18.341720 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:04:18.341720 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:04:18.341720 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:04:18.341720 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:04:18.341720 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:04:18.341720 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:04:18.341720 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:04:18.342604 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:04:18.342604 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:04:18.342604 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:04:18.342604 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:04:18.342604 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:04:18.342604 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:04:18.342604 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:04:18.342604 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:04:18.342604 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:04:18.342604 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:04:18.342604 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:04:18.342604 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:04:18.342604 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:04:18.342604 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:04:18.342604 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:04:18.342604 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:04:18.343355 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:04:18.343355 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:04:18.343355 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:04:18.343355 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:04:18.343355 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:04:18.343355 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:04:18.343355 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:04:18.343355 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:04:18.343355 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:04:18.343355 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:04:18.343355 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:04:18.343355 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:04:18.343355 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 53/110] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jul 4 09:04:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:04:18.349015 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa21db75-d758-4206-a957-a99bacc394c3 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:18.475979 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa21db75-d758-4206-a957-a99bacc394c3 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:18.501216 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f44548-2095-48de-bc50-6704515f0f40 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:18.502792 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:18.520593 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654968d1-9379-4a2e-a018-09fe08ad71a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:18.521632 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654968d1-9379-4a2e-a018-09fe08ad71a0 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:18.522545 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654968d1-9379-4a2e-a018-09fe08ad71a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:18.522998 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654968d1-9379-4a2e-a018-09fe08ad71a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:18.524123 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654968d1-9379-4a2e-a018-09fe08ad71a0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:04:18.525908 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654968d1-9379-4a2e-a018-09fe08ad71a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:18.527553 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654968d1-9379-4a2e-a018-09fe08ad71a0 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:18.545408 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 54/111] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Jul 4 09:04:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:04:18.551239 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654968d1-9379-4a2e-a018-09fe08ad71a0 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:18.574378 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b11635-dab3-4262-9288-fb92b2883807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:18.575552 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b11635-dab3-4262-9288-fb92b2883807 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:18.576062 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b11635-dab3-4262-9288-fb92b2883807 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:18.576602 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b11635-dab3-4262-9288-fb92b2883807 None admin] PATH_INFO: `/v3/projects/4dd04e5b7dd24f0e8050b45d6060f68c` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:18.577992 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b11635-dab3-4262-9288-fb92b2883807 None admin] RBAC: Authorizing `identity:get_project(project_id=4dd04e5b7dd24f0e8050b45d6060f68c)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:18.581271 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b11635-dab3-4262-9288-fb92b2883807 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:18.587356 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 58/112] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jul 4 09:04:18 2022] GET /identity/v3/projects/4dd04e5b7dd24f0e8050b45d6060f68c => generated 298 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:18.591909 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b11635-dab3-4262-9288-fb92b2883807 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:18.632277 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:18.742441 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654968d1-9379-4a2e-a018-09fe08ad71a0 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:18.814400 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b11635-dab3-4262-9288-fb92b2883807 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:18.845135 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38babd5-c7b2-4522-95f3-43352730f282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:18.846023 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38babd5-c7b2-4522-95f3-43352730f282 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:18.846306 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38babd5-c7b2-4522-95f3-43352730f282 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:18.846582 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38babd5-c7b2-4522-95f3-43352730f282 None admin] PATH_INFO: `/v3/users/cbeb03f2771e4aac8c0ee7d37e9ad2e0` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:18.848628 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38babd5-c7b2-4522-95f3-43352730f282 None admin] RBAC: Authorizing `identity:get_user(user_id=cbeb03f2771e4aac8c0ee7d37e9ad2e0)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:18.849572 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6eb8fa-073a-4de0-b2c0-9755f6a409b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:18.850111 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38babd5-c7b2-4522-95f3-43352730f282 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:18.850344 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6eb8fa-073a-4de0-b2c0-9755f6a409b7 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:18.850699 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6eb8fa-073a-4de0-b2c0-9755f6a409b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:18.851045 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6eb8fa-073a-4de0-b2c0-9755f6a409b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:18.851765 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 55/113] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Jul 4 09:04:18 2022] GET /identity/v3/users/cbeb03f2771e4aac8c0ee7d37e9ad2e0 => generated 275 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:18.852028 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6eb8fa-073a-4de0-b2c0-9755f6a409b7 None admin] RBAC: Adding query filter params (role.id=a5112c31cfa1478db60e6079627603f6, scope.project.id=4dd04e5b7dd24f0e8050b45d6060f68c, user.id=afc1d34c7c80418b81e9282d3853696f) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:04:18.852412 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6eb8fa-073a-4de0-b2c0-9755f6a409b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:18.854060 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6eb8fa-073a-4de0-b2c0-9755f6a409b7 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:18.857372 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0732b-0b8a-498a-b992-f72422dd2e7c None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:18.857665 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0732b-0b8a-498a-b992-f72422dd2e7c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:18.857943 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0732b-0b8a-498a-b992-f72422dd2e7c None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:18.861609 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 56/114] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:04:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:04:18.862359 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba0732b-0b8a-498a-b992-f72422dd2e7c None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:18.868371 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 59/115] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Jul 4 09:04:18 2022] GET /identity/v3/role_assignments?user.id=afc1d34c7c80418b81e9282d3853696f&scope.project.id=4dd04e5b7dd24f0e8050b45d6060f68c&role.id=a5112c31cfa1478db60e6079627603f6 => generated 259 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:04:18.880185 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f3e0d-290d-42b0-831c-96ec58b04387 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:18.880516 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f3e0d-290d-42b0-831c-96ec58b04387 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:18.880776 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f3e0d-290d-42b0-831c-96ec58b04387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:18.917917 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-d17f3e0d-290d-42b0-831c-96ec58b04387 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:04:18.919159 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-d17f3e0d-290d-42b0-831c-96ec58b04387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:04:18.971283 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:19.042755 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 60/116] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:04:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 04 09:04:19.076002 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f3e0d-290d-42b0-831c-96ec58b04387 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:19.160803 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba0732b-0b8a-498a-b992-f72422dd2e7c None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:19.182223 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:19.231505 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4f28de-7c67-4010-838d-f60bc40dbbad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:19.232708 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f28de-7c67-4010-838d-f60bc40dbbad None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:19.233273 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f28de-7c67-4010-838d-f60bc40dbbad None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:19.233696 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f28de-7c67-4010-838d-f60bc40dbbad None admin] PATH_INFO: `/v3/projects/4dd04e5b7dd24f0e8050b45d6060f68c` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:19.235077 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4f28de-7c67-4010-838d-f60bc40dbbad None admin] RBAC: Authorizing `identity:get_project(project_id=4dd04e5b7dd24f0e8050b45d6060f68c)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:19.237647 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4f28de-7c67-4010-838d-f60bc40dbbad None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:19.247893 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 57/117] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jul 4 09:04:18 2022] GET /identity/v3/projects/4dd04e5b7dd24f0e8050b45d6060f68c => generated 298 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:19.249135 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4f28de-7c67-4010-838d-f60bc40dbbad None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:19.321577 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f3e0d-290d-42b0-831c-96ec58b04387 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:19.376337 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2228b3b-bd78-4285-be38-24e94229a653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:19.377054 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2228b3b-bd78-4285-be38-24e94229a653 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:19.377601 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2228b3b-bd78-4285-be38-24e94229a653 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:19.378023 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2228b3b-bd78-4285-be38-24e94229a653 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:19.399468 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2228b3b-bd78-4285-be38-24e94229a653 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:04:19.407276 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-b2228b3b-bd78-4285-be38-24e94229a653 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:04:19.407276 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:04:19.407276 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:04:19.407276 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:04:19.407276 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:04:19.407276 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:04:19.407276 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:04:19.407276 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:04:19.407276 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:04:19.407276 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:04:19.407276 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:04:19.407276 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:04:19.407276 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:04:19.407276 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:04:19.407276 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:04:19.407276 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:04:19.408725 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:04:19.408725 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:04:19.408725 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:04:19.408725 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:04:19.408725 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:04:19.408725 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:04:19.408725 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:04:19.408725 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:04:19.408725 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:04:19.408725 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:04:19.408725 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:04:19.408725 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:04:19.408725 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:04:19.408725 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:04:19.408725 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:04:19.408725 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:04:19.409487 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:04:19.409487 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:04:19.409487 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:04:19.409487 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:04:19.409487 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:04:19.409487 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:04:19.409487 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:04:19.409487 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:04:19.409487 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:04:19.409487 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:04:19.409487 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:04:19.409487 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:04:19.409487 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 61/118] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Jul 4 09:04:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:04:19.416831 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2228b3b-bd78-4285-be38-24e94229a653 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:19.446364 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:19.470113 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4f28de-7c67-4010-838d-f60bc40dbbad None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:19.564389 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19deda93-b734-4d9f-bdd1-17162efdc48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:19.565295 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19deda93-b734-4d9f-bdd1-17162efdc48f None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:19.565580 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19deda93-b734-4d9f-bdd1-17162efdc48f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:19.565859 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19deda93-b734-4d9f-bdd1-17162efdc48f None admin] PATH_INFO: `/v3/projects/4dd04e5b7dd24f0e8050b45d6060f68c/users/cbeb03f2771e4aac8c0ee7d37e9ad2e0/roles/81634e7812344f84afcb29b0dba2687c` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:19.569057 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19deda93-b734-4d9f-bdd1-17162efdc48f None admin] RBAC: Authorizing `identity:create_grant(project_id=4dd04e5b7dd24f0e8050b45d6060f68c, user_id=cbeb03f2771e4aac8c0ee7d37e9ad2e0, role_id=81634e7812344f84afcb29b0dba2687c)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:19.570546 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19deda93-b734-4d9f-bdd1-17162efdc48f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:19.584069 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2228b3b-bd78-4285-be38-24e94229a653 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:19.595372 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 58/119] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Jul 4 09:04:19 2022] PUT /identity/v3/projects/4dd04e5b7dd24f0e8050b45d6060f68c/users/cbeb03f2771e4aac8c0ee7d37e9ad2e0/roles/81634e7812344f84afcb29b0dba2687c => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:04:19.636137 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2c7d76-c465-4fa2-bce8-67f171dd4a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:19.636873 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2c7d76-c465-4fa2-bce8-67f171dd4a7b None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:19.637166 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2c7d76-c465-4fa2-bce8-67f171dd4a7b None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:19.637443 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2c7d76-c465-4fa2-bce8-67f171dd4a7b None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:19.638218 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2c7d76-c465-4fa2-bce8-67f171dd4a7b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:04:19.638532 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2c7d76-c465-4fa2-bce8-67f171dd4a7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:19.640154 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2c7d76-c465-4fa2-bce8-67f171dd4a7b None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:19.650086 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 62/120] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jul 4 09:04:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:19.655688 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19deda93-b734-4d9f-bdd1-17162efdc48f None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:19.698745 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c821f3e-ad98-48c7-945b-1858276c7ef2 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:19.699092 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c821f3e-ad98-48c7-945b-1858276c7ef2 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:19.699313 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c821f3e-ad98-48c7-945b-1858276c7ef2 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:19.701005 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 63/121] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:04:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:04:19.709456 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08b6f2-3b56-4b9d-a652-8e59a71c799e None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:19.709753 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08b6f2-3b56-4b9d-a652-8e59a71c799e None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:19.710025 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08b6f2-3b56-4b9d-a652-8e59a71c799e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:19.731913 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:19.745047 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-6a08b6f2-3b56-4b9d-a652-8e59a71c799e None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:04:19.746331 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-6a08b6f2-3b56-4b9d-a652-8e59a71c799e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:04:19.856399 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19deda93-b734-4d9f-bdd1-17162efdc48f None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:19.873244 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 64/122] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:04:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 04 09:04:19.898215 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a08b6f2-3b56-4b9d-a652-8e59a71c799e None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:19.907369 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae657a7c-81f9-4004-be57-7d2486f6e7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:19.911570 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae657a7c-81f9-4004-be57-7d2486f6e7e6 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:19.911919 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae657a7c-81f9-4004-be57-7d2486f6e7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:19.912204 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae657a7c-81f9-4004-be57-7d2486f6e7e6 None admin] PATH_INFO: `/v3/users/04cf7e50af2f41cdb2f3d808072f7c87` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:19.913492 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae657a7c-81f9-4004-be57-7d2486f6e7e6 None admin] RBAC: Authorizing `identity:get_user(user_id=04cf7e50af2f41cdb2f3d808072f7c87)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:19.914983 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae657a7c-81f9-4004-be57-7d2486f6e7e6 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:19.917974 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 59/123] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Jul 4 09:04:19 2022] GET /identity/v3/users/04cf7e50af2f41cdb2f3d808072f7c87 => generated 247 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:19.923482 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae657a7c-81f9-4004-be57-7d2486f6e7e6 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:19.950111 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:20.040810 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae657a7c-81f9-4004-be57-7d2486f6e7e6 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:20.043321 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:20.082956 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864e103d-3dca-4008-a78b-4228a137c946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:20.084241 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e103d-3dca-4008-a78b-4228a137c946 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:20.084718 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e103d-3dca-4008-a78b-4228a137c946 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:20.085179 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e103d-3dca-4008-a78b-4228a137c946 None admin] PATH_INFO: `/v3/projects/4dd04e5b7dd24f0e8050b45d6060f68c` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:20.086555 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864e103d-3dca-4008-a78b-4228a137c946 None admin] RBAC: Authorizing `identity:get_project(project_id=4dd04e5b7dd24f0e8050b45d6060f68c)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:20.088286 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864e103d-3dca-4008-a78b-4228a137c946 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:20.090585 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 60/124] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jul 4 09:04:19 2022] GET /identity/v3/projects/4dd04e5b7dd24f0e8050b45d6060f68c => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:20.092097 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87571b00-944e-4164-9987-7ac2870b82b3 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:20.092576 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87571b00-944e-4164-9987-7ac2870b82b3 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:20.093037 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87571b00-944e-4164-9987-7ac2870b82b3 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:20.094618 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 61/125] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:04:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:04:20.101062 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87571b00-944e-4164-9987-7ac2870b82b3 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:20.103894 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a08b6f2-3b56-4b9d-a652-8e59a71c799e None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:20.140780 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d05d57-d830-4620-885d-7912e85b4408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:20.141624 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d05d57-d830-4620-885d-7912e85b4408 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:20.141916 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d05d57-d830-4620-885d-7912e85b4408 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:20.142253 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d05d57-d830-4620-885d-7912e85b4408 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:20.161067 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d05d57-d830-4620-885d-7912e85b4408 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:04:20.172980 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-66d05d57-d830-4620-885d-7912e85b4408 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:04:20.172980 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:04:20.172980 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:04:20.172980 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:04:20.172980 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:04:20.172980 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:04:20.172980 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:04:20.172980 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:04:20.172980 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:04:20.172980 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:04:20.172980 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:04:20.172980 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:04:20.172980 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:04:20.172980 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:04:20.172980 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:04:20.172980 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:04:20.173877 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:04:20.173877 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:04:20.173877 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:04:20.173877 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:04:20.173877 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:04:20.173877 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:04:20.173877 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:04:20.173877 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:04:20.173877 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:04:20.173877 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:04:20.173877 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:04:20.173877 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:04:20.173877 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:04:20.173877 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:04:20.173877 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:04:20.173877 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:04:20.174625 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:04:20.174625 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:04:20.174625 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:04:20.174625 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:04:20.174625 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:04:20.174625 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:04:20.174625 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:04:20.174625 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:04:20.174625 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:04:20.174625 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:04:20.174625 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:04:20.174625 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:04:20.174625 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 65/126] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jul 4 09:04:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:04:20.176025 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ac03f-3aad-4ec9-a411-0d7c3993ecac None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:20.176025 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ac03f-3aad-4ec9-a411-0d7c3993ecac None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:20.182335 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ac03f-3aad-4ec9-a411-0d7c3993ecac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:20.221739 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-b42ac03f-3aad-4ec9-a411-0d7c3993ecac None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:04:20.222965 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-b42ac03f-3aad-4ec9-a411-0d7c3993ecac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:04:20.309592 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87571b00-944e-4164-9987-7ac2870b82b3 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:20.327466 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 66/127] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:04:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:04:20.329107 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ac03f-3aad-4ec9-a411-0d7c3993ecac None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:20.344020 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:20.368342 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9189449-ec49-4147-ae07-7c0a4b3adebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:20.369265 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9189449-ec49-4147-ae07-7c0a4b3adebe None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:20.369544 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9189449-ec49-4147-ae07-7c0a4b3adebe None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:20.369818 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9189449-ec49-4147-ae07-7c0a4b3adebe None admin] PATH_INFO: `/v3/projects/4dd04e5b7dd24f0e8050b45d6060f68c/users/04cf7e50af2f41cdb2f3d808072f7c87/roles/965049e7ce6144aaad23c15f3a5e37c3` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:20.374173 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9189449-ec49-4147-ae07-7c0a4b3adebe None admin] RBAC: Authorizing `identity:create_grant(project_id=4dd04e5b7dd24f0e8050b45d6060f68c, user_id=04cf7e50af2f41cdb2f3d808072f7c87, role_id=965049e7ce6144aaad23c15f3a5e37c3)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:20.376482 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9189449-ec49-4147-ae07-7c0a4b3adebe None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:20.401509 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 62/128] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Jul 4 09:04:20 2022] PUT /identity/v3/projects/4dd04e5b7dd24f0e8050b45d6060f68c/users/04cf7e50af2f41cdb2f3d808072f7c87/roles/965049e7ce6144aaad23c15f3a5e37c3 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:04:20.402341 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9189449-ec49-4147-ae07-7c0a4b3adebe None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:20.477121 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:20.523943 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ac03f-3aad-4ec9-a411-0d7c3993ecac None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:20.573245 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9189449-ec49-4147-ae07-7c0a4b3adebe None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:20.588450 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902dcd90-b82c-4020-b0d7-4dfe6827c07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:20.589536 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902dcd90-b82c-4020-b0d7-4dfe6827c07f None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:20.590043 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902dcd90-b82c-4020-b0d7-4dfe6827c07f None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:20.590508 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902dcd90-b82c-4020-b0d7-4dfe6827c07f None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:20.591486 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902dcd90-b82c-4020-b0d7-4dfe6827c07f None admin] RBAC: Adding query filter params (name=member) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:04:20.592043 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902dcd90-b82c-4020-b0d7-4dfe6827c07f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:20.593690 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902dcd90-b82c-4020-b0d7-4dfe6827c07f None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:20.612654 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 67/129] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Jul 4 09:04:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:20.614554 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4459086-adb2-4c30-9d75-05659c033dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:20.615386 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4459086-adb2-4c30-9d75-05659c033dfb None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:20.615672 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4459086-adb2-4c30-9d75-05659c033dfb None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:20.615976 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4459086-adb2-4c30-9d75-05659c033dfb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:20.618224 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902dcd90-b82c-4020-b0d7-4dfe6827c07f None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:20.627309 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4459086-adb2-4c30-9d75-05659c033dfb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:04:20.636582 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-f4459086-adb2-4c30-9d75-05659c033dfb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 09:04:20.636582 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:04:20.636582 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:04:20.636582 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:04:20.636582 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:04:20.636582 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:04:20.636582 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:04:20.636582 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:04:20.636582 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:04:20.636582 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:04:20.636582 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:04:20.636582 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:04:20.636582 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:04:20.636582 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:04:20.636582 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:04:20.636582 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:04:20.637548 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:04:20.637548 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:04:20.637548 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:04:20.637548 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:04:20.637548 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:04:20.637548 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:04:20.637548 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:04:20.637548 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:04:20.637548 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:04:20.637548 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:04:20.637548 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:04:20.637548 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:04:20.637548 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:04:20.637548 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:04:20.637548 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:04:20.637548 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:04:20.638397 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:04:20.638397 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:04:20.638397 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:04:20.638397 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:04:20.638397 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:04:20.638397 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:04:20.638397 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:04:20.638397 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:04:20.638397 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:04:20.638397 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:04:20.638397 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 09:04:20.638397 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:04:20.638397 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 63/130] 10.222.0.42 () {56 vars in 1114 bytes} [Mon Jul 4 09:04:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:04:20.644765 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4459086-adb2-4c30-9d75-05659c033dfb None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:20.732341 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:20.765934 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902dcd90-b82c-4020-b0d7-4dfe6827c07f None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:20.799473 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d6a9d6-66b8-4233-847e-639cbe66b7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:20.800381 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6a9d6-66b8-4233-847e-639cbe66b7c0 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:20.800667 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6a9d6-66b8-4233-847e-639cbe66b7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:20.800947 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6a9d6-66b8-4233-847e-639cbe66b7c0 None admin] PATH_INFO: `/v3/users/cbeb03f2771e4aac8c0ee7d37e9ad2e0` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:20.802342 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d6a9d6-66b8-4233-847e-639cbe66b7c0 None admin] RBAC: Authorizing `identity:get_user(user_id=cbeb03f2771e4aac8c0ee7d37e9ad2e0)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:20.803609 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d6a9d6-66b8-4233-847e-639cbe66b7c0 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:20.805275 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 68/131] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Jul 4 09:04:20 2022] GET /identity/v3/users/cbeb03f2771e4aac8c0ee7d37e9ad2e0 => generated 275 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:04:20.806475 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceefab16-ba2c-4118-a1f6-58e525efbe61 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:20.806759 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceefab16-ba2c-4118-a1f6-58e525efbe61 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:20.807035 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceefab16-ba2c-4118-a1f6-58e525efbe61 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:20.808410 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 69/132] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:04:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:04:20.812817 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceefab16-ba2c-4118-a1f6-58e525efbe61 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:20.819581 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4459086-adb2-4c30-9d75-05659c033dfb None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:20.824682 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:20.856469 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6a45ec-b249-48f4-81d0-88876ed8103d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:20.857437 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6a45ec-b249-48f4-81d0-88876ed8103d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:20.857833 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6a45ec-b249-48f4-81d0-88876ed8103d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:20.858212 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6a45ec-b249-48f4-81d0-88876ed8103d None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:20.859071 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6a45ec-b249-48f4-81d0-88876ed8103d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:04:20.859528 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6a45ec-b249-48f4-81d0-88876ed8103d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:20.861649 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6a45ec-b249-48f4-81d0-88876ed8103d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:20.871697 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 64/133] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jul 4 09:04:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:20.873182 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bff2b5-36f7-4eed-8b2e-59b8e527571c None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:20.873581 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bff2b5-36f7-4eed-8b2e-59b8e527571c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:20.873964 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bff2b5-36f7-4eed-8b2e-59b8e527571c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:20.912589 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-17bff2b5-36f7-4eed-8b2e-59b8e527571c None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:04:20.913791 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-17bff2b5-36f7-4eed-8b2e-59b8e527571c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:04:20.972564 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceefab16-ba2c-4118-a1f6-58e525efbe61 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:21.034929 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed89846-c10e-4f77-8edf-9f04da39f314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:21.035731 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed89846-c10e-4f77-8edf-9f04da39f314 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:21.036051 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed89846-c10e-4f77-8edf-9f04da39f314 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:21.036362 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed89846-c10e-4f77-8edf-9f04da39f314 None admin] PATH_INFO: `/v3/projects/dc815f286d5a4fccb6f44401eb037eb6` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:21.038256 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed89846-c10e-4f77-8edf-9f04da39f314 None admin] RBAC: Authorizing `identity:get_project(project_id=dc815f286d5a4fccb6f44401eb037eb6)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:21.039852 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed89846-c10e-4f77-8edf-9f04da39f314 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:21.041905 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 70/134] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jul 4 09:04:20 2022] GET /identity/v3/projects/dc815f286d5a4fccb6f44401eb037eb6 => generated 312 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:21.042490 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed89846-c10e-4f77-8edf-9f04da39f314 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:21.044714 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 65/135] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:04:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:04:21.045967 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:21.048659 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bff2b5-36f7-4eed-8b2e-59b8e527571c None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:21.210439 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:21.246066 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bff2b5-36f7-4eed-8b2e-59b8e527571c None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:21.251110 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed89846-c10e-4f77-8edf-9f04da39f314 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:21.325704 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1047765-ec47-4680-8ff4-d34c38d16eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:21.326867 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1047765-ec47-4680-8ff4-d34c38d16eae None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:21.328605 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1047765-ec47-4680-8ff4-d34c38d16eae None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:21.329311 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1047765-ec47-4680-8ff4-d34c38d16eae None admin] PATH_INFO: `/v3/projects/dc815f286d5a4fccb6f44401eb037eb6/users/cbeb03f2771e4aac8c0ee7d37e9ad2e0/roles/81634e7812344f84afcb29b0dba2687c` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:21.331186 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7a4a38-e6a1-4acd-a715-5b0e37c1b89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:21.332253 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a4a38-e6a1-4acd-a715-5b0e37c1b89e None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:21.333167 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a4a38-e6a1-4acd-a715-5b0e37c1b89e None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:21.338100 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1047765-ec47-4680-8ff4-d34c38d16eae None admin] RBAC: Authorizing `identity:create_grant(project_id=dc815f286d5a4fccb6f44401eb037eb6, user_id=cbeb03f2771e4aac8c0ee7d37e9ad2e0, role_id=81634e7812344f84afcb29b0dba2687c)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:21.338548 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a4a38-e6a1-4acd-a715-5b0e37c1b89e None admin] PATH_INFO: `/v3/users/cbeb03f2771e4aac8c0ee7d37e9ad2e0` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:21.340220 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1047765-ec47-4680-8ff4-d34c38d16eae None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:21.345244 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7a4a38-e6a1-4acd-a715-5b0e37c1b89e None admin] RBAC: Authorizing `identity:get_user(user_id=cbeb03f2771e4aac8c0ee7d37e9ad2e0)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:21.346876 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7a4a38-e6a1-4acd-a715-5b0e37c1b89e None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:21.352425 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 71/136] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Jul 4 09:04:21 2022] GET /identity/v3/users/cbeb03f2771e4aac8c0ee7d37e9ad2e0 => generated 275 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:21.354467 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7a4a38-e6a1-4acd-a715-5b0e37c1b89e None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:21.375394 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 66/137] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Jul 4 09:04:21 2022] PUT /identity/v3/projects/dc815f286d5a4fccb6f44401eb037eb6/users/cbeb03f2771e4aac8c0ee7d37e9ad2e0/roles/81634e7812344f84afcb29b0dba2687c => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:04:21.376519 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1047765-ec47-4680-8ff4-d34c38d16eae None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:21.531893 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:21.597767 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7a4a38-e6a1-4acd-a715-5b0e37c1b89e None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:21.611589 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1047765-ec47-4680-8ff4-d34c38d16eae None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:21.672675 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ce5dc6-fa4b-469e-896e-da5955178ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:21.674578 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce5dc6-fa4b-469e-896e-da5955178ca1 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:21.676211 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce5dc6-fa4b-469e-896e-da5955178ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:21.677362 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce5dc6-fa4b-469e-896e-da5955178ca1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:21.679498 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ce5dc6-fa4b-469e-896e-da5955178ca1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:21.681612 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ce5dc6-fa4b-469e-896e-da5955178ca1 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:21.685497 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6f9501-fa20-4e1e-8db3-a632bf5d9905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:21.686583 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f9501-fa20-4e1e-8db3-a632bf5d9905 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:21.687006 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f9501-fa20-4e1e-8db3-a632bf5d9905 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:21.687419 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f9501-fa20-4e1e-8db3-a632bf5d9905 None admin] PATH_INFO: `/v3/projects/4dd04e5b7dd24f0e8050b45d6060f68c` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:21.687900 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 72/138] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:04:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:21.689345 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1c1036-ac3c-4853-8369-5b8532ee0336 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:21.690441 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1c1036-ac3c-4853-8369-5b8532ee0336 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:21.691312 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6f9501-fa20-4e1e-8db3-a632bf5d9905 None admin] RBAC: Authorizing `identity:get_project(project_id=4dd04e5b7dd24f0e8050b45d6060f68c)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:21.692976 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6f9501-fa20-4e1e-8db3-a632bf5d9905 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:21.693414 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1c1036-ac3c-4853-8369-5b8532ee0336 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:21.694939 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 73/139] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:04:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:04:21.696895 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 67/140] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jul 4 09:04:21 2022] GET /identity/v3/projects/4dd04e5b7dd24f0e8050b45d6060f68c => generated 298 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:21.697807 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1c1036-ac3c-4853-8369-5b8532ee0336 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:21.705580 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42ea68c-9aa9-4f3b-ad5c-3d4f7f557078 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:21.705872 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42ea68c-9aa9-4f3b-ad5c-3d4f7f557078 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:21.706159 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42ea68c-9aa9-4f3b-ad5c-3d4f7f557078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:21.750467 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-a42ea68c-9aa9-4f3b-ad5c-3d4f7f557078 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:04:21.750467 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a42ea68c-9aa9-4f3b-ad5c-3d4f7f557078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:04:21.759208 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:21.851347 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 68/141] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:04:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:04:21.852527 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42ea68c-9aa9-4f3b-ad5c-3d4f7f557078 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:21.910330 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1c1036-ac3c-4853-8369-5b8532ee0336 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:21.946746 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5c1dde-7691-437e-bc34-8ea547b8d501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:21.947424 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c1dde-7691-437e-bc34-8ea547b8d501 None admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:21.947710 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c1dde-7691-437e-bc34-8ea547b8d501 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:21.948019 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c1dde-7691-437e-bc34-8ea547b8d501 None admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:21.948746 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5c1dde-7691-437e-bc34-8ea547b8d501 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:21.950216 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5c1dde-7691-437e-bc34-8ea547b8d501 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:21.961652 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:21.974762 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 74/142] 10.222.0.42 () {60 vars in 1132 bytes} [Mon Jul 4 09:04:21 2022] POST /identity/v3/users => generated 283 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:04:21.975710 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5c1dde-7691-437e-bc34-8ea547b8d501 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:22.098067 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42ea68c-9aa9-4f3b-ad5c-3d4f7f557078 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:22.139397 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a325374-6d0f-42f4-8c1f-a2605de8b9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:22.140408 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a325374-6d0f-42f4-8c1f-a2605de8b9c7 None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:22.140700 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a325374-6d0f-42f4-8c1f-a2605de8b9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:22.141121 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a325374-6d0f-42f4-8c1f-a2605de8b9c7 None admin] PATH_INFO: `/v3/projects/4dd04e5b7dd24f0e8050b45d6060f68c/users/cbeb03f2771e4aac8c0ee7d37e9ad2e0/roles/157d1a80161e43a3ad84446eeca98e0b` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:22.144124 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a325374-6d0f-42f4-8c1f-a2605de8b9c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=4dd04e5b7dd24f0e8050b45d6060f68c, user_id=cbeb03f2771e4aac8c0ee7d37e9ad2e0, role_id=157d1a80161e43a3ad84446eeca98e0b)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:22.145659 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a325374-6d0f-42f4-8c1f-a2605de8b9c7 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:22.150504 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5c1dde-7691-437e-bc34-8ea547b8d501 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:22.183167 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 69/143] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Jul 4 09:04:21 2022] PUT /identity/v3/projects/4dd04e5b7dd24f0e8050b45d6060f68c/users/cbeb03f2771e4aac8c0ee7d37e9ad2e0/roles/157d1a80161e43a3ad84446eeca98e0b => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:04:22.219518 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7b403a-2997-453e-a00d-243b2f8728fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:22.220379 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b403a-2997-453e-a00d-243b2f8728fb None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:22.220663 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b403a-2997-453e-a00d-243b2f8728fb None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:22.220938 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b403a-2997-453e-a00d-243b2f8728fb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:22.239973 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7b403a-2997-453e-a00d-243b2f8728fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:04:22.249668 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-0b7b403a-2997-453e-a00d-243b2f8728fb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 09:04:22.249668 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:04:22.249668 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:04:22.249668 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:04:22.249668 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:04:22.249668 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:04:22.249668 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:04:22.249668 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:04:22.249668 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:04:22.249668 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:04:22.249668 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:04:22.249668 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:04:22.249668 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:04:22.249668 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:04:22.249668 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:04:22.249668 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:04:22.250691 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:04:22.250691 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:04:22.250691 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:04:22.250691 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:04:22.250691 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:04:22.250691 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:04:22.250691 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:04:22.250691 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:04:22.250691 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:04:22.250691 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:04:22.250691 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:04:22.250691 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:04:22.250691 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:04:22.250691 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:04:22.250691 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:04:22.250691 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:04:22.251923 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:04:22.251923 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:04:22.251923 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:04:22.251923 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:04:22.251923 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:04:22.251923 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:04:22.251923 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:04:22.251923 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:04:22.251923 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:04:22.251923 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:04:22.251923 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 09:04:22.251923 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:04:22.251923 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 75/144] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jul 4 09:04:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:04:22.257582 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a325374-6d0f-42f4-8c1f-a2605de8b9c7 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:22.264962 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:22.410074 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a325374-6d0f-42f4-8c1f-a2605de8b9c7 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:22.452079 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9b124d-aed4-43b7-a6f2-d782911650d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:22.452757 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b124d-aed4-43b7-a6f2-d782911650d8 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:22.453040 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b124d-aed4-43b7-a6f2-d782911650d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:22.453352 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b124d-aed4-43b7-a6f2-d782911650d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:22.454111 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9b124d-aed4-43b7-a6f2-d782911650d8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:04:22.454416 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9b124d-aed4-43b7-a6f2-d782911650d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:22.455826 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9b124d-aed4-43b7-a6f2-d782911650d8 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:22.467754 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 70/145] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Jul 4 09:04:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:22.475367 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7b403a-2997-453e-a00d-243b2f8728fb None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:22.563456 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:22.574317 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218b011-e759-416b-a023-f35fa8f4f8e7 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:22.574933 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218b011-e759-416b-a023-f35fa8f4f8e7 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:22.575404 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218b011-e759-416b-a023-f35fa8f4f8e7 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:22.584182 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 71/146] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:04:22 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:04:22.597374 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022e282-37e8-42b7-ac6d-9ccf3ec716ad None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:22.597956 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022e282-37e8-42b7-ac6d-9ccf3ec716ad None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:22.598439 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022e282-37e8-42b7-ac6d-9ccf3ec716ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:22.620274 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7b403a-2997-453e-a00d-243b2f8728fb None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:22.652907 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-6022e282-37e8-42b7-ac6d-9ccf3ec716ad None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:04:22.654784 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6022e282-37e8-42b7-ac6d-9ccf3ec716ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:04:22.659911 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431073ca-b616-45c4-97e9-51b3daaa7bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:22.659911 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431073ca-b616-45c4-97e9-51b3daaa7bcf None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:22.659911 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431073ca-b616-45c4-97e9-51b3daaa7bcf None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:22.659911 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431073ca-b616-45c4-97e9-51b3daaa7bcf None admin] PATH_INFO: `/v3/users/afc1d34c7c80418b81e9282d3853696f` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:22.660308 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431073ca-b616-45c4-97e9-51b3daaa7bcf None admin] RBAC: Authorizing `identity:get_user(user_id=afc1d34c7c80418b81e9282d3853696f)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:22.662648 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431073ca-b616-45c4-97e9-51b3daaa7bcf None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:22.664523 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 76/147] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Jul 4 09:04:22 2022] GET /identity/v3/users/afc1d34c7c80418b81e9282d3853696f => generated 289 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:22.670849 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431073ca-b616-45c4-97e9-51b3daaa7bcf None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:22.781640 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431073ca-b616-45c4-97e9-51b3daaa7bcf None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:22.818472 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512a32d9-11d0-4596-8a4e-5e3e8466dd4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:22.819807 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a32d9-11d0-4596-8a4e-5e3e8466dd4a None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:22.820123 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a32d9-11d0-4596-8a4e-5e3e8466dd4a None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:22.820398 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a32d9-11d0-4596-8a4e-5e3e8466dd4a None admin] PATH_INFO: `/v3/projects/4dd04e5b7dd24f0e8050b45d6060f68c` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:22.821743 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512a32d9-11d0-4596-8a4e-5e3e8466dd4a None admin] RBAC: Authorizing `identity:get_project(project_id=4dd04e5b7dd24f0e8050b45d6060f68c)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:22.823347 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512a32d9-11d0-4596-8a4e-5e3e8466dd4a None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:22.825408 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 77/148] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jul 4 09:04:22 2022] GET /identity/v3/projects/4dd04e5b7dd24f0e8050b45d6060f68c => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:04:22.828425 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:22.831921 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512a32d9-11d0-4596-8a4e-5e3e8466dd4a None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:22.833777 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:22.853774 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 72/149] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:04:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:04:22.955091 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512a32d9-11d0-4596-8a4e-5e3e8466dd4a None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:22.997654 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4657f6-8742-4c2a-b212-5243d021ebc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:22.998560 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4657f6-8742-4c2a-b212-5243d021ebc1 None admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:22.998839 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4657f6-8742-4c2a-b212-5243d021ebc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:22.999110 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4657f6-8742-4c2a-b212-5243d021ebc1 None admin] PATH_INFO: `/v3/projects/4dd04e5b7dd24f0e8050b45d6060f68c/users/afc1d34c7c80418b81e9282d3853696f/roles/a5112c31cfa1478db60e6079627603f6` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:23.001407 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4657f6-8742-4c2a-b212-5243d021ebc1 None admin] RBAC: Authorizing `identity:create_grant(project_id=4dd04e5b7dd24f0e8050b45d6060f68c, user_id=afc1d34c7c80418b81e9282d3853696f, role_id=a5112c31cfa1478db60e6079627603f6)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:23.002633 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6022e282-37e8-42b7-ac6d-9ccf3ec716ad None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:23.002946 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4657f6-8742-4c2a-b212-5243d021ebc1 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:23.023408 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 78/150] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Jul 4 09:04:22 2022] PUT /identity/v3/projects/4dd04e5b7dd24f0e8050b45d6060f68c/users/afc1d34c7c80418b81e9282d3853696f/roles/a5112c31cfa1478db60e6079627603f6 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:04:23.153159 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6022e282-37e8-42b7-ac6d-9ccf3ec716ad None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:23.200196 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb7ebea-fff9-4597-aa28-12f897689815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:23.201364 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb7ebea-fff9-4597-aa28-12f897689815 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:23.201839 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb7ebea-fff9-4597-aa28-12f897689815 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:23.202340 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb7ebea-fff9-4597-aa28-12f897689815 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:23.214646 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb7ebea-fff9-4597-aa28-12f897689815 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:04:23.222987 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-edb7ebea-fff9-4597-aa28-12f897689815 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:04:23.222987 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:04:23.222987 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:04:23.222987 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:04:23.222987 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:04:23.222987 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:04:23.222987 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:04:23.222987 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:04:23.222987 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:04:23.222987 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:04:23.222987 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:04:23.222987 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:04:23.222987 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:04:23.222987 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:04:23.222987 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:04:23.222987 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:04:23.223910 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:04:23.223910 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:04:23.223910 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:04:23.223910 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:04:23.223910 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:04:23.223910 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:04:23.223910 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:04:23.223910 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:04:23.223910 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:04:23.223910 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:04:23.223910 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:04:23.223910 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:04:23.223910 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:04:23.223910 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:04:23.223910 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:04:23.223910 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:04:23.224728 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:04:23.224728 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:04:23.224728 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:04:23.224728 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:04:23.224728 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:04:23.224728 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:04:23.224728 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:04:23.224728 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:04:23.224728 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:04:23.224728 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:04:23.224728 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:04:23.224728 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:04:23.227163 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 73/151] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jul 4 09:04:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:04:23.233116 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4657f6-8742-4c2a-b212-5243d021ebc1 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:23.313716 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:23.374652 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4657f6-8742-4c2a-b212-5243d021ebc1 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:23.411760 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788bc57c-8983-4e0f-81dc-9a1669b5613c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:23.412489 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788bc57c-8983-4e0f-81dc-9a1669b5613c None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:23.412769 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788bc57c-8983-4e0f-81dc-9a1669b5613c None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:23.413040 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788bc57c-8983-4e0f-81dc-9a1669b5613c None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:23.413884 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788bc57c-8983-4e0f-81dc-9a1669b5613c None admin] RBAC: Adding query filter params (name=member) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:04:23.414093 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788bc57c-8983-4e0f-81dc-9a1669b5613c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:23.415410 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf0b90-d8a2-470e-8f5d-4f0f6d1fdfdc None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:23.415512 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788bc57c-8983-4e0f-81dc-9a1669b5613c None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:23.415701 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf0b90-d8a2-470e-8f5d-4f0f6d1fdfdc None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:23.417350 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf0b90-d8a2-470e-8f5d-4f0f6d1fdfdc None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:23.417456 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 74/152] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:04:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:04:23.424654 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 79/153] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Jul 4 09:04:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:23.429262 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae13d5b8-f438-4ece-a2f3-907373f176e6 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:23.429555 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae13d5b8-f438-4ece-a2f3-907373f176e6 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:23.429835 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae13d5b8-f438-4ece-a2f3-907373f176e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:23.430000 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788bc57c-8983-4e0f-81dc-9a1669b5613c None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:23.469080 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-ae13d5b8-f438-4ece-a2f3-907373f176e6 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:04:23.470215 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ae13d5b8-f438-4ece-a2f3-907373f176e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:04:23.557205 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788bc57c-8983-4e0f-81dc-9a1669b5613c None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:23.577329 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:23.591974 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:23.606146 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae5605-dd30-4e20-8f76-52fcfe4dcc25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:23.607371 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae5605-dd30-4e20-8f76-52fcfe4dcc25 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:23.607828 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae5605-dd30-4e20-8f76-52fcfe4dcc25 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:23.608305 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae5605-dd30-4e20-8f76-52fcfe4dcc25 None admin] PATH_INFO: `/v3/users/cbeb03f2771e4aac8c0ee7d37e9ad2e0` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:23.610455 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daae5605-dd30-4e20-8f76-52fcfe4dcc25 None admin] RBAC: Authorizing `identity:get_user(user_id=cbeb03f2771e4aac8c0ee7d37e9ad2e0)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:23.612610 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daae5605-dd30-4e20-8f76-52fcfe4dcc25 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:23.614457 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 80/154] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Jul 4 09:04:23 2022] GET /identity/v3/users/cbeb03f2771e4aac8c0ee7d37e9ad2e0 => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:04:23.620215 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae5605-dd30-4e20-8f76-52fcfe4dcc25 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:23.634189 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 75/155] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:04:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:04:23.673974 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae13d5b8-f438-4ece-a2f3-907373f176e6 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:23.732959 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae5605-dd30-4e20-8f76-52fcfe4dcc25 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:23.791121 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187b6d61-3373-483b-ab69-9bc40e54940c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:23.792306 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b6d61-3373-483b-ab69-9bc40e54940c None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:23.792888 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b6d61-3373-483b-ab69-9bc40e54940c None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:23.793343 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b6d61-3373-483b-ab69-9bc40e54940c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:23.865906 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:23.901467 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187b6d61-3373-483b-ab69-9bc40e54940c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:23.903319 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187b6d61-3373-483b-ab69-9bc40e54940c None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:23.981152 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae13d5b8-f438-4ece-a2f3-907373f176e6 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:24.082218 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db14d3c-fe88-4291-9c3d-d030845a8606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:24.082922 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db14d3c-fe88-4291-9c3d-d030845a8606 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:24.083205 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db14d3c-fe88-4291-9c3d-d030845a8606 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:24.083478 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db14d3c-fe88-4291-9c3d-d030845a8606 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:24.096933 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 81/156] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jul 4 09:04:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:04:24.102639 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187b6d61-3373-483b-ab69-9bc40e54940c None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:24.108788 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db14d3c-fe88-4291-9c3d-d030845a8606 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:04:24.117078 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-9db14d3c-fe88-4291-9c3d-d030845a8606 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:04:24.117078 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:04:24.117078 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:04:24.117078 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:04:24.117078 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:04:24.117078 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:04:24.117078 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:04:24.117078 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:04:24.117078 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:04:24.117078 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:04:24.117078 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:04:24.117078 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:04:24.117078 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:04:24.117078 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:04:24.117078 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:04:24.117078 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:04:24.118179 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:04:24.118179 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:04:24.118179 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:04:24.118179 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:04:24.118179 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:04:24.118179 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:04:24.118179 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:04:24.118179 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:04:24.118179 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:04:24.118179 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:04:24.118179 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:04:24.118179 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:04:24.118179 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:04:24.118179 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:04:24.118179 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:04:24.118179 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:04:24.119050 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:04:24.119050 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:04:24.119050 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:04:24.119050 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:04:24.119050 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:04:24.119050 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:04:24.119050 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:04:24.119050 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:04:24.119050 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:04:24.119050 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:04:24.119050 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:04:24.119050 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:04:24.124208 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 76/157] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Jul 4 09:04:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 451 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:04:24.125178 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db14d3c-fe88-4291-9c3d-d030845a8606 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:24.221998 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:24.266141 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:24.311547 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187b6d61-3373-483b-ab69-9bc40e54940c None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:24.359777 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db14d3c-fe88-4291-9c3d-d030845a8606 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:24.397957 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd261d0d-8d33-4ce2-bedf-4983d2ab7a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:24.398841 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd261d0d-8d33-4ce2-bedf-4983d2ab7a38 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:24.399128 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd261d0d-8d33-4ce2-bedf-4983d2ab7a38 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:24.399405 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd261d0d-8d33-4ce2-bedf-4983d2ab7a38 None admin] PATH_INFO: `/v3/projects/4dd04e5b7dd24f0e8050b45d6060f68c` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:24.404203 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd261d0d-8d33-4ce2-bedf-4983d2ab7a38 None admin] RBAC: Authorizing `identity:get_project(project_id=4dd04e5b7dd24f0e8050b45d6060f68c)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:24.405697 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd261d0d-8d33-4ce2-bedf-4983d2ab7a38 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:24.407824 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 82/158] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jul 4 09:04:24 2022] GET /identity/v3/projects/4dd04e5b7dd24f0e8050b45d6060f68c => generated 298 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:04:24.413214 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd261d0d-8d33-4ce2-bedf-4983d2ab7a38 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:24.442443 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427ce04a-8a25-4590-becf-eb91eb9d6cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:24.443120 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ce04a-8a25-4590-becf-eb91eb9d6cc2 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:24.443405 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ce04a-8a25-4590-becf-eb91eb9d6cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:24.443680 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ce04a-8a25-4590-becf-eb91eb9d6cc2 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:24.444490 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427ce04a-8a25-4590-becf-eb91eb9d6cc2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:04:24.444795 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427ce04a-8a25-4590-becf-eb91eb9d6cc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:24.446214 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427ce04a-8a25-4590-becf-eb91eb9d6cc2 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:24.463121 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 77/159] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jul 4 09:04:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:24.469168 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427ce04a-8a25-4590-becf-eb91eb9d6cc2 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:24.599894 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd261d0d-8d33-4ce2-bedf-4983d2ab7a38 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:24.661504 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf2a7d3-5bff-4233-b75c-609c8df15d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:24.662668 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf2a7d3-5bff-4233-b75c-609c8df15d90 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:24.663241 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf2a7d3-5bff-4233-b75c-609c8df15d90 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:24.663704 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf2a7d3-5bff-4233-b75c-609c8df15d90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:24.664777 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf2a7d3-5bff-4233-b75c-609c8df15d90 None admin] RBAC: Adding query filter params (role.id=81634e7812344f84afcb29b0dba2687c, scope.project.id=4dd04e5b7dd24f0e8050b45d6060f68c, user.id=cbeb03f2771e4aac8c0ee7d37e9ad2e0) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:04:24.665292 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf2a7d3-5bff-4233-b75c-609c8df15d90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:24.666958 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf2a7d3-5bff-4233-b75c-609c8df15d90 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:24.677696 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 83/160] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Jul 4 09:04:24 2022] GET /identity/v3/role_assignments?user.id=cbeb03f2771e4aac8c0ee7d37e9ad2e0&scope.project.id=4dd04e5b7dd24f0e8050b45d6060f68c&role.id=81634e7812344f84afcb29b0dba2687c => generated 608 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:24.686226 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427ce04a-8a25-4590-becf-eb91eb9d6cc2 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:24.698253 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:24.730729 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419a4c0b-0f9e-42fe-a8b5-95ddb342b917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:24.731676 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a4c0b-0f9e-42fe-a8b5-95ddb342b917 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:24.731987 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a4c0b-0f9e-42fe-a8b5-95ddb342b917 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:24.732265 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a4c0b-0f9e-42fe-a8b5-95ddb342b917 None admin] PATH_INFO: `/v3/users/04cf7e50af2f41cdb2f3d808072f7c87` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:24.733576 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419a4c0b-0f9e-42fe-a8b5-95ddb342b917 None admin] RBAC: Authorizing `identity:get_user(user_id=04cf7e50af2f41cdb2f3d808072f7c87)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:24.735121 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419a4c0b-0f9e-42fe-a8b5-95ddb342b917 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:24.737321 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 78/161] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Jul 4 09:04:24 2022] GET /identity/v3/users/04cf7e50af2f41cdb2f3d808072f7c87 => generated 247 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:04:24.742834 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf2a7d3-5bff-4233-b75c-609c8df15d90 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:24.764365 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:24.875990 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf2a7d3-5bff-4233-b75c-609c8df15d90 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:24.916445 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be47896-e2e9-4384-98f8-c212b282583f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:24.920616 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be47896-e2e9-4384-98f8-c212b282583f None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:24.920904 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be47896-e2e9-4384-98f8-c212b282583f None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:24.921183 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be47896-e2e9-4384-98f8-c212b282583f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:25.007672 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be47896-e2e9-4384-98f8-c212b282583f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:25.009277 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be47896-e2e9-4384-98f8-c212b282583f None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:25.024086 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:25.110260 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 84/162] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jul 4 09:04:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:04:25.115852 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419a4c0b-0f9e-42fe-a8b5-95ddb342b917 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:25.244190 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e9b45-6f5d-4763-be98-c1421e988acc None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:25.244495 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e9b45-6f5d-4763-be98-c1421e988acc None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:25.244678 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e9b45-6f5d-4763-be98-c1421e988acc None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:25.246044 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 85/163] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:04:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:04:25.253397 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff846c55-53bd-42c2-951b-166b7eb940ad None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:25.253683 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff846c55-53bd-42c2-951b-166b7eb940ad None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:25.253948 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff846c55-53bd-42c2-951b-166b7eb940ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:25.277816 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419a4c0b-0f9e-42fe-a8b5-95ddb342b917 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:25.280923 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-ff846c55-53bd-42c2-951b-166b7eb940ad None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:04:25.282275 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-ff846c55-53bd-42c2-951b-166b7eb940ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:04:25.356609 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d019e19-9dc2-4d20-965f-0818b02436e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:25.357513 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d019e19-9dc2-4d20-965f-0818b02436e3 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:25.357777 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d019e19-9dc2-4d20-965f-0818b02436e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:25.358054 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d019e19-9dc2-4d20-965f-0818b02436e3 None admin] PATH_INFO: `/v3/projects/4dd04e5b7dd24f0e8050b45d6060f68c` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:25.359303 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d019e19-9dc2-4d20-965f-0818b02436e3 None admin] RBAC: Authorizing `identity:get_project(project_id=4dd04e5b7dd24f0e8050b45d6060f68c)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:25.361181 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d019e19-9dc2-4d20-965f-0818b02436e3 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:25.363229 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 79/164] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jul 4 09:04:25 2022] GET /identity/v3/projects/4dd04e5b7dd24f0e8050b45d6060f68c => generated 298 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:25.368948 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d019e19-9dc2-4d20-965f-0818b02436e3 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:25.381308 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 86/165] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:04:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 09:04:25.420480 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff846c55-53bd-42c2-951b-166b7eb940ad None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:25.455634 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:25.484228 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:25.543492 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff846c55-53bd-42c2-951b-166b7eb940ad None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:25.562615 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d019e19-9dc2-4d20-965f-0818b02436e3 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:25.587062 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3747442c-1af8-4c7e-997c-62107e13037f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:25.587965 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3747442c-1af8-4c7e-997c-62107e13037f None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:25.588253 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3747442c-1af8-4c7e-997c-62107e13037f None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:25.588611 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3747442c-1af8-4c7e-997c-62107e13037f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:25.607913 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3747442c-1af8-4c7e-997c-62107e13037f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:04:25.623539 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-3747442c-1af8-4c7e-997c-62107e13037f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:04:25.623539 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:04:25.623539 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:04:25.623539 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:04:25.623539 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:04:25.623539 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:04:25.623539 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:04:25.623539 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:04:25.623539 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:04:25.623539 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:04:25.623539 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:04:25.623539 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:04:25.623539 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:04:25.623539 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:04:25.623539 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:04:25.623539 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:04:25.625742 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:04:25.625742 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:04:25.625742 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:04:25.625742 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:04:25.625742 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:04:25.625742 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:04:25.625742 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:04:25.625742 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:04:25.625742 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:04:25.625742 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:04:25.625742 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:04:25.625742 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:04:25.625742 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:04:25.625742 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:04:25.625742 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:04:25.625742 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:04:25.628032 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:04:25.628032 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:04:25.628032 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:04:25.628032 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:04:25.628032 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:04:25.628032 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:04:25.628032 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:04:25.628032 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:04:25.628032 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:04:25.628032 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:04:25.628032 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:04:25.628032 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:04:25.628032 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 87/166] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jul 4 09:04:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:04:25.629623 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1261e4e3-ebba-4262-8bc9-6195f8e69a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:25.629623 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261e4e3-ebba-4262-8bc9-6195f8e69a13 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:25.629623 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261e4e3-ebba-4262-8bc9-6195f8e69a13 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:25.629623 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261e4e3-ebba-4262-8bc9-6195f8e69a13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:25.630182 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1261e4e3-ebba-4262-8bc9-6195f8e69a13 None admin] RBAC: Adding query filter params (role.id=965049e7ce6144aaad23c15f3a5e37c3, scope.project.id=4dd04e5b7dd24f0e8050b45d6060f68c, user.id=04cf7e50af2f41cdb2f3d808072f7c87) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:04:25.635892 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1261e4e3-ebba-4262-8bc9-6195f8e69a13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:25.636137 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3747442c-1af8-4c7e-997c-62107e13037f None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:25.636312 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1261e4e3-ebba-4262-8bc9-6195f8e69a13 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:25.643683 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 80/167] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Jul 4 09:04:25 2022] GET /identity/v3/role_assignments?user.id=04cf7e50af2f41cdb2f3d808072f7c87&scope.project.id=4dd04e5b7dd24f0e8050b45d6060f68c&role.id=965049e7ce6144aaad23c15f3a5e37c3 => generated 608 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:04:25.806127 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3747442c-1af8-4c7e-997c-62107e13037f None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:25.820483 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:25.854770 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6149f531-7247-4ba9-a49c-82a9dda867b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:25.855455 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149f531-7247-4ba9-a49c-82a9dda867b4 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:25.855779 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149f531-7247-4ba9-a49c-82a9dda867b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:25.856088 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149f531-7247-4ba9-a49c-82a9dda867b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:25.856855 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6149f531-7247-4ba9-a49c-82a9dda867b4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:04:25.857159 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6149f531-7247-4ba9-a49c-82a9dda867b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:25.858560 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6149f531-7247-4ba9-a49c-82a9dda867b4 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:25.868007 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 88/168] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Jul 4 09:04:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:04:25.873806 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1261e4e3-ebba-4262-8bc9-6195f8e69a13 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:25.957361 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ee8c7-1b2d-4db5-8c6e-34a0c110300c None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:25.957714 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ee8c7-1b2d-4db5-8c6e-34a0c110300c None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:25.957915 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ee8c7-1b2d-4db5-8c6e-34a0c110300c None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:25.961376 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 89/169] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:04:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:04:25.964822 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a673f94-0fba-4d3b-948c-1468426d8b44 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:25.965104 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a673f94-0fba-4d3b-948c-1468426d8b44 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:25.965373 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a673f94-0fba-4d3b-948c-1468426d8b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:26.001498 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-6a673f94-0fba-4d3b-948c-1468426d8b44 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:04:26.003163 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-6a673f94-0fba-4d3b-948c-1468426d8b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:04:26.011967 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1261e4e3-ebba-4262-8bc9-6195f8e69a13 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:26.034118 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:26.049140 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ed8d9-b83a-4073-9cf8-0fed4f5fdb29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:26.050036 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ed8d9-b83a-4073-9cf8-0fed4f5fdb29 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:26.050319 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ed8d9-b83a-4073-9cf8-0fed4f5fdb29 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:26.050596 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ed8d9-b83a-4073-9cf8-0fed4f5fdb29 None admin] PATH_INFO: `/v3/users/cbeb03f2771e4aac8c0ee7d37e9ad2e0` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:26.053144 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732ed8d9-b83a-4073-9cf8-0fed4f5fdb29 None admin] RBAC: Authorizing `identity:get_user(user_id=cbeb03f2771e4aac8c0ee7d37e9ad2e0)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:26.054652 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732ed8d9-b83a-4073-9cf8-0fed4f5fdb29 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:26.056936 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 81/170] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Jul 4 09:04:25 2022] GET /identity/v3/users/cbeb03f2771e4aac8c0ee7d37e9ad2e0 => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:26.062964 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ed8d9-b83a-4073-9cf8-0fed4f5fdb29 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:26.134426 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 90/171] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:04:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 09:04:26.171713 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a673f94-0fba-4d3b-948c-1468426d8b44 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:26.222420 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ed8d9-b83a-4073-9cf8-0fed4f5fdb29 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:26.275620 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737c1db3-b026-4abe-8ee8-bf26dcdd3d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:26.276410 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c1db3-b026-4abe-8ee8-bf26dcdd3d6f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:26.276699 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c1db3-b026-4abe-8ee8-bf26dcdd3d6f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:26.276971 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c1db3-b026-4abe-8ee8-bf26dcdd3d6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:26.329330 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:26.332250 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:26.337753 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a673f94-0fba-4d3b-948c-1468426d8b44 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:26.356325 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737c1db3-b026-4abe-8ee8-bf26dcdd3d6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:26.358224 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737c1db3-b026-4abe-8ee8-bf26dcdd3d6f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:26.392578 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cd03d0-cb07-4623-a3ac-f154bd9fd805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:26.393405 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd03d0-cb07-4623-a3ac-f154bd9fd805 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:26.393682 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd03d0-cb07-4623-a3ac-f154bd9fd805 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:26.393952 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd03d0-cb07-4623-a3ac-f154bd9fd805 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:26.409209 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cd03d0-cb07-4623-a3ac-f154bd9fd805 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:04:26.425724 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-80cd03d0-cb07-4623-a3ac-f154bd9fd805 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 09:04:26.425724 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:04:26.425724 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:04:26.425724 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:04:26.425724 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:04:26.425724 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:04:26.425724 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:04:26.425724 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:04:26.425724 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:04:26.425724 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:04:26.425724 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:04:26.425724 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:04:26.425724 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:04:26.425724 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:04:26.425724 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:04:26.425724 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:04:26.427102 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:04:26.427102 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:04:26.427102 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:04:26.427102 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:04:26.427102 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:04:26.427102 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:04:26.427102 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:04:26.427102 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:04:26.427102 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:04:26.427102 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:04:26.427102 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:04:26.427102 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:04:26.427102 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:04:26.427102 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:04:26.427102 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:04:26.427102 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:04:26.428190 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:04:26.428190 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:04:26.428190 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:04:26.428190 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:04:26.428190 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:04:26.428190 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:04:26.428190 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:04:26.428190 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:04:26.428190 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:04:26.428190 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:04:26.428190 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 09:04:26.428190 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:04:26.428190 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 91/172] 10.222.0.42 () {56 vars in 1114 bytes} [Mon Jul 4 09:04:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:04:26.433511 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cd03d0-cb07-4623-a3ac-f154bd9fd805 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:26.492138 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 82/173] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jul 4 09:04:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:04:26.497312 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737c1db3-b026-4abe-8ee8-bf26dcdd3d6f None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:26.582694 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cd03d0-cb07-4623-a3ac-f154bd9fd805 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:26.639896 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:26.665495 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda44673-9263-4dc8-bc8c-a155c7ee1737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:26.666187 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda44673-9263-4dc8-bc8c-a155c7ee1737 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:26.666474 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda44673-9263-4dc8-bc8c-a155c7ee1737 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:26.666749 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda44673-9263-4dc8-bc8c-a155c7ee1737 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:26.667521 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda44673-9263-4dc8-bc8c-a155c7ee1737 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:04:26.667833 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda44673-9263-4dc8-bc8c-a155c7ee1737 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:26.669279 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda44673-9263-4dc8-bc8c-a155c7ee1737 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:26.682898 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737c1db3-b026-4abe-8ee8-bf26dcdd3d6f None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:26.686731 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 92/174] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jul 4 09:04:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:04:26.698881 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda44673-9263-4dc8-bc8c-a155c7ee1737 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:26.730860 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:26.765217 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a6718-b474-4d40-825f-2da1305489f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:26.766528 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a6718-b474-4d40-825f-2da1305489f9 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:26.767103 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a6718-b474-4d40-825f-2da1305489f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:26.767575 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a6718-b474-4d40-825f-2da1305489f9 None admin] PATH_INFO: `/v3/projects/dc815f286d5a4fccb6f44401eb037eb6` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:26.772591 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4a6718-b474-4d40-825f-2da1305489f9 None admin] RBAC: Authorizing `identity:get_project(project_id=dc815f286d5a4fccb6f44401eb037eb6)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:26.774409 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4a6718-b474-4d40-825f-2da1305489f9 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:26.776734 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 83/175] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jul 4 09:04:26 2022] GET /identity/v3/projects/dc815f286d5a4fccb6f44401eb037eb6 => generated 312 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:04:26.778264 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3272355a-76c9-46da-a2af-49e15a63ac87 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:26.778766 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3272355a-76c9-46da-a2af-49e15a63ac87 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:26.779235 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3272355a-76c9-46da-a2af-49e15a63ac87 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:26.788242 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 84/176] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:04:26 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:04:26.789369 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3272355a-76c9-46da-a2af-49e15a63ac87 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:26.826126 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda44673-9263-4dc8-bc8c-a155c7ee1737 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:26.862612 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682e0de6-aa5f-4120-a9a3-6059a52b9e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:26.863448 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e0de6-aa5f-4120-a9a3-6059a52b9e69 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:26.863702 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e0de6-aa5f-4120-a9a3-6059a52b9e69 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:26.864033 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e0de6-aa5f-4120-a9a3-6059a52b9e69 None admin] PATH_INFO: `/v3/users/cbeb03f2771e4aac8c0ee7d37e9ad2e0` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:26.865234 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682e0de6-aa5f-4120-a9a3-6059a52b9e69 None admin] RBAC: Authorizing `identity:get_user(user_id=cbeb03f2771e4aac8c0ee7d37e9ad2e0)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:26.867318 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682e0de6-aa5f-4120-a9a3-6059a52b9e69 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:26.868747 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 93/177] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Jul 4 09:04:26 2022] GET /identity/v3/users/cbeb03f2771e4aac8c0ee7d37e9ad2e0 => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:04:26.869737 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e175371b-6000-473f-afe0-c212ae25f1b7 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:26.870025 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e175371b-6000-473f-afe0-c212ae25f1b7 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:26.870305 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e175371b-6000-473f-afe0-c212ae25f1b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:26.898723 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-e175371b-6000-473f-afe0-c212ae25f1b7 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:04:26.900342 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-e175371b-6000-473f-afe0-c212ae25f1b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:04:26.901357 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3272355a-76c9-46da-a2af-49e15a63ac87 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:26.938049 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235b2096-2f4d-4624-9945-e8cec508fa21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:26.939034 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b2096-2f4d-4624-9945-e8cec508fa21 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:26.939469 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b2096-2f4d-4624-9945-e8cec508fa21 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:26.939958 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b2096-2f4d-4624-9945-e8cec508fa21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:26.941071 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235b2096-2f4d-4624-9945-e8cec508fa21 None admin] RBAC: Adding query filter params (role.id=81634e7812344f84afcb29b0dba2687c, scope.project.id=dc815f286d5a4fccb6f44401eb037eb6, user.id=cbeb03f2771e4aac8c0ee7d37e9ad2e0) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:04:26.941632 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235b2096-2f4d-4624-9945-e8cec508fa21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:26.943345 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235b2096-2f4d-4624-9945-e8cec508fa21 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:26.950007 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 85/178] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Jul 4 09:04:26 2022] GET /identity/v3/role_assignments?user.id=cbeb03f2771e4aac8c0ee7d37e9ad2e0&scope.project.id=dc815f286d5a4fccb6f44401eb037eb6&role.id=81634e7812344f84afcb29b0dba2687c => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:26.951516 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ac45c-8fc5-4ba5-b79c-15ab93622875 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:26.952026 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ac45c-8fc5-4ba5-b79c-15ab93622875 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:26.952566 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ac45c-8fc5-4ba5-b79c-15ab93622875 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:26.954077 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 86/179] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:04:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:04:26.955070 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0ac45c-8fc5-4ba5-b79c-15ab93622875 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:26.964664 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:26.977545 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 94/180] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:04:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:04:26.979078 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6689afcb-bbc3-48e3-9c0a-5c194cb29a99 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:26.979569 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6689afcb-bbc3-48e3-9c0a-5c194cb29a99 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:26.980066 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6689afcb-bbc3-48e3-9c0a-5c194cb29a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:26.998522 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-6689afcb-bbc3-48e3-9c0a-5c194cb29a99 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:04:27.000155 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-6689afcb-bbc3-48e3-9c0a-5c194cb29a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:04:27.013405 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:27.079697 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 95/181] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:04:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:04:27.081293 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6689afcb-bbc3-48e3-9c0a-5c194cb29a99 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:27.092419 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0ac45c-8fc5-4ba5-b79c-15ab93622875 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:27.131388 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e725ebcf-d094-43f7-924d-0c8fe58ad708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:27.132061 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e725ebcf-d094-43f7-924d-0c8fe58ad708 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:27.132387 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e725ebcf-d094-43f7-924d-0c8fe58ad708 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:27.132718 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e725ebcf-d094-43f7-924d-0c8fe58ad708 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:27.200287 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6689afcb-bbc3-48e3-9c0a-5c194cb29a99 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:27.208115 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e725ebcf-d094-43f7-924d-0c8fe58ad708 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:27.209718 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e725ebcf-d094-43f7-924d-0c8fe58ad708 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:27.219080 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:27.245191 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c36dc3-57fa-4221-a9a5-6d8c9a87a724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:27.246016 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c36dc3-57fa-4221-a9a5-6d8c9a87a724 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:27.246308 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c36dc3-57fa-4221-a9a5-6d8c9a87a724 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:27.246584 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c36dc3-57fa-4221-a9a5-6d8c9a87a724 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:27.258084 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c36dc3-57fa-4221-a9a5-6d8c9a87a724 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:04:27.267275 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-c4c36dc3-57fa-4221-a9a5-6d8c9a87a724 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 09:04:27.267275 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:04:27.267275 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:04:27.267275 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:04:27.267275 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:04:27.267275 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:04:27.267275 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:04:27.267275 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:04:27.267275 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:04:27.267275 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:04:27.267275 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:04:27.267275 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:04:27.267275 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:04:27.267275 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:04:27.267275 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:04:27.267275 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:04:27.268195 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:04:27.268195 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:04:27.268195 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:04:27.268195 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:04:27.268195 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:04:27.268195 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:04:27.268195 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:04:27.268195 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:04:27.268195 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:04:27.268195 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:04:27.268195 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:04:27.268195 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:04:27.268195 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:04:27.268195 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:04:27.268195 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:04:27.268195 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:04:27.269018 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:04:27.269018 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:04:27.269018 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:04:27.269018 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:04:27.269018 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:04:27.269018 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:04:27.269018 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:04:27.269018 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:04:27.269018 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:04:27.269018 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:04:27.269018 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 09:04:27.269018 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:04:27.269018 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 96/182] 10.222.0.42 () {56 vars in 1114 bytes} [Mon Jul 4 09:04:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:04:27.269660 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c36dc3-57fa-4221-a9a5-6d8c9a87a724 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:27.279124 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:27.324152 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 87/183] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jul 4 09:04:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:04:27.325818 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e4020c-40ae-4c5d-a565-2180e8419021 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:27.326105 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e4020c-40ae-4c5d-a565-2180e8419021 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:27.326382 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e4020c-40ae-4c5d-a565-2180e8419021 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:27.327660 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 88/184] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:04:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:04:27.328878 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d2eb3-3869-4f59-8f95-18120e5731ac None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:27.329160 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d2eb3-3869-4f59-8f95-18120e5731ac None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:27.329458 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d2eb3-3869-4f59-8f95-18120e5731ac None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:27.330668 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 89/185] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:04:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:04:27.331359 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66d2eb3-3869-4f59-8f95-18120e5731ac None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:27.388603 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c36dc3-57fa-4221-a9a5-6d8c9a87a724 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:27.422110 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2b97db-9d67-438f-91c0-d4097dae9d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:27.422900 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b97db-9d67-438f-91c0-d4097dae9d8a None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:27.423185 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b97db-9d67-438f-91c0-d4097dae9d8a None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:27.423460 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b97db-9d67-438f-91c0-d4097dae9d8a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:27.430676 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66d2eb3-3869-4f59-8f95-18120e5731ac None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:27.433996 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2b97db-9d67-438f-91c0-d4097dae9d8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:04:27.438072 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:27.442271 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-ac2b97db-9d67-438f-91c0-d4097dae9d8a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:04:27.442271 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:04:27.442271 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:04:27.442271 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:04:27.442271 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:04:27.442271 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:04:27.442271 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:04:27.442271 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:04:27.442271 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:04:27.442271 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:04:27.442271 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:04:27.442271 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:04:27.442271 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:04:27.442271 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:04:27.442271 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:04:27.442271 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:04:27.443313 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:04:27.443313 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:04:27.443313 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:04:27.443313 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:04:27.443313 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:04:27.443313 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:04:27.443313 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:04:27.443313 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:04:27.443313 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:04:27.443313 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:04:27.443313 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:04:27.443313 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:04:27.443313 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:04:27.443313 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:04:27.443313 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:04:27.443313 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:04:27.444393 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:04:27.444393 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:04:27.444393 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:04:27.444393 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:04:27.444393 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:04:27.444393 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:04:27.444393 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:04:27.444393 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:04:27.444393 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:04:27.444393 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:04:27.444393 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:04:27.444393 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:04:27.444393 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 97/186] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Jul 4 09:04:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:04:27.445127 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe6c6fb-fef6-4b59-b233-c8a2852da8e7 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:27.445127 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe6c6fb-fef6-4b59-b233-c8a2852da8e7 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:27.445254 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe6c6fb-fef6-4b59-b233-c8a2852da8e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:27.462200 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-5fe6c6fb-fef6-4b59-b233-c8a2852da8e7 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:04:27.463374 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-5fe6c6fb-fef6-4b59-b233-c8a2852da8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:04:27.468029 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6db8d8-4300-420e-8a5d-d4476e5b8de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:27.468742 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6db8d8-4300-420e-8a5d-d4476e5b8de2 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:27.469024 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6db8d8-4300-420e-8a5d-d4476e5b8de2 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:27.469303 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6db8d8-4300-420e-8a5d-d4476e5b8de2 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:27.470050 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6db8d8-4300-420e-8a5d-d4476e5b8de2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:04:27.470357 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6db8d8-4300-420e-8a5d-d4476e5b8de2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:27.471752 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6db8d8-4300-420e-8a5d-d4476e5b8de2 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:27.479831 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 90/187] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jul 4 09:04:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:27.480630 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6db8d8-4300-420e-8a5d-d4476e5b8de2 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:27.525768 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:27.533323 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 98/188] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:04:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:04:27.537155 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d859b13e-943b-4fa6-90ab-622ed1953b33 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:27.537606 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d859b13e-943b-4fa6-90ab-622ed1953b33 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:27.537881 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d859b13e-943b-4fa6-90ab-622ed1953b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:27.553323 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-d859b13e-943b-4fa6-90ab-622ed1953b33 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:04:27.554465 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-d859b13e-943b-4fa6-90ab-622ed1953b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:04:27.579221 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6db8d8-4300-420e-8a5d-d4476e5b8de2 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:27.612313 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5818d5-7cd9-4ec9-b3ca-463bd9db9028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:27.613183 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5818d5-7cd9-4ec9-b3ca-463bd9db9028 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:27.613546 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5818d5-7cd9-4ec9-b3ca-463bd9db9028 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:27.613832 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5818d5-7cd9-4ec9-b3ca-463bd9db9028 None admin] PATH_INFO: `/v3/projects/4dd04e5b7dd24f0e8050b45d6060f68c` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:27.615042 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5818d5-7cd9-4ec9-b3ca-463bd9db9028 None admin] RBAC: Authorizing `identity:get_project(project_id=4dd04e5b7dd24f0e8050b45d6060f68c)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:27.616572 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5818d5-7cd9-4ec9-b3ca-463bd9db9028 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:27.618302 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 91/189] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jul 4 09:04:27 2022] GET /identity/v3/projects/4dd04e5b7dd24f0e8050b45d6060f68c => generated 298 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:27.619067 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5818d5-7cd9-4ec9-b3ca-463bd9db9028 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:27.624406 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 99/190] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:04:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:04:27.626077 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d859b13e-943b-4fa6-90ab-622ed1953b33 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:27.659139 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:27.721135 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5818d5-7cd9-4ec9-b3ca-463bd9db9028 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:27.724311 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d859b13e-943b-4fa6-90ab-622ed1953b33 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:27.749806 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:27.755947 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05fa49-6df2-4448-b529-dccc32538836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:27.756621 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05fa49-6df2-4448-b529-dccc32538836 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:27.756906 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05fa49-6df2-4448-b529-dccc32538836 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:27.757185 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05fa49-6df2-4448-b529-dccc32538836 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:27.757945 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc05fa49-6df2-4448-b529-dccc32538836 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:04:27.758253 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc05fa49-6df2-4448-b529-dccc32538836 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:27.758693 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37765536-6c52-4487-a197-bd95c8a1a236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:27.759559 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37765536-6c52-4487-a197-bd95c8a1a236 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:27.759645 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc05fa49-6df2-4448-b529-dccc32538836 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:27.759834 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37765536-6c52-4487-a197-bd95c8a1a236 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:27.760132 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37765536-6c52-4487-a197-bd95c8a1a236 None admin] PATH_INFO: `/v3/users/fa0144932d6e4ce58efa2a31699446cd` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:27.767809 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 92/191] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jul 4 09:04:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:27.772415 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05fa49-6df2-4448-b529-dccc32538836 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:27.777020 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37765536-6c52-4487-a197-bd95c8a1a236 None admin] RBAC: Authorizing `identity:get_user(user_id=fa0144932d6e4ce58efa2a31699446cd)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:27.778498 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37765536-6c52-4487-a197-bd95c8a1a236 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:27.780441 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 100/192] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Jul 4 09:04:27 2022] GET /identity/v3/users/fa0144932d6e4ce58efa2a31699446cd => generated 283 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:27.781161 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37765536-6c52-4487-a197-bd95c8a1a236 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:27.860796 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:27.864910 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05fa49-6df2-4448-b529-dccc32538836 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:27.876174 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37765536-6c52-4487-a197-bd95c8a1a236 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:27.900858 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434c9b3b-6fed-4f97-85a1-190319d78d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:27.901659 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c9b3b-6fed-4f97-85a1-190319d78d7b None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:27.902139 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c9b3b-6fed-4f97-85a1-190319d78d7b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:27.902241 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c9b3b-6fed-4f97-85a1-190319d78d7b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:27.903388 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434c9b3b-6fed-4f97-85a1-190319d78d7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:27.904891 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434c9b3b-6fed-4f97-85a1-190319d78d7b None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:27.906560 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 93/193] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:04:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:27.908735 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434c9b3b-6fed-4f97-85a1-190319d78d7b None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:27.910945 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba25779-2adc-40dc-ad36-e0323404783b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:27.911781 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba25779-2adc-40dc-ad36-e0323404783b None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:27.912092 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba25779-2adc-40dc-ad36-e0323404783b None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:27.912366 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba25779-2adc-40dc-ad36-e0323404783b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:27.913193 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba25779-2adc-40dc-ad36-e0323404783b None admin] RBAC: Adding query filter params (role.id=157d1a80161e43a3ad84446eeca98e0b, scope.project.id=4dd04e5b7dd24f0e8050b45d6060f68c, user.id=cbeb03f2771e4aac8c0ee7d37e9ad2e0) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:04:27.913502 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba25779-2adc-40dc-ad36-e0323404783b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:27.914947 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba25779-2adc-40dc-ad36-e0323404783b None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:27.920883 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 101/194] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Jul 4 09:04:27 2022] GET /identity/v3/role_assignments?user.id=cbeb03f2771e4aac8c0ee7d37e9ad2e0&scope.project.id=4dd04e5b7dd24f0e8050b45d6060f68c&role.id=157d1a80161e43a3ad84446eeca98e0b => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:27.921583 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba25779-2adc-40dc-ad36-e0323404783b None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:27.981615 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:28.020276 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434c9b3b-6fed-4f97-85a1-190319d78d7b None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:28.036823 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba25779-2adc-40dc-ad36-e0323404783b None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:28.058880 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5066e1e1-6261-4e4f-8dda-e9eae931f041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:28.059809 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066e1e1-6261-4e4f-8dda-e9eae931f041 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:28.060119 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066e1e1-6261-4e4f-8dda-e9eae931f041 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:28.060397 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066e1e1-6261-4e4f-8dda-e9eae931f041 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:28.072350 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5066e1e1-6261-4e4f-8dda-e9eae931f041 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:04:28.075055 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34b9306-d470-4ebe-8aa6-831a5e9cdcac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:28.075580 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b9306-d470-4ebe-8aa6-831a5e9cdcac None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:28.076488 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b9306-d470-4ebe-8aa6-831a5e9cdcac None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:28.076488 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b9306-d470-4ebe-8aa6-831a5e9cdcac None admin] PATH_INFO: `/v3/users/fa0144932d6e4ce58efa2a31699446cd` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:28.077524 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34b9306-d470-4ebe-8aa6-831a5e9cdcac None admin] RBAC: Authorizing `identity:get_user(user_id=fa0144932d6e4ce58efa2a31699446cd)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:28.079631 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34b9306-d470-4ebe-8aa6-831a5e9cdcac None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:28.080608 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-5066e1e1-6261-4e4f-8dda-e9eae931f041 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 09:04:28.080608 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:04:28.080608 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:04:28.080608 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:04:28.080608 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:04:28.080608 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:04:28.080608 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:04:28.080608 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:04:28.080608 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:04:28.080608 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:04:28.080608 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:04:28.080608 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:04:28.080608 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:04:28.080608 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:04:28.080608 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:04:28.080608 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:04:28.081495 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:04:28.081495 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:04:28.081495 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:04:28.081495 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:04:28.081495 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:04:28.081495 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:04:28.081495 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:04:28.081495 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:04:28.081495 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:04:28.081495 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:04:28.081495 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:04:28.081495 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:04:28.081495 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:04:28.081495 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:04:28.081495 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:04:28.081495 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:04:28.085599 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:04:28.085599 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:04:28.085599 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:04:28.085599 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:04:28.085599 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:04:28.085599 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:04:28.085599 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:04:28.085599 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:04:28.085599 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:04:28.085599 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:04:28.085599 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 09:04:28.085599 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:04:28.086525 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 102/195] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Jul 4 09:04:27 2022] GET /identity/v3/users/fa0144932d6e4ce58efa2a31699446cd => generated 283 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:28.086525 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34b9306-d470-4ebe-8aa6-831a5e9cdcac None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:28.086656 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 94/196] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jul 4 09:04:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:04:28.086656 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5066e1e1-6261-4e4f-8dda-e9eae931f041 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:28.114318 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:28.192575 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5066e1e1-6261-4e4f-8dda-e9eae931f041 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:28.195469 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34b9306-d470-4ebe-8aa6-831a5e9cdcac None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:28.211465 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:28.224888 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c85d68d-a268-4968-8485-7233a222de3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:28.225551 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c85d68d-a268-4968-8485-7233a222de3a None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:28.225828 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c85d68d-a268-4968-8485-7233a222de3a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:28.226105 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c85d68d-a268-4968-8485-7233a222de3a None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:28.226880 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c85d68d-a268-4968-8485-7233a222de3a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:28.228323 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c85d68d-a268-4968-8485-7233a222de3a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:28.230413 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f59472b-c531-4be5-ac93-1396f044f54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:28.231062 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59472b-c531-4be5-ac93-1396f044f54b None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:28.231342 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59472b-c531-4be5-ac93-1396f044f54b None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:28.231612 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59472b-c531-4be5-ac93-1396f044f54b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:28.247841 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 95/197] 10.222.0.42 () {60 vars in 1132 bytes} [Mon Jul 4 09:04:28 2022] POST /identity/v3/users => generated 297 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:04:28.252944 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c85d68d-a268-4968-8485-7233a222de3a None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:28.308771 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f59472b-c531-4be5-ac93-1396f044f54b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:28.310313 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f59472b-c531-4be5-ac93-1396f044f54b None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:28.351002 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:28.373259 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c85d68d-a268-4968-8485-7233a222de3a None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:28.418326 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4dd5ff-7554-44db-b129-892fa815cca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:28.419020 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4dd5ff-7554-44db-b129-892fa815cca2 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:28.419308 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4dd5ff-7554-44db-b129-892fa815cca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:28.419659 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4dd5ff-7554-44db-b129-892fa815cca2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:28.427093 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 103/198] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jul 4 09:04:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:04:28.428222 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f59472b-c531-4be5-ac93-1396f044f54b None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:28.448837 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:28.508925 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4dd5ff-7554-44db-b129-892fa815cca2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:28.510453 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4dd5ff-7554-44db-b129-892fa815cca2 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:28.553180 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f59472b-c531-4be5-ac93-1396f044f54b None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:28.596425 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0160caef-51c9-4446-b9b0-00c7c9a0f4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:28.598733 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0160caef-51c9-4446-b9b0-00c7c9a0f4da None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:28.598733 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0160caef-51c9-4446-b9b0-00c7c9a0f4da None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:28.598733 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0160caef-51c9-4446-b9b0-00c7c9a0f4da None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:28.598733 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0160caef-51c9-4446-b9b0-00c7c9a0f4da None admin] RBAC: Adding query filter params (name=reader) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:04:28.598733 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0160caef-51c9-4446-b9b0-00c7c9a0f4da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:28.600079 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0160caef-51c9-4446-b9b0-00c7c9a0f4da None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:28.612127 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:28.617125 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 104/199] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Jul 4 09:04:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:28.618307 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0160caef-51c9-4446-b9b0-00c7c9a0f4da None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:28.643030 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 96/200] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jul 4 09:04:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:04:28.644053 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4dd5ff-7554-44db-b129-892fa815cca2 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:28.713425 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:28.737627 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0160caef-51c9-4446-b9b0-00c7c9a0f4da None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:28.752548 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4dd5ff-7554-44db-b129-892fa815cca2 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:28.772017 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c4cbf3-875a-4625-ada1-8a2b9bffe5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:28.772967 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4cbf3-875a-4625-ada1-8a2b9bffe5c9 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:28.773254 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4cbf3-875a-4625-ada1-8a2b9bffe5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:28.773525 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4cbf3-875a-4625-ada1-8a2b9bffe5c9 None admin] PATH_INFO: `/v3/projects/f1e246896b7b4569b9cea667ca2e1386` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:28.774717 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c4cbf3-875a-4625-ada1-8a2b9bffe5c9 None admin] RBAC: Authorizing `identity:get_project(project_id=f1e246896b7b4569b9cea667ca2e1386)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:28.777017 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c4cbf3-875a-4625-ada1-8a2b9bffe5c9 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:28.780058 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 105/201] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jul 4 09:04:28 2022] GET /identity/v3/projects/f1e246896b7b4569b9cea667ca2e1386 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:28.780905 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c4cbf3-875a-4625-ada1-8a2b9bffe5c9 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:28.787577 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e45d07-f2dd-42e8-8fd1-ea6f0f836540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:28.788479 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e45d07-f2dd-42e8-8fd1-ea6f0f836540 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:28.788759 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e45d07-f2dd-42e8-8fd1-ea6f0f836540 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:28.789024 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e45d07-f2dd-42e8-8fd1-ea6f0f836540 None admin] PATH_INFO: `/v3/users/afc1d34c7c80418b81e9282d3853696f` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:28.790231 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e45d07-f2dd-42e8-8fd1-ea6f0f836540 None admin] RBAC: Authorizing `identity:get_user(user_id=afc1d34c7c80418b81e9282d3853696f)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:28.791705 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e45d07-f2dd-42e8-8fd1-ea6f0f836540 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:28.793394 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 97/202] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Jul 4 09:04:28 2022] GET /identity/v3/users/afc1d34c7c80418b81e9282d3853696f => generated 289 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:28.794160 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e45d07-f2dd-42e8-8fd1-ea6f0f836540 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:28.854594 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:28.901377 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c4cbf3-875a-4625-ada1-8a2b9bffe5c9 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:28.937825 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e45d07-f2dd-42e8-8fd1-ea6f0f836540 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:28.938360 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d01945-ebfd-42c7-a351-7dab412174df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:28.939106 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d01945-ebfd-42c7-a351-7dab412174df None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:28.939386 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d01945-ebfd-42c7-a351-7dab412174df None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:28.939660 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d01945-ebfd-42c7-a351-7dab412174df None admin] PATH_INFO: `/v3/projects/f1e246896b7b4569b9cea667ca2e1386` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:28.940993 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d01945-ebfd-42c7-a351-7dab412174df None admin] RBAC: Authorizing `identity:get_project(project_id=f1e246896b7b4569b9cea667ca2e1386)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:28.942648 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d01945-ebfd-42c7-a351-7dab412174df None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:28.944564 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 106/203] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jul 4 09:04:28 2022] GET /identity/v3/projects/f1e246896b7b4569b9cea667ca2e1386 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:28.945404 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d01945-ebfd-42c7-a351-7dab412174df None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:28.961965 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:28.988488 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4f8e81-38a4-458a-9760-3bdb9e7cfb85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:28.989061 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f8e81-38a4-458a-9760-3bdb9e7cfb85 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:28.991202 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f8e81-38a4-458a-9760-3bdb9e7cfb85 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:28.991377 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f8e81-38a4-458a-9760-3bdb9e7cfb85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:28.992222 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4f8e81-38a4-458a-9760-3bdb9e7cfb85 None admin] RBAC: Adding query filter params (role.id=157d1a80161e43a3ad84446eeca98e0b, scope.project.id=f1e246896b7b4569b9cea667ca2e1386, user.id=fa0144932d6e4ce58efa2a31699446cd) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:04:28.992541 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4f8e81-38a4-458a-9760-3bdb9e7cfb85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:28.994065 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4f8e81-38a4-458a-9760-3bdb9e7cfb85 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:29.000370 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 98/204] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Jul 4 09:04:28 2022] GET /identity/v3/role_assignments?user.id=fa0144932d6e4ce58efa2a31699446cd&scope.project.id=f1e246896b7b4569b9cea667ca2e1386&role.id=157d1a80161e43a3ad84446eeca98e0b => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:29.001187 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4f8e81-38a4-458a-9760-3bdb9e7cfb85 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:29.094278 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d01945-ebfd-42c7-a351-7dab412174df None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:29.171858 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374474f2-5e7a-4f18-973b-398e9566251f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:29.173054 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374474f2-5e7a-4f18-973b-398e9566251f None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:29.173534 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374474f2-5e7a-4f18-973b-398e9566251f None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:29.174017 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374474f2-5e7a-4f18-973b-398e9566251f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:29.198757 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4f8e81-38a4-458a-9760-3bdb9e7cfb85 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:29.215175 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:29.244988 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70247c2-53b7-4d60-b273-d57a7f4b5630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:29.245564 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70247c2-53b7-4d60-b273-d57a7f4b5630 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:29.245833 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70247c2-53b7-4d60-b273-d57a7f4b5630 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:29.246100 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70247c2-53b7-4d60-b273-d57a7f4b5630 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:29.246937 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70247c2-53b7-4d60-b273-d57a7f4b5630 None admin] RBAC: Adding query filter params (role.id=965049e7ce6144aaad23c15f3a5e37c3, scope.project.id=f1e246896b7b4569b9cea667ca2e1386, user.id=fa0144932d6e4ce58efa2a31699446cd) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:04:29.247243 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70247c2-53b7-4d60-b273-d57a7f4b5630 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:29.248799 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70247c2-53b7-4d60-b273-d57a7f4b5630 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:29.264704 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 99/205] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Jul 4 09:04:29 2022] GET /identity/v3/role_assignments?user.id=fa0144932d6e4ce58efa2a31699446cd&scope.project.id=f1e246896b7b4569b9cea667ca2e1386&role.id=965049e7ce6144aaad23c15f3a5e37c3 => generated 259 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:29.267497 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374474f2-5e7a-4f18-973b-398e9566251f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:29.269087 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374474f2-5e7a-4f18-973b-398e9566251f None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:29.286226 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:29.378983 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 107/206] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jul 4 09:04:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:04:29.385011 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70247c2-53b7-4d60-b273-d57a7f4b5630 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:29.519777 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70247c2-53b7-4d60-b273-d57a7f4b5630 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:29.586200 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fb1c4f-3461-4034-85c7-b8faa2178082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:29.587471 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb1c4f-3461-4034-85c7-b8faa2178082 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:29.588002 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb1c4f-3461-4034-85c7-b8faa2178082 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:29.588504 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb1c4f-3461-4034-85c7-b8faa2178082 None admin] PATH_INFO: `/v3/projects/4dd04e5b7dd24f0e8050b45d6060f68c` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:29.589958 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fb1c4f-3461-4034-85c7-b8faa2178082 None admin] RBAC: Authorizing `identity:get_project(project_id=4dd04e5b7dd24f0e8050b45d6060f68c)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:29.591730 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fb1c4f-3461-4034-85c7-b8faa2178082 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:29.594178 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 100/207] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jul 4 09:04:29 2022] GET /identity/v3/projects/4dd04e5b7dd24f0e8050b45d6060f68c => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:29.605030 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374474f2-5e7a-4f18-973b-398e9566251f None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:29.722875 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374474f2-5e7a-4f18-973b-398e9566251f None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:29.737984 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:29.763917 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f1585b-0fdc-445f-ae3f-306b27e85e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:29.764580 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f1585b-0fdc-445f-ae3f-306b27e85e8a None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:29.764859 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f1585b-0fdc-445f-ae3f-306b27e85e8a None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:29.765131 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f1585b-0fdc-445f-ae3f-306b27e85e8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:29.766015 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f1585b-0fdc-445f-ae3f-306b27e85e8a None admin] RBAC: Adding query filter params (role.id=a5112c31cfa1478db60e6079627603f6, scope.project.id=4dd04e5b7dd24f0e8050b45d6060f68c, user.id=afc1d34c7c80418b81e9282d3853696f) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:04:29.766325 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f1585b-0fdc-445f-ae3f-306b27e85e8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:29.767781 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f1585b-0fdc-445f-ae3f-306b27e85e8a None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:29.773762 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 108/208] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Jul 4 09:04:29 2022] GET /identity/v3/role_assignments?user.id=afc1d34c7c80418b81e9282d3853696f&scope.project.id=4dd04e5b7dd24f0e8050b45d6060f68c&role.id=a5112c31cfa1478db60e6079627603f6 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:30.573278 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65538b3-b9cc-44ed-b802-ee3f9130e058 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:30.573792 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65538b3-b9cc-44ed-b802-ee3f9130e058 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:30.573866 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65538b3-b9cc-44ed-b802-ee3f9130e058 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:30.575646 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 101/209] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:04:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:04:30.580813 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452fcc6-0211-49b0-8d53-f74d0e76331a None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:30.581096 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452fcc6-0211-49b0-8d53-f74d0e76331a None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:30.581425 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452fcc6-0211-49b0-8d53-f74d0e76331a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:30.599029 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-0452fcc6-0211-49b0-8d53-f74d0e76331a None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:04:30.600249 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-0452fcc6-0211-49b0-8d53-f74d0e76331a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:04:30.668064 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 109/210] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:04:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:04:30.690589 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65538b3-b9cc-44ed-b802-ee3f9130e058 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:30.713360 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f210b-2576-461b-b039-0f6ec68e376a None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:30.713961 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f210b-2576-461b-b039-0f6ec68e376a None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:30.714451 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f210b-2576-461b-b039-0f6ec68e376a None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:30.716044 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 110/211] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:04:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:04:30.721566 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac6f31-bb38-473b-8cdf-e0af5f7a3c6a None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:30.722384 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac6f31-bb38-473b-8cdf-e0af5f7a3c6a None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:30.722991 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac6f31-bb38-473b-8cdf-e0af5f7a3c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:30.742927 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-f3ac6f31-bb38-473b-8cdf-e0af5f7a3c6a None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:04:30.743527 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:30.745399 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-f3ac6f31-bb38-473b-8cdf-e0af5f7a3c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:04:30.802414 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65538b3-b9cc-44ed-b802-ee3f9130e058 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:30.826645 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 111/212] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:04:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:04:30.839099 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de45712d-6719-4533-b876-ea98634db80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:30.840171 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45712d-6719-4533-b876-ea98634db80c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:30.840641 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45712d-6719-4533-b876-ea98634db80c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:30.841082 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45712d-6719-4533-b876-ea98634db80c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:30.851975 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de45712d-6719-4533-b876-ea98634db80c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:04:30.852849 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ac6f31-bb38-473b-8cdf-e0af5f7a3c6a None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:30.861715 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-de45712d-6719-4533-b876-ea98634db80c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:04:30.861715 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:04:30.861715 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:04:30.861715 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:04:30.861715 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:04:30.861715 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:04:30.861715 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:04:30.861715 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:04:30.861715 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:04:30.861715 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:04:30.861715 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:04:30.861715 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:04:30.861715 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:04:30.861715 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:04:30.861715 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:04:30.861715 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:04:30.862593 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:04:30.862593 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:04:30.862593 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:04:30.862593 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:04:30.862593 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:04:30.862593 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:04:30.862593 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:04:30.862593 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:04:30.862593 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:04:30.862593 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:04:30.862593 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:04:30.862593 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:04:30.862593 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:04:30.862593 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:04:30.862593 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:04:30.862593 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:04:30.863397 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:04:30.863397 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:04:30.863397 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:04:30.863397 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:04:30.863397 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:04:30.863397 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:04:30.863397 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:04:30.863397 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:04:30.863397 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:04:30.863397 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:04:30.863397 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:04:30.863397 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:04:30.865398 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 102/213] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jul 4 09:04:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:04:30.872519 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de45712d-6719-4533-b876-ea98634db80c None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:30.920827 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:30.986254 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de45712d-6719-4533-b876-ea98634db80c None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:30.993467 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ac6f31-bb38-473b-8cdf-e0af5f7a3c6a None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:30.995681 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:31.029759 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e755ef5-6c0e-40ca-8cb2-c57d23c6a938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:31.030427 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e755ef5-6c0e-40ca-8cb2-c57d23c6a938 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:31.030705 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e755ef5-6c0e-40ca-8cb2-c57d23c6a938 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:31.030974 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e755ef5-6c0e-40ca-8cb2-c57d23c6a938 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:31.031763 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e755ef5-6c0e-40ca-8cb2-c57d23c6a938 None admin] RBAC: Adding query filter params (name=member) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:04:31.032110 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e755ef5-6c0e-40ca-8cb2-c57d23c6a938 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:31.033207 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460f7d45-874c-4d45-a257-08145faf8200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:31.033489 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e755ef5-6c0e-40ca-8cb2-c57d23c6a938 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:31.034390 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f7d45-874c-4d45-a257-08145faf8200 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:31.034937 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f7d45-874c-4d45-a257-08145faf8200 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:31.035381 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f7d45-874c-4d45-a257-08145faf8200 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:31.036876 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460f7d45-874c-4d45-a257-08145faf8200 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:31.038661 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460f7d45-874c-4d45-a257-08145faf8200 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:31.040574 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 112/214] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:04:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:04:31.046937 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 103/215] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Jul 4 09:04:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:04:31.047910 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e755ef5-6c0e-40ca-8cb2-c57d23c6a938 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:31.051084 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460f7d45-874c-4d45-a257-08145faf8200 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:31.159296 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460f7d45-874c-4d45-a257-08145faf8200 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:31.168153 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:31.183915 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e755ef5-6c0e-40ca-8cb2-c57d23c6a938 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:31.198895 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdeb7ef-91e8-47a6-9e65-1476bb672b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:31.199617 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdeb7ef-91e8-47a6-9e65-1476bb672b98 None admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:31.199979 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdeb7ef-91e8-47a6-9e65-1476bb672b98 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:31.200252 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdeb7ef-91e8-47a6-9e65-1476bb672b98 None admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:31.201051 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdeb7ef-91e8-47a6-9e65-1476bb672b98 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:31.202620 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdeb7ef-91e8-47a6-9e65-1476bb672b98 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:31.226650 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e3d3e-e69a-4c00-a858-227a3d2c409e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:31.227904 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e3d3e-e69a-4c00-a858-227a3d2c409e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:31.228378 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e3d3e-e69a-4c00-a858-227a3d2c409e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:31.228494 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 113/216] 10.222.0.42 () {60 vars in 1132 bytes} [Mon Jul 4 09:04:31 2022] POST /identity/v3/users => generated 297 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:04:31.229013 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e3d3e-e69a-4c00-a858-227a3d2c409e None admin] PATH_INFO: `/v3/users/f26ad617d9a7448ba7c3b3a9796bbba6` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:31.248110 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7e3d3e-e69a-4c00-a858-227a3d2c409e None admin] RBAC: Authorizing `identity:get_user(user_id=f26ad617d9a7448ba7c3b3a9796bbba6)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:31.250078 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7e3d3e-e69a-4c00-a858-227a3d2c409e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:31.252713 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 104/217] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Jul 4 09:04:31 2022] GET /identity/v3/users/f26ad617d9a7448ba7c3b3a9796bbba6 => generated 297 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:04:31.261351 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdeb7ef-91e8-47a6-9e65-1476bb672b98 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:31.288352 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2fd8f4-745a-4e02-8caa-037229399ab8 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:31.288998 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2fd8f4-745a-4e02-8caa-037229399ab8 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:31.289495 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2fd8f4-745a-4e02-8caa-037229399ab8 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:31.291326 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 105/218] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:04:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:04:31.298043 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680aa154-9f2a-49c5-a800-1692a0fd2827 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:31.298654 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680aa154-9f2a-49c5-a800-1692a0fd2827 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:31.299166 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680aa154-9f2a-49c5-a800-1692a0fd2827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:31.319436 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-680aa154-9f2a-49c5-a800-1692a0fd2827 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:04:31.321045 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-680aa154-9f2a-49c5-a800-1692a0fd2827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:04:31.346584 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:31.388606 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdeb7ef-91e8-47a6-9e65-1476bb672b98 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:31.411266 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 106/219] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:04:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 09:04:31.429604 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680aa154-9f2a-49c5-a800-1692a0fd2827 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:31.435913 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f134f747-48e4-46a7-8ff5-c8c8529803a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:31.436845 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f134f747-48e4-46a7-8ff5-c8c8529803a0 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:31.437405 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f134f747-48e4-46a7-8ff5-c8c8529803a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:31.437900 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f134f747-48e4-46a7-8ff5-c8c8529803a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:31.478599 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:31.528668 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f134f747-48e4-46a7-8ff5-c8c8529803a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:31.530535 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f134f747-48e4-46a7-8ff5-c8c8529803a0 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:31.560856 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680aa154-9f2a-49c5-a800-1692a0fd2827 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:31.605383 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa44258-15cb-433e-bb66-5272a5521afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:31.606198 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa44258-15cb-433e-bb66-5272a5521afe None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:31.606479 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa44258-15cb-433e-bb66-5272a5521afe None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:31.606751 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa44258-15cb-433e-bb66-5272a5521afe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:31.622344 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa44258-15cb-433e-bb66-5272a5521afe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:04:31.632334 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-9fa44258-15cb-433e-bb66-5272a5521afe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 09:04:31.632334 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:04:31.632334 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:04:31.632334 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:04:31.632334 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:04:31.632334 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:04:31.632334 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:04:31.632334 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:04:31.632334 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:04:31.632334 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:04:31.632334 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:04:31.632334 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:04:31.632334 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:04:31.632334 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:04:31.632334 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:04:31.632334 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:04:31.633258 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:04:31.633258 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:04:31.633258 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:04:31.633258 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:04:31.633258 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:04:31.633258 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:04:31.633258 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:04:31.633258 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:04:31.633258 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:04:31.633258 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:04:31.633258 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:04:31.633258 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:04:31.633258 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:04:31.633258 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:04:31.633258 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:04:31.633258 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:04:31.634049 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:04:31.634049 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:04:31.634049 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:04:31.634049 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:04:31.634049 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:04:31.634049 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:04:31.634049 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:04:31.634049 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:04:31.634049 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:04:31.634049 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:04:31.634049 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 09:04:31.634049 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:04:31.635509 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 107/220] 10.222.0.42 () {56 vars in 1114 bytes} [Mon Jul 4 09:04:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:04:31.637342 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e8908-bd12-44e5-9d0e-f34a34a661ed None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:31.637622 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e8908-bd12-44e5-9d0e-f34a34a661ed None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:31.637900 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e8908-bd12-44e5-9d0e-f34a34a661ed None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:31.639259 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 108/221] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:04:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:04:31.639996 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5e8908-bd12-44e5-9d0e-f34a34a661ed None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:31.651172 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 114/222] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jul 4 09:04:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:04:31.653259 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c4ea3d-63d6-4b9a-9fec-7b60a7f0eafc None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:31.654101 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c4ea3d-63d6-4b9a-9fec-7b60a7f0eafc None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:31.654562 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c4ea3d-63d6-4b9a-9fec-7b60a7f0eafc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:31.672266 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:31.675754 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-a7c4ea3d-63d6-4b9a-9fec-7b60a7f0eafc None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:04:31.677570 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-a7c4ea3d-63d6-4b9a-9fec-7b60a7f0eafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:04:31.737775 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:31.750072 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 115/223] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:04:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:04:31.751221 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c4ea3d-63d6-4b9a-9fec-7b60a7f0eafc None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:31.774529 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5e8908-bd12-44e5-9d0e-f34a34a661ed None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:31.823154 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce7909-4cf9-4f62-911c-60a11f5db4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:31.824111 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce7909-4cf9-4f62-911c-60a11f5db4f3 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:31.824394 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce7909-4cf9-4f62-911c-60a11f5db4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:31.824668 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce7909-4cf9-4f62-911c-60a11f5db4f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:31.825429 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bce7909-4cf9-4f62-911c-60a11f5db4f3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:04:31.825738 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bce7909-4cf9-4f62-911c-60a11f5db4f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:31.827144 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bce7909-4cf9-4f62-911c-60a11f5db4f3 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:31.839987 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 109/224] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jul 4 09:04:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:31.841556 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce7909-4cf9-4f62-911c-60a11f5db4f3 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:31.871696 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c4ea3d-63d6-4b9a-9fec-7b60a7f0eafc None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:31.913421 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212dbc42-5230-467d-b897-5018006e861e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:31.914750 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212dbc42-5230-467d-b897-5018006e861e None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:31.915279 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212dbc42-5230-467d-b897-5018006e861e None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:31.915751 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212dbc42-5230-467d-b897-5018006e861e None admin] PATH_INFO: `/v3/projects/f1e246896b7b4569b9cea667ca2e1386` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:31.917264 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212dbc42-5230-467d-b897-5018006e861e None admin] RBAC: Authorizing `identity:get_project(project_id=f1e246896b7b4569b9cea667ca2e1386)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:31.919040 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212dbc42-5230-467d-b897-5018006e861e None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:31.921197 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 116/225] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jul 4 09:04:31 2022] GET /identity/v3/projects/f1e246896b7b4569b9cea667ca2e1386 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:31.922236 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212dbc42-5230-467d-b897-5018006e861e None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:31.953011 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:31.983486 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce7909-4cf9-4f62-911c-60a11f5db4f3 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:31.992681 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:32.027655 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b800b713-7dca-489c-96a6-cfc373017782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:32.028493 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b800b713-7dca-489c-96a6-cfc373017782 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:32.028777 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b800b713-7dca-489c-96a6-cfc373017782 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:32.029279 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b800b713-7dca-489c-96a6-cfc373017782 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:32.039778 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212dbc42-5230-467d-b897-5018006e861e None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:32.043157 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b800b713-7dca-489c-96a6-cfc373017782 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:04:32.052023 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-b800b713-7dca-489c-96a6-cfc373017782 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:04:32.052023 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:04:32.052023 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:04:32.052023 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:04:32.052023 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:04:32.052023 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:04:32.052023 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:04:32.052023 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:04:32.052023 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:04:32.052023 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:04:32.052023 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:04:32.052023 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:04:32.052023 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:04:32.052023 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:04:32.052023 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:04:32.052023 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:04:32.052931 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:04:32.052931 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:04:32.052931 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:04:32.052931 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:04:32.052931 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:04:32.052931 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:04:32.052931 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:04:32.052931 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:04:32.052931 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:04:32.052931 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:04:32.052931 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:04:32.052931 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:04:32.052931 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:04:32.052931 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:04:32.052931 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:04:32.052931 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:04:32.053743 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:04:32.053743 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:04:32.053743 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:04:32.053743 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:04:32.053743 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:04:32.053743 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:04:32.053743 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:04:32.053743 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:04:32.053743 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:04:32.053743 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:04:32.053743 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:04:32.053743 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:04:32.053743 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 110/226] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Jul 4 09:04:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:04:32.055002 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b800b713-7dca-489c-96a6-cfc373017782 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:32.080899 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe234e98-3cc4-408b-8932-e1dc33bc0886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:32.082147 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe234e98-3cc4-408b-8932-e1dc33bc0886 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:32.082746 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe234e98-3cc4-408b-8932-e1dc33bc0886 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:32.083117 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe234e98-3cc4-408b-8932-e1dc33bc0886 None admin] PATH_INFO: `/v3/users/fa0144932d6e4ce58efa2a31699446cd` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:32.084540 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe234e98-3cc4-408b-8932-e1dc33bc0886 None admin] RBAC: Authorizing `identity:get_user(user_id=fa0144932d6e4ce58efa2a31699446cd)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:32.086339 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe234e98-3cc4-408b-8932-e1dc33bc0886 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:32.088133 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 117/227] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Jul 4 09:04:31 2022] GET /identity/v3/users/fa0144932d6e4ce58efa2a31699446cd => generated 283 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:32.093613 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe234e98-3cc4-408b-8932-e1dc33bc0886 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:32.177324 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b800b713-7dca-489c-96a6-cfc373017782 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:32.209811 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe234e98-3cc4-408b-8932-e1dc33bc0886 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:32.213115 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aaba70-1b1a-48a8-a4f2-7c73bf98a8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:32.213945 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aaba70-1b1a-48a8-a4f2-7c73bf98a8da None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:32.214373 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aaba70-1b1a-48a8-a4f2-7c73bf98a8da None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:32.214787 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aaba70-1b1a-48a8-a4f2-7c73bf98a8da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:32.215791 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aaba70-1b1a-48a8-a4f2-7c73bf98a8da None admin] RBAC: Adding query filter params (role.id=81634e7812344f84afcb29b0dba2687c, scope.project.id=f1e246896b7b4569b9cea667ca2e1386, user.id=f26ad617d9a7448ba7c3b3a9796bbba6) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:04:32.216265 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aaba70-1b1a-48a8-a4f2-7c73bf98a8da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:32.217874 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aaba70-1b1a-48a8-a4f2-7c73bf98a8da None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:32.224671 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 111/228] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Jul 4 09:04:32 2022] GET /identity/v3/role_assignments?user.id=f26ad617d9a7448ba7c3b3a9796bbba6&scope.project.id=f1e246896b7b4569b9cea667ca2e1386&role.id=81634e7812344f84afcb29b0dba2687c => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:32.225676 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aaba70-1b1a-48a8-a4f2-7c73bf98a8da None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:32.228799 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:32.244638 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:32.254392 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b6b34-c321-4b46-a11c-f71efa6820d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:32.255240 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b6b34-c321-4b46-a11c-f71efa6820d4 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:32.255939 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b6b34-c321-4b46-a11c-f71efa6820d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:32.256323 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b6b34-c321-4b46-a11c-f71efa6820d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:32.257352 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386b6b34-c321-4b46-a11c-f71efa6820d4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:04:32.257766 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386b6b34-c321-4b46-a11c-f71efa6820d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:32.259439 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386b6b34-c321-4b46-a11c-f71efa6820d4 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:32.277120 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 118/229] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jul 4 09:04:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:32.284418 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b6b34-c321-4b46-a11c-f71efa6820d4 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:32.346248 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aaba70-1b1a-48a8-a4f2-7c73bf98a8da None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:32.383619 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec6f116-f394-45c3-a97c-e12e6e949c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:32.384798 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec6f116-f394-45c3-a97c-e12e6e949c2e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:32.385225 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec6f116-f394-45c3-a97c-e12e6e949c2e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:32.385672 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec6f116-f394-45c3-a97c-e12e6e949c2e None admin] PATH_INFO: `/v3/projects/f1e246896b7b4569b9cea667ca2e1386` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:32.387215 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec6f116-f394-45c3-a97c-e12e6e949c2e None admin] RBAC: Authorizing `identity:get_project(project_id=f1e246896b7b4569b9cea667ca2e1386)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:32.388893 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec6f116-f394-45c3-a97c-e12e6e949c2e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:32.390895 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 112/230] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jul 4 09:04:32 2022] GET /identity/v3/projects/f1e246896b7b4569b9cea667ca2e1386 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:32.397714 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec6f116-f394-45c3-a97c-e12e6e949c2e None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:32.471913 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:32.503702 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec6f116-f394-45c3-a97c-e12e6e949c2e None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:32.541867 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca348194-1e48-4e68-ac49-ad3a99c2065a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:32.543007 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca348194-1e48-4e68-ac49-ad3a99c2065a None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:32.543431 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca348194-1e48-4e68-ac49-ad3a99c2065a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:32.543967 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca348194-1e48-4e68-ac49-ad3a99c2065a None admin] PATH_INFO: `/v3/projects/f1e246896b7b4569b9cea667ca2e1386/users/fa0144932d6e4ce58efa2a31699446cd/roles/157d1a80161e43a3ad84446eeca98e0b` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:32.546390 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca348194-1e48-4e68-ac49-ad3a99c2065a None admin] RBAC: Authorizing `identity:create_grant(project_id=f1e246896b7b4569b9cea667ca2e1386, user_id=fa0144932d6e4ce58efa2a31699446cd, role_id=157d1a80161e43a3ad84446eeca98e0b)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:32.548204 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca348194-1e48-4e68-ac49-ad3a99c2065a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:32.567254 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 113/231] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Jul 4 09:04:32 2022] PUT /identity/v3/projects/f1e246896b7b4569b9cea667ca2e1386/users/fa0144932d6e4ce58efa2a31699446cd/roles/157d1a80161e43a3ad84446eeca98e0b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:04:32.582012 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b6b34-c321-4b46-a11c-f71efa6820d4 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:32.631442 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab140fc-eb77-4c43-a70d-7a55f8ba9425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:32.632377 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab140fc-eb77-4c43-a70d-7a55f8ba9425 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:32.632662 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab140fc-eb77-4c43-a70d-7a55f8ba9425 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:32.632938 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab140fc-eb77-4c43-a70d-7a55f8ba9425 None admin] PATH_INFO: `/v3/users/fa0144932d6e4ce58efa2a31699446cd` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:32.636715 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab140fc-eb77-4c43-a70d-7a55f8ba9425 None admin] RBAC: Authorizing `identity:get_user(user_id=fa0144932d6e4ce58efa2a31699446cd)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:32.638221 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab140fc-eb77-4c43-a70d-7a55f8ba9425 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:32.640304 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 119/232] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Jul 4 09:04:32 2022] GET /identity/v3/users/fa0144932d6e4ce58efa2a31699446cd => generated 283 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:32.646083 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca348194-1e48-4e68-ac49-ad3a99c2065a None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:32.758637 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca348194-1e48-4e68-ac49-ad3a99c2065a None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:32.788568 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:32.794551 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a896b7e-01e4-4d0d-b51a-fd8e704d982b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:32.796961 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a896b7e-01e4-4d0d-b51a-fd8e704d982b None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:32.796961 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a896b7e-01e4-4d0d-b51a-fd8e704d982b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:32.796961 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a896b7e-01e4-4d0d-b51a-fd8e704d982b None admin] PATH_INFO: `/v3/projects/f1e246896b7b4569b9cea667ca2e1386` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:32.797363 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a896b7e-01e4-4d0d-b51a-fd8e704d982b None admin] RBAC: Authorizing `identity:get_project(project_id=f1e246896b7b4569b9cea667ca2e1386)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:32.798851 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a896b7e-01e4-4d0d-b51a-fd8e704d982b None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:32.801351 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 114/233] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jul 4 09:04:32 2022] GET /identity/v3/projects/f1e246896b7b4569b9cea667ca2e1386 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:32.807096 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab140fc-eb77-4c43-a70d-7a55f8ba9425 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:32.896299 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:32.937697 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab140fc-eb77-4c43-a70d-7a55f8ba9425 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:32.973892 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6fabfd-668c-4894-b69c-51e623365ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:32.974794 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6fabfd-668c-4894-b69c-51e623365ce2 None admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:32.975078 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6fabfd-668c-4894-b69c-51e623365ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:32.975355 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6fabfd-668c-4894-b69c-51e623365ce2 None admin] PATH_INFO: `/v3/projects/f1e246896b7b4569b9cea667ca2e1386/users/fa0144932d6e4ce58efa2a31699446cd/roles/965049e7ce6144aaad23c15f3a5e37c3` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:32.977522 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6fabfd-668c-4894-b69c-51e623365ce2 None admin] RBAC: Authorizing `identity:create_grant(project_id=f1e246896b7b4569b9cea667ca2e1386, user_id=fa0144932d6e4ce58efa2a31699446cd, role_id=965049e7ce6144aaad23c15f3a5e37c3)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:32.978984 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6fabfd-668c-4894-b69c-51e623365ce2 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:32.994509 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 120/234] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Jul 4 09:04:32 2022] PUT /identity/v3/projects/f1e246896b7b4569b9cea667ca2e1386/users/fa0144932d6e4ce58efa2a31699446cd/roles/965049e7ce6144aaad23c15f3a5e37c3 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:04:33.783414 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4b19a-1fc2-4f6d-929b-85fa5303d373 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:33.784461 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4b19a-1fc2-4f6d-929b-85fa5303d373 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:33.784935 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4b19a-1fc2-4f6d-929b-85fa5303d373 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:33.787003 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb193d68-a0ea-4e1e-af19-7707510d43e5 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:33.787228 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb193d68-a0ea-4e1e-af19-7707510d43e5 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:33.787415 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 115/235] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:04:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:04:33.787507 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb193d68-a0ea-4e1e-af19-7707510d43e5 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:33.789205 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 121/236] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:04:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:04:33.791527 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311fb76-2071-4e84-a4fb-c42927168275 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:33.792032 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311fb76-2071-4e84-a4fb-c42927168275 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:33.792494 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311fb76-2071-4e84-a4fb-c42927168275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:33.793982 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb33058-3324-4a40-b506-43511bb71bfc None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:33.794273 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb33058-3324-4a40-b506-43511bb71bfc None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:33.794552 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb33058-3324-4a40-b506-43511bb71bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:33.811201 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-ebb33058-3324-4a40-b506-43511bb71bfc None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:04:33.812546 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-ebb33058-3324-4a40-b506-43511bb71bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:04:33.816828 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-f311fb76-2071-4e84-a4fb-c42927168275 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:04:33.818199 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f311fb76-2071-4e84-a4fb-c42927168275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:04:33.909957 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 122/237] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:04:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 09:04:33.937209 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb33058-3324-4a40-b506-43511bb71bfc None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:33.946109 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 116/238] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:04:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:04:33.969794 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f311fb76-2071-4e84-a4fb-c42927168275 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:34.036138 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:34.121005 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb33058-3324-4a40-b506-43511bb71bfc None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:34.162463 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f311fb76-2071-4e84-a4fb-c42927168275 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:34.189882 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1dc257-44c3-44b5-933d-dfb9d6c80e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:34.190743 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1dc257-44c3-44b5-933d-dfb9d6c80e60 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:34.191033 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1dc257-44c3-44b5-933d-dfb9d6c80e60 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:34.191295 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1dc257-44c3-44b5-933d-dfb9d6c80e60 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:34.193816 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1dc257-44c3-44b5-933d-dfb9d6c80e60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:34.195315 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1dc257-44c3-44b5-933d-dfb9d6c80e60 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:34.197281 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 123/239] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:04:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:34.205778 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1dc257-44c3-44b5-933d-dfb9d6c80e60 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:34.220722 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:34.234965 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65737833-aa73-45b1-b91b-d31f9f3e5e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:34.236104 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65737833-aa73-45b1-b91b-d31f9f3e5e94 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:34.236382 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65737833-aa73-45b1-b91b-d31f9f3e5e94 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:34.236649 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65737833-aa73-45b1-b91b-d31f9f3e5e94 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:34.257954 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65737833-aa73-45b1-b91b-d31f9f3e5e94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:04:34.273071 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-65737833-aa73-45b1-b91b-d31f9f3e5e94 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 09:04:34.273071 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:04:34.273071 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:04:34.273071 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:04:34.273071 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:04:34.273071 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:04:34.273071 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:04:34.273071 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:04:34.273071 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:04:34.273071 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:04:34.273071 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:04:34.273071 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:04:34.273071 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:04:34.273071 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:04:34.273071 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:04:34.273071 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:04:34.273965 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:04:34.273965 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:04:34.273965 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:04:34.273965 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:04:34.273965 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:04:34.273965 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:04:34.273965 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:04:34.273965 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:04:34.273965 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:04:34.273965 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:04:34.273965 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:04:34.273965 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:04:34.273965 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:04:34.273965 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:04:34.273965 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:04:34.273965 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:04:34.274760 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:04:34.274760 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:04:34.274760 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:04:34.274760 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:04:34.274760 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:04:34.274760 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:04:34.274760 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:04:34.274760 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:04:34.274760 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:04:34.274760 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:04:34.274760 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 09:04:34.274760 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:04:34.274760 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 117/240] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jul 4 09:04:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:04:34.281691 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65737833-aa73-45b1-b91b-d31f9f3e5e94 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:34.401617 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65737833-aa73-45b1-b91b-d31f9f3e5e94 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:34.422419 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1dc257-44c3-44b5-933d-dfb9d6c80e60 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:34.443037 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:34.465033 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd6984b-edf7-491e-968a-5d86fa66eba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:34.466392 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6984b-edf7-491e-968a-5d86fa66eba5 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:34.467150 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2775b7-992d-4dff-acb5-8e47614d6381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:34.467988 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2775b7-992d-4dff-acb5-8e47614d6381 None admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:34.468435 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6984b-edf7-491e-968a-5d86fa66eba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:34.468849 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6984b-edf7-491e-968a-5d86fa66eba5 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:34.469268 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2775b7-992d-4dff-acb5-8e47614d6381 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:34.470210 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd6984b-edf7-491e-968a-5d86fa66eba5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:04:34.470615 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2775b7-992d-4dff-acb5-8e47614d6381 None admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:34.471501 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2775b7-992d-4dff-acb5-8e47614d6381 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:34.471969 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd6984b-edf7-491e-968a-5d86fa66eba5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:34.473511 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd6984b-edf7-491e-968a-5d86fa66eba5 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:34.475096 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2775b7-992d-4dff-acb5-8e47614d6381 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:34.492911 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 118/241] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Jul 4 09:04:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:34.496728 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd6984b-edf7-491e-968a-5d86fa66eba5 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:34.519452 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 124/242] 10.222.0.42 () {60 vars in 1132 bytes} [Mon Jul 4 09:04:34 2022] POST /identity/v3/users => generated 293 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:04:34.572276 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:34.610718 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc279f-7593-4fa1-845a-8d5e031c6313 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:34.611106 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc279f-7593-4fa1-845a-8d5e031c6313 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:34.611492 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc279f-7593-4fa1-845a-8d5e031c6313 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:34.613051 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 125/243] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:04:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:04:34.615136 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd6984b-edf7-491e-968a-5d86fa66eba5 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:34.618246 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b698fc3c-2bc0-40d9-b62e-8bdb9f244fbe None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:34.618650 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b698fc3c-2bc0-40d9-b62e-8bdb9f244fbe None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:34.619034 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b698fc3c-2bc0-40d9-b62e-8bdb9f244fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:34.637134 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-b698fc3c-2bc0-40d9-b62e-8bdb9f244fbe None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:04:34.638837 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-b698fc3c-2bc0-40d9-b62e-8bdb9f244fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:04:34.655139 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaa4227-ebf2-46e4-b42f-b5a4c254bef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:34.656367 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa4227-ebf2-46e4-b42f-b5a4c254bef7 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:34.656780 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa4227-ebf2-46e4-b42f-b5a4c254bef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:34.657183 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa4227-ebf2-46e4-b42f-b5a4c254bef7 None admin] PATH_INFO: `/v3/users/b661bf5ec1794bf08799c21680ea0ca9` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:34.672342 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaa4227-ebf2-46e4-b42f-b5a4c254bef7 None admin] RBAC: Authorizing `identity:get_user(user_id=b661bf5ec1794bf08799c21680ea0ca9)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:34.674119 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaa4227-ebf2-46e4-b42f-b5a4c254bef7 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:34.676799 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 119/244] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Jul 4 09:04:34 2022] GET /identity/v3/users/b661bf5ec1794bf08799c21680ea0ca9 => generated 297 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:34.684934 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaa4227-ebf2-46e4-b42f-b5a4c254bef7 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:34.775531 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 126/245] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:04:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 09:04:34.803358 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b698fc3c-2bc0-40d9-b62e-8bdb9f244fbe None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:34.823789 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaa4227-ebf2-46e4-b42f-b5a4c254bef7 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:34.837534 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:34.870585 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31c28c1-9ad4-4985-bc09-10d3813615d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:34.871698 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c28c1-9ad4-4985-bc09-10d3813615d4 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:34.872205 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c28c1-9ad4-4985-bc09-10d3813615d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:34.872722 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c28c1-9ad4-4985-bc09-10d3813615d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:34.945382 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b698fc3c-2bc0-40d9-b62e-8bdb9f244fbe None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:34.946919 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:34.956783 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31c28c1-9ad4-4985-bc09-10d3813615d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:34.958626 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31c28c1-9ad4-4985-bc09-10d3813615d4 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:34.992115 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9595f1-bcbe-4044-a80d-8ce1ce6025c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:34.992919 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9595f1-bcbe-4044-a80d-8ce1ce6025c5 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:34.993364 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9595f1-bcbe-4044-a80d-8ce1ce6025c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:34.993782 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9595f1-bcbe-4044-a80d-8ce1ce6025c5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:35.006783 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9595f1-bcbe-4044-a80d-8ce1ce6025c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:04:35.015651 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-ca9595f1-bcbe-4044-a80d-8ce1ce6025c5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:04:35.015651 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:04:35.015651 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:04:35.015651 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:04:35.015651 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:04:35.015651 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:04:35.015651 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:04:35.015651 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:04:35.015651 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:04:35.015651 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:04:35.015651 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:04:35.015651 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:04:35.015651 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:04:35.015651 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:04:35.015651 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:04:35.015651 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:04:35.016772 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:04:35.016772 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:04:35.016772 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:04:35.016772 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:04:35.016772 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:04:35.016772 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:04:35.016772 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:04:35.016772 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:04:35.016772 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:04:35.016772 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:04:35.016772 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:04:35.016772 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:04:35.016772 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:04:35.016772 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:04:35.016772 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:04:35.016772 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:04:35.017670 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:04:35.017670 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:04:35.017670 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:04:35.017670 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:04:35.017670 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:04:35.017670 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:04:35.017670 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:04:35.017670 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:04:35.017670 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:04:35.017670 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:04:35.017670 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:04:35.017670 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:04:35.020897 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 127/246] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jul 4 09:04:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:04:35.030144 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9595f1-bcbe-4044-a80d-8ce1ce6025c5 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:35.081516 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 120/247] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jul 4 09:04:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:04:35.089805 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31c28c1-9ad4-4985-bc09-10d3813615d4 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:35.102158 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:35.148634 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9595f1-bcbe-4044-a80d-8ce1ce6025c5 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:35.185700 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8521c6c7-0c09-414c-bca7-7bb4ec7f9e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:35.186756 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521c6c7-0c09-414c-bca7-7bb4ec7f9e0c None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:35.187294 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521c6c7-0c09-414c-bca7-7bb4ec7f9e0c None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:35.187770 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521c6c7-0c09-414c-bca7-7bb4ec7f9e0c None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:35.188770 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8521c6c7-0c09-414c-bca7-7bb4ec7f9e0c None admin] RBAC: Adding query filter params (name=member) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:04:35.189273 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8521c6c7-0c09-414c-bca7-7bb4ec7f9e0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:35.190877 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8521c6c7-0c09-414c-bca7-7bb4ec7f9e0c None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:35.200477 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 128/248] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Jul 4 09:04:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:35.207336 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8521c6c7-0c09-414c-bca7-7bb4ec7f9e0c None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:35.209920 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31c28c1-9ad4-4985-bc09-10d3813615d4 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:35.234553 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:35.262931 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2e86bd-e76a-4d45-9a0f-0f94a1ec8a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:35.263789 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e86bd-e76a-4d45-9a0f-0f94a1ec8a11 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:35.264257 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e86bd-e76a-4d45-9a0f-0f94a1ec8a11 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:35.264530 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e86bd-e76a-4d45-9a0f-0f94a1ec8a11 None admin] PATH_INFO: `/v3/projects/f1e246896b7b4569b9cea667ca2e1386` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:35.265776 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2e86bd-e76a-4d45-9a0f-0f94a1ec8a11 None admin] RBAC: Authorizing `identity:get_project(project_id=f1e246896b7b4569b9cea667ca2e1386)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:35.267259 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2e86bd-e76a-4d45-9a0f-0f94a1ec8a11 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:35.269228 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 121/249] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jul 4 09:04:35 2022] GET /identity/v3/projects/f1e246896b7b4569b9cea667ca2e1386 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:35.270549 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8bf17-70cc-407b-813d-94ec313fe7a5 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:35.270834 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8bf17-70cc-407b-813d-94ec313fe7a5 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:35.271105 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8bf17-70cc-407b-813d-94ec313fe7a5 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:35.274018 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 122/250] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:04:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:04:35.274835 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e8bf17-70cc-407b-813d-94ec313fe7a5 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:35.325601 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8521c6c7-0c09-414c-bca7-7bb4ec7f9e0c None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:35.363905 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:35.382141 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b43445-73a8-442c-b8e7-5164c9119df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:35.383037 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b43445-73a8-442c-b8e7-5164c9119df2 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:35.383313 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b43445-73a8-442c-b8e7-5164c9119df2 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:35.387193 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b43445-73a8-442c-b8e7-5164c9119df2 None admin] PATH_INFO: `/v3/users/f26ad617d9a7448ba7c3b3a9796bbba6` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:35.390456 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b43445-73a8-442c-b8e7-5164c9119df2 None admin] RBAC: Authorizing `identity:get_user(user_id=f26ad617d9a7448ba7c3b3a9796bbba6)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:35.391968 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b43445-73a8-442c-b8e7-5164c9119df2 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:35.393645 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 129/251] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Jul 4 09:04:35 2022] GET /identity/v3/users/f26ad617d9a7448ba7c3b3a9796bbba6 => generated 297 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:35.399605 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38883674-2593-436c-8314-2d89a7260c4e None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:35.399902 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38883674-2593-436c-8314-2d89a7260c4e None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:35.400182 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38883674-2593-436c-8314-2d89a7260c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:35.403272 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e8bf17-70cc-407b-813d-94ec313fe7a5 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:35.433071 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-38883674-2593-436c-8314-2d89a7260c4e None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:04:35.434817 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-38883674-2593-436c-8314-2d89a7260c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:04:35.439741 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a53d07e-8e18-4089-b359-47cd8695ccc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:35.440426 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a53d07e-8e18-4089-b359-47cd8695ccc8 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:35.440705 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a53d07e-8e18-4089-b359-47cd8695ccc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:35.440977 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a53d07e-8e18-4089-b359-47cd8695ccc8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:35.441808 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a53d07e-8e18-4089-b359-47cd8695ccc8 None admin] RBAC: Adding query filter params (role.id=a5112c31cfa1478db60e6079627603f6, scope.project.id=f1e246896b7b4569b9cea667ca2e1386, user.id=b661bf5ec1794bf08799c21680ea0ca9) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:04:35.442115 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a53d07e-8e18-4089-b359-47cd8695ccc8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:35.443566 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a53d07e-8e18-4089-b359-47cd8695ccc8 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:35.451188 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 123/252] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Jul 4 09:04:35 2022] GET /identity/v3/role_assignments?user.id=b661bf5ec1794bf08799c21680ea0ca9&scope.project.id=f1e246896b7b4569b9cea667ca2e1386&role.id=a5112c31cfa1478db60e6079627603f6 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:35.451933 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a53d07e-8e18-4089-b359-47cd8695ccc8 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:35.575778 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a53d07e-8e18-4089-b359-47cd8695ccc8 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:35.597647 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 130/253] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:04:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:04:35.599317 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120c2ec3-4ca1-4a49-a966-ae6811fcd56a None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:35.599753 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120c2ec3-4ca1-4a49-a966-ae6811fcd56a None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:35.600200 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120c2ec3-4ca1-4a49-a966-ae6811fcd56a None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:35.601710 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 131/254] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:04:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:04:35.609522 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a603fb3-e444-44e2-988b-84e1b4f01222 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:35.610056 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a603fb3-e444-44e2-988b-84e1b4f01222 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:35.610793 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a603fb3-e444-44e2-988b-84e1b4f01222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:35.626769 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa632b8-04bf-4e91-b3e8-bfbf1ace6eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:35.627659 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa632b8-04bf-4e91-b3e8-bfbf1ace6eeb None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:35.627999 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa632b8-04bf-4e91-b3e8-bfbf1ace6eeb None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:35.628255 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa632b8-04bf-4e91-b3e8-bfbf1ace6eeb None admin] PATH_INFO: `/v3/projects/f1e246896b7b4569b9cea667ca2e1386` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:35.629583 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa632b8-04bf-4e91-b3e8-bfbf1ace6eeb None admin] RBAC: Authorizing `identity:get_project(project_id=f1e246896b7b4569b9cea667ca2e1386)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:35.631280 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa632b8-04bf-4e91-b3e8-bfbf1ace6eeb None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:35.633505 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 124/255] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jul 4 09:04:35 2022] GET /identity/v3/projects/f1e246896b7b4569b9cea667ca2e1386 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:35.639335 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa632b8-04bf-4e91-b3e8-bfbf1ace6eeb None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:35.645037 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-9a603fb3-e444-44e2-988b-84e1b4f01222 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:04:35.646504 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-9a603fb3-e444-44e2-988b-84e1b4f01222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:04:35.662627 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:35.665923 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:35.757614 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 132/256] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:04:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:04:35.759706 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a603fb3-e444-44e2-988b-84e1b4f01222 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:35.836069 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa632b8-04bf-4e91-b3e8-bfbf1ace6eeb None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:35.903491 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13293f34-aafa-441d-8ea3-7824c2b9e58c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:35.904421 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13293f34-aafa-441d-8ea3-7824c2b9e58c None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:35.904701 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13293f34-aafa-441d-8ea3-7824c2b9e58c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:35.904973 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13293f34-aafa-441d-8ea3-7824c2b9e58c None admin] PATH_INFO: `/v3/projects/f1e246896b7b4569b9cea667ca2e1386/users/f26ad617d9a7448ba7c3b3a9796bbba6/roles/81634e7812344f84afcb29b0dba2687c` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:35.911289 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13293f34-aafa-441d-8ea3-7824c2b9e58c None admin] RBAC: Authorizing `identity:create_grant(project_id=f1e246896b7b4569b9cea667ca2e1386, user_id=f26ad617d9a7448ba7c3b3a9796bbba6, role_id=81634e7812344f84afcb29b0dba2687c)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:35.912822 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13293f34-aafa-441d-8ea3-7824c2b9e58c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:35.936530 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 125/257] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Jul 4 09:04:35 2022] PUT /identity/v3/projects/f1e246896b7b4569b9cea667ca2e1386/users/f26ad617d9a7448ba7c3b3a9796bbba6/roles/81634e7812344f84afcb29b0dba2687c => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:04:35.938121 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13293f34-aafa-441d-8ea3-7824c2b9e58c None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:35.966837 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a603fb3-e444-44e2-988b-84e1b4f01222 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:36.030925 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:36.072961 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18ea3a0-a3b5-4351-8362-70cea76c8249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:36.073840 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ea3a0-a3b5-4351-8362-70cea76c8249 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:36.074122 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ea3a0-a3b5-4351-8362-70cea76c8249 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:36.074396 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ea3a0-a3b5-4351-8362-70cea76c8249 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:36.078899 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13293f34-aafa-441d-8ea3-7824c2b9e58c None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:36.095669 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18ea3a0-a3b5-4351-8362-70cea76c8249 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:04:36.112596 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-f18ea3a0-a3b5-4351-8362-70cea76c8249 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 09:04:36.112596 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:04:36.112596 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:04:36.112596 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:04:36.112596 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:04:36.112596 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:04:36.112596 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:04:36.112596 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:04:36.112596 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:04:36.112596 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:04:36.112596 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:04:36.112596 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:04:36.112596 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:04:36.112596 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:04:36.112596 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:04:36.112596 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:04:36.113588 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:04:36.113588 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:04:36.113588 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:04:36.113588 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:04:36.113588 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:04:36.113588 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:04:36.113588 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:04:36.113588 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:04:36.113588 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:04:36.113588 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:04:36.113588 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:04:36.113588 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:04:36.113588 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:04:36.113588 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:04:36.113588 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:04:36.113588 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:04:36.114376 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:04:36.114376 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:04:36.114376 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:04:36.114376 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:04:36.114376 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:04:36.114376 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:04:36.114376 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:04:36.114376 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:04:36.114376 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:04:36.114376 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:04:36.114376 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 09:04:36.114376 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:04:36.114376 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 133/258] 10.222.0.42 () {56 vars in 1114 bytes} [Mon Jul 4 09:04:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:04:36.120266 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18ea3a0-a3b5-4351-8362-70cea76c8249 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:36.122130 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2bfed4-f588-4538-beb8-d1e17bc1fa31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:36.123179 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2bfed4-f588-4538-beb8-d1e17bc1fa31 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:36.123708 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2bfed4-f588-4538-beb8-d1e17bc1fa31 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:36.124204 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2bfed4-f588-4538-beb8-d1e17bc1fa31 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:36.138591 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2bfed4-f588-4538-beb8-d1e17bc1fa31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:04:36.147032 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:36.150347 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-cc2bfed4-f588-4538-beb8-d1e17bc1fa31 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:04:36.150347 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:04:36.150347 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:04:36.150347 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:04:36.150347 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:04:36.150347 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:04:36.150347 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:04:36.150347 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:04:36.150347 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:04:36.150347 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:04:36.150347 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:04:36.150347 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:04:36.150347 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:04:36.150347 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:04:36.150347 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:04:36.150347 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:04:36.151298 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:04:36.151298 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:04:36.151298 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:04:36.151298 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:04:36.151298 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:04:36.151298 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:04:36.151298 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:04:36.151298 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:04:36.151298 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:04:36.151298 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:04:36.151298 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:04:36.151298 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:04:36.151298 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:04:36.151298 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:04:36.151298 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:04:36.151298 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:04:36.152114 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:04:36.152114 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:04:36.152114 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:04:36.152114 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:04:36.152114 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:04:36.152114 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:04:36.152114 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:04:36.152114 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:04:36.152114 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:04:36.152114 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:04:36.152114 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:04:36.152114 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:04:36.153117 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 126/259] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Jul 4 09:04:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:04:36.162115 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2bfed4-f588-4538-beb8-d1e17bc1fa31 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:36.254721 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18ea3a0-a3b5-4351-8362-70cea76c8249 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:36.283179 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2bfed4-f588-4538-beb8-d1e17bc1fa31 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:36.290312 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256ad2f6-b6eb-440f-afa3-8b2663bc3f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:36.291065 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ad2f6-b6eb-440f-afa3-8b2663bc3f0a None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:36.291647 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ad2f6-b6eb-440f-afa3-8b2663bc3f0a None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:36.291647 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ad2f6-b6eb-440f-afa3-8b2663bc3f0a None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:36.292444 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256ad2f6-b6eb-440f-afa3-8b2663bc3f0a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:04:36.292751 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256ad2f6-b6eb-440f-afa3-8b2663bc3f0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:36.294306 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256ad2f6-b6eb-440f-afa3-8b2663bc3f0a None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:36.303540 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 134/260] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jul 4 09:04:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:04:36.313028 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256ad2f6-b6eb-440f-afa3-8b2663bc3f0a None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:36.320227 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:36.327449 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529e93a3-b8c4-4967-8d0d-8ffd8accbe39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:36.328319 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529e93a3-b8c4-4967-8d0d-8ffd8accbe39 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:36.328452 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529e93a3-b8c4-4967-8d0d-8ffd8accbe39 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:36.328957 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529e93a3-b8c4-4967-8d0d-8ffd8accbe39 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:36.329484 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529e93a3-b8c4-4967-8d0d-8ffd8accbe39 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:04:36.330073 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529e93a3-b8c4-4967-8d0d-8ffd8accbe39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:36.333280 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529e93a3-b8c4-4967-8d0d-8ffd8accbe39 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:36.350277 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 127/261] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jul 4 09:04:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:04:36.354131 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529e93a3-b8c4-4967-8d0d-8ffd8accbe39 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:36.456858 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:36.508896 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256ad2f6-b6eb-440f-afa3-8b2663bc3f0a None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:36.550160 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529e93a3-b8c4-4967-8d0d-8ffd8accbe39 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:36.577023 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd29764-4351-404e-b730-1e3c515c5ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:36.577989 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd29764-4351-404e-b730-1e3c515c5ff6 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:36.578278 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd29764-4351-404e-b730-1e3c515c5ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:36.578556 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd29764-4351-404e-b730-1e3c515c5ff6 None admin] PATH_INFO: `/v3/users/fa0144932d6e4ce58efa2a31699446cd` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:36.579771 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd29764-4351-404e-b730-1e3c515c5ff6 None admin] RBAC: Authorizing `identity:get_user(user_id=fa0144932d6e4ce58efa2a31699446cd)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:36.581307 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd29764-4351-404e-b730-1e3c515c5ff6 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:36.583192 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 135/262] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Jul 4 09:04:36 2022] GET /identity/v3/users/fa0144932d6e4ce58efa2a31699446cd => generated 283 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:36.589655 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd29764-4351-404e-b730-1e3c515c5ff6 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:36.590583 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f608d559-f04b-4036-8ceb-3cec554f067a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:36.591472 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f608d559-f04b-4036-8ceb-3cec554f067a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:36.591756 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f608d559-f04b-4036-8ceb-3cec554f067a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:36.592062 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f608d559-f04b-4036-8ceb-3cec554f067a None admin] PATH_INFO: `/v3/users/fa0144932d6e4ce58efa2a31699446cd` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:36.593601 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f608d559-f04b-4036-8ceb-3cec554f067a None admin] RBAC: Authorizing `identity:get_user(user_id=fa0144932d6e4ce58efa2a31699446cd)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:36.597169 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f608d559-f04b-4036-8ceb-3cec554f067a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:36.599003 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 128/263] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Jul 4 09:04:36 2022] GET /identity/v3/users/fa0144932d6e4ce58efa2a31699446cd => generated 283 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:36.609616 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f608d559-f04b-4036-8ceb-3cec554f067a None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:36.685575 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:36.730029 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f608d559-f04b-4036-8ceb-3cec554f067a None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:36.766111 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e645bb1-3252-46eb-852a-b50b0987589d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:36.766771 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e645bb1-3252-46eb-852a-b50b0987589d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:36.767061 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e645bb1-3252-46eb-852a-b50b0987589d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:36.767344 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e645bb1-3252-46eb-852a-b50b0987589d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:36.841402 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e645bb1-3252-46eb-852a-b50b0987589d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:36.842906 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e645bb1-3252-46eb-852a-b50b0987589d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:36.877947 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd29764-4351-404e-b730-1e3c515c5ff6 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:36.964253 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:36.992608 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c90da9-899a-4521-8b99-11348a21dff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:36.993269 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c90da9-899a-4521-8b99-11348a21dff3 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:36.993555 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c90da9-899a-4521-8b99-11348a21dff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:36.993838 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c90da9-899a-4521-8b99-11348a21dff3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:37.009618 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:37.023597 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 129/264] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jul 4 09:04:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:04:37.029003 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e645bb1-3252-46eb-852a-b50b0987589d None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:37.105060 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c90da9-899a-4521-8b99-11348a21dff3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:37.106456 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c90da9-899a-4521-8b99-11348a21dff3 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:37.132379 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e645bb1-3252-46eb-852a-b50b0987589d None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:37.174281 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2433b4-148d-4b57-b482-9fe5c9100324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:37.175154 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2433b4-148d-4b57-b482-9fe5c9100324 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:37.175437 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2433b4-148d-4b57-b482-9fe5c9100324 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:37.175711 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2433b4-148d-4b57-b482-9fe5c9100324 None admin] PATH_INFO: `/v3/projects/f1e246896b7b4569b9cea667ca2e1386` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:37.178262 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2433b4-148d-4b57-b482-9fe5c9100324 None admin] RBAC: Authorizing `identity:get_project(project_id=f1e246896b7b4569b9cea667ca2e1386)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:37.179767 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2433b4-148d-4b57-b482-9fe5c9100324 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:37.182700 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 130/265] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jul 4 09:04:37 2022] GET /identity/v3/projects/f1e246896b7b4569b9cea667ca2e1386 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:37.189815 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2433b4-148d-4b57-b482-9fe5c9100324 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:37.236256 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:37.293115 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 136/266] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jul 4 09:04:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 704 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 04 09:04:37.298889 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c90da9-899a-4521-8b99-11348a21dff3 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:37.353899 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2433b4-148d-4b57-b482-9fe5c9100324 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:37.366561 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:37.392369 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c4d977-8792-40c6-a653-b6e725d55b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:37.393435 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4d977-8792-40c6-a653-b6e725d55b5c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:37.393915 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4d977-8792-40c6-a653-b6e725d55b5c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:37.394407 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4d977-8792-40c6-a653-b6e725d55b5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:37.395569 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c4d977-8792-40c6-a653-b6e725d55b5c None admin] RBAC: Adding query filter params (role.id=965049e7ce6144aaad23c15f3a5e37c3, scope.project.id=f1e246896b7b4569b9cea667ca2e1386, user.id=fa0144932d6e4ce58efa2a31699446cd) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:04:37.396151 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c4d977-8792-40c6-a653-b6e725d55b5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:37.397913 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c4d977-8792-40c6-a653-b6e725d55b5c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:37.405003 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 131/267] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Jul 4 09:04:37 2022] GET /identity/v3/role_assignments?user.id=fa0144932d6e4ce58efa2a31699446cd&scope.project.id=f1e246896b7b4569b9cea667ca2e1386&role.id=965049e7ce6144aaad23c15f3a5e37c3 => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:37.467457 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c90da9-899a-4521-8b99-11348a21dff3 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:37.520715 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadd4fcc-2ab5-4216-a8b2-3e91e6a90643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:37.521602 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd4fcc-2ab5-4216-a8b2-3e91e6a90643 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:37.521880 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd4fcc-2ab5-4216-a8b2-3e91e6a90643 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:37.522149 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd4fcc-2ab5-4216-a8b2-3e91e6a90643 None admin] PATH_INFO: `/v3/projects/f1e246896b7b4569b9cea667ca2e1386` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:37.523458 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadd4fcc-2ab5-4216-a8b2-3e91e6a90643 None admin] RBAC: Authorizing `identity:get_project(project_id=f1e246896b7b4569b9cea667ca2e1386)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:37.524986 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadd4fcc-2ab5-4216-a8b2-3e91e6a90643 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:37.526748 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 137/268] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jul 4 09:04:37 2022] GET /identity/v3/projects/f1e246896b7b4569b9cea667ca2e1386 => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:04:37.533068 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c4d977-8792-40c6-a653-b6e725d55b5c None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:37.659961 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:37.671614 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c4d977-8792-40c6-a653-b6e725d55b5c None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:37.710695 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e070e31-dda2-4be1-9b8d-6a9901191537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:37.711373 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e070e31-dda2-4be1-9b8d-6a9901191537 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:37.711660 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e070e31-dda2-4be1-9b8d-6a9901191537 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:37.711966 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e070e31-dda2-4be1-9b8d-6a9901191537 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:37.712825 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e070e31-dda2-4be1-9b8d-6a9901191537 None admin] RBAC: Adding query filter params (role.id=157d1a80161e43a3ad84446eeca98e0b, scope.project.id=f1e246896b7b4569b9cea667ca2e1386, user.id=fa0144932d6e4ce58efa2a31699446cd) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:04:37.713141 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e070e31-dda2-4be1-9b8d-6a9901191537 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:37.714716 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e070e31-dda2-4be1-9b8d-6a9901191537 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:37.722148 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 132/269] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Jul 4 09:04:37 2022] GET /identity/v3/role_assignments?user.id=fa0144932d6e4ce58efa2a31699446cd&scope.project.id=f1e246896b7b4569b9cea667ca2e1386&role.id=157d1a80161e43a3ad84446eeca98e0b => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:38.064609 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127e623-3337-4c4f-b52e-59451635cf98 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:38.065126 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127e623-3337-4c4f-b52e-59451635cf98 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:38.065126 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127e623-3337-4c4f-b52e-59451635cf98 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:38.066514 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 138/270] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:04:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:04:38.073393 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1fbbd7-98a5-4c3e-b802-d486d8e79437 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:38.073841 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1fbbd7-98a5-4c3e-b802-d486d8e79437 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:38.073918 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1fbbd7-98a5-4c3e-b802-d486d8e79437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:38.091329 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-0f1fbbd7-98a5-4c3e-b802-d486d8e79437 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:04:38.092528 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0f1fbbd7-98a5-4c3e-b802-d486d8e79437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:04:38.166979 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b3f602-56f7-45c8-84db-c28489f49b88 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:38.167303 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b3f602-56f7-45c8-84db-c28489f49b88 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:38.168050 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b3f602-56f7-45c8-84db-c28489f49b88 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:38.169584 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 139/271] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:04:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:04:38.175658 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f9ea9-2552-47b4-866f-737851f265a7 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:38.176024 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f9ea9-2552-47b4-866f-737851f265a7 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:38.176260 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f9ea9-2552-47b4-866f-737851f265a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:38.179651 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 133/272] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:04:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:04:38.181267 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd057e18-743f-4ecd-9073-2b06d4db0ad9 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:38.181730 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd057e18-743f-4ecd-9073-2b06d4db0ad9 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:38.182172 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd057e18-743f-4ecd-9073-2b06d4db0ad9 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:38.185025 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 134/273] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:04:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:04:38.193406 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e5d6b-8828-4edc-a4ba-4109825704d9 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:38.193942 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e5d6b-8828-4edc-a4ba-4109825704d9 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:38.194389 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e5d6b-8828-4edc-a4ba-4109825704d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:38.195940 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-eb1f9ea9-2552-47b4-866f-737851f265a7 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:04:38.197309 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-eb1f9ea9-2552-47b4-866f-737851f265a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:04:38.216022 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-ec3e5d6b-8828-4edc-a4ba-4109825704d9 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:04:38.217805 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ec3e5d6b-8828-4edc-a4ba-4109825704d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:04:38.275093 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 140/274] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:04:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 09:04:38.284121 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f9ea9-2552-47b4-866f-737851f265a7 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:38.302658 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 135/275] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:04:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 04 09:04:38.303684 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e5d6b-8828-4edc-a4ba-4109825704d9 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:38.318697 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:38.324288 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:38.379687 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f9ea9-2552-47b4-866f-737851f265a7 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:38.414462 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b396da-85af-4815-970a-cf9f87e7cd62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:38.415259 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b396da-85af-4815-970a-cf9f87e7cd62 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:38.415477 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e5d6b-8828-4edc-a4ba-4109825704d9 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:38.415580 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b396da-85af-4815-970a-cf9f87e7cd62 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:38.415802 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b396da-85af-4815-970a-cf9f87e7cd62 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:38.426095 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b396da-85af-4815-970a-cf9f87e7cd62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:04:38.433774 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-56b396da-85af-4815-970a-cf9f87e7cd62 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 09:04:38.433774 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:04:38.433774 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:04:38.433774 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:04:38.433774 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:04:38.433774 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:04:38.433774 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:04:38.433774 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:04:38.433774 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:04:38.433774 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:04:38.433774 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:04:38.433774 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:04:38.433774 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:04:38.433774 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:04:38.433774 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:04:38.433774 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:04:38.434664 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:04:38.434664 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:04:38.434664 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:04:38.434664 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:04:38.434664 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:04:38.434664 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:04:38.434664 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:04:38.434664 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:04:38.434664 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:04:38.434664 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:04:38.434664 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:04:38.434664 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:04:38.434664 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:04:38.434664 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:04:38.434664 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:04:38.434664 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:04:38.435460 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:04:38.435460 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:04:38.435460 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:04:38.435460 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:04:38.435460 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:04:38.435460 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:04:38.435460 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:04:38.435460 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:04:38.435460 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:04:38.435460 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:04:38.435460 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 09:04:38.435460 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:04:38.435460 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 141/276] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jul 4 09:04:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:04:38.436151 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b396da-85af-4815-970a-cf9f87e7cd62 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:38.456542 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d66ee-098a-42a1-96e9-2957f108c6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:38.457332 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d66ee-098a-42a1-96e9-2957f108c6ca None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:38.457612 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d66ee-098a-42a1-96e9-2957f108c6ca None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:38.457878 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d66ee-098a-42a1-96e9-2957f108c6ca None admin] PATH_INFO: `/v3/roles/member` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:38.470723 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4d66ee-098a-42a1-96e9-2957f108c6ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:04:38.478488 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-8e4d66ee-098a-42a1-96e9-2957f108c6ca None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:04:38.478488 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:04:38.478488 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:04:38.478488 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:04:38.478488 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:04:38.478488 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:04:38.478488 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:04:38.478488 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:04:38.478488 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:04:38.478488 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:04:38.478488 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:04:38.478488 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:04:38.478488 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:04:38.478488 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:04:38.478488 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:04:38.478488 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:04:38.479670 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:04:38.479670 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:04:38.479670 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:04:38.479670 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:04:38.479670 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:04:38.479670 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:04:38.479670 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:04:38.479670 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:04:38.479670 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:04:38.479670 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:04:38.479670 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:04:38.479670 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:04:38.479670 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:04:38.479670 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:04:38.479670 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:04:38.479670 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:04:38.480735 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:04:38.480735 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:04:38.480735 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:04:38.480735 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:04:38.480735 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:04:38.480735 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:04:38.480735 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:04:38.480735 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:04:38.480735 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:04:38.480735 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:04:38.480735 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:04:38.480735 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:04:38.484166 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 136/277] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jul 4 09:04:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:04:38.485159 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d66ee-098a-42a1-96e9-2957f108c6ca None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:38.541562 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:38.545320 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b396da-85af-4815-970a-cf9f87e7cd62 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:38.570113 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:38.583233 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016da3a8-11c4-441b-8daa-2805bfdb59af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:38.584186 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016da3a8-11c4-441b-8daa-2805bfdb59af None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:38.584581 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016da3a8-11c4-441b-8daa-2805bfdb59af None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:38.584953 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016da3a8-11c4-441b-8daa-2805bfdb59af None admin] PATH_INFO: `/v3/domains/default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:38.586195 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016da3a8-11c4-441b-8daa-2805bfdb59af None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:38.587773 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016da3a8-11c4-441b-8daa-2805bfdb59af None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:38.589469 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 142/278] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:04:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:38.594828 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016da3a8-11c4-441b-8daa-2805bfdb59af None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:38.596792 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d66ee-098a-42a1-96e9-2957f108c6ca None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:38.631747 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3c88b6-ea3e-4209-957a-237dce8a34c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:38.632449 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c88b6-ea3e-4209-957a-237dce8a34c7 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:38.632875 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c88b6-ea3e-4209-957a-237dce8a34c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:38.633154 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c88b6-ea3e-4209-957a-237dce8a34c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:38.634686 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3c88b6-ea3e-4209-957a-237dce8a34c7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:04:38.634996 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3c88b6-ea3e-4209-957a-237dce8a34c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:38.636432 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3c88b6-ea3e-4209-957a-237dce8a34c7 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:38.651614 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 137/279] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Jul 4 09:04:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:38.651614 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3c88b6-ea3e-4209-957a-237dce8a34c7 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:38.697844 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016da3a8-11c4-441b-8daa-2805bfdb59af None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:38.731841 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa43e95b-9f3f-42e5-99ce-50793913ef35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:38.732554 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa43e95b-9f3f-42e5-99ce-50793913ef35 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:38.732812 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa43e95b-9f3f-42e5-99ce-50793913ef35 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:38.733088 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa43e95b-9f3f-42e5-99ce-50793913ef35 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:38.733844 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa43e95b-9f3f-42e5-99ce-50793913ef35 None admin] RBAC: Adding query filter params (name=member) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:04:38.734223 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa43e95b-9f3f-42e5-99ce-50793913ef35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:38.735957 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa43e95b-9f3f-42e5-99ce-50793913ef35 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:38.744593 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 143/280] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Jul 4 09:04:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:38.745198 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa43e95b-9f3f-42e5-99ce-50793913ef35 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:38.758760 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3c88b6-ea3e-4209-957a-237dce8a34c7 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:38.774766 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:38.792585 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc3d57-1a24-424c-b468-902ecdf9a770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:38.793255 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc3d57-1a24-424c-b468-902ecdf9a770 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:38.793533 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc3d57-1a24-424c-b468-902ecdf9a770 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:38.793811 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc3d57-1a24-424c-b468-902ecdf9a770 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:38.794510 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bc3d57-1a24-424c-b468-902ecdf9a770 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:38.796005 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bc3d57-1a24-424c-b468-902ecdf9a770 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:38.803673 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:38.817407 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 138/281] 10.222.0.42 () {60 vars in 1132 bytes} [Mon Jul 4 09:04:38 2022] POST /identity/v3/users => generated 293 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:04:38.818909 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96daffa2-bea0-4cbc-a58b-75fc94c17714 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:38.819202 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96daffa2-bea0-4cbc-a58b-75fc94c17714 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:38.819481 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96daffa2-bea0-4cbc-a58b-75fc94c17714 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:38.820841 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 139/282] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:04:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:04:38.821509 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96daffa2-bea0-4cbc-a58b-75fc94c17714 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:38.858193 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa43e95b-9f3f-42e5-99ce-50793913ef35 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:38.896560 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e2fa7e-a947-4dc6-849c-5c8a8db75613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:38.897450 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e2fa7e-a947-4dc6-849c-5c8a8db75613 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:38.897731 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e2fa7e-a947-4dc6-849c-5c8a8db75613 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:38.898007 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e2fa7e-a947-4dc6-849c-5c8a8db75613 None admin] PATH_INFO: `/v3/users/b661bf5ec1794bf08799c21680ea0ca9` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:38.899252 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e2fa7e-a947-4dc6-849c-5c8a8db75613 None admin] RBAC: Authorizing `identity:get_user(user_id=b661bf5ec1794bf08799c21680ea0ca9)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:38.900795 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e2fa7e-a947-4dc6-849c-5c8a8db75613 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:38.902860 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 144/283] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Jul 4 09:04:38 2022] GET /identity/v3/users/b661bf5ec1794bf08799c21680ea0ca9 => generated 297 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:38.904276 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe4107-fc1d-456c-bd04-7361770424bc None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:38.904562 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe4107-fc1d-456c-bd04-7361770424bc None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:38.904835 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe4107-fc1d-456c-bd04-7361770424bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:38.923643 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-cebe4107-fc1d-456c-bd04-7361770424bc None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:04:38.925059 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-cebe4107-fc1d-456c-bd04-7361770424bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:04:38.959029 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96daffa2-bea0-4cbc-a58b-75fc94c17714 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:38.999449 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feeda31-4cd3-43d8-9ad7-b4b2143bbf51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:39.000696 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feeda31-4cd3-43d8-9ad7-b4b2143bbf51 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:39.000970 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feeda31-4cd3-43d8-9ad7-b4b2143bbf51 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:39.001275 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feeda31-4cd3-43d8-9ad7-b4b2143bbf51 None admin] PATH_INFO: `/v3/users/ac70aa3794a24fdab5f21ac515fbbaea` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:39.003179 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 145/284] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:04:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:04:39.003379 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebe4107-fc1d-456c-bd04-7361770424bc None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:39.024541 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feeda31-4cd3-43d8-9ad7-b4b2143bbf51 None admin] RBAC: Authorizing `identity:get_user(user_id=ac70aa3794a24fdab5f21ac515fbbaea)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:39.026043 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feeda31-4cd3-43d8-9ad7-b4b2143bbf51 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:39.027851 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 140/285] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Jul 4 09:04:38 2022] GET /identity/v3/users/ac70aa3794a24fdab5f21ac515fbbaea => generated 293 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:39.029495 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feeda31-4cd3-43d8-9ad7-b4b2143bbf51 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:39.040399 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:39.094615 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:39.134505 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebe4107-fc1d-456c-bd04-7361770424bc None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:39.157745 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feeda31-4cd3-43d8-9ad7-b4b2143bbf51 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:39.181373 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65418baf-f550-488d-ae35-76b8491c33f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:39.182610 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65418baf-f550-488d-ae35-76b8491c33f0 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:39.183087 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65418baf-f550-488d-ae35-76b8491c33f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:39.184092 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65418baf-f550-488d-ae35-76b8491c33f0 None admin] PATH_INFO: `/v3/projects/f1e246896b7b4569b9cea667ca2e1386` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:39.185772 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65418baf-f550-488d-ae35-76b8491c33f0 None admin] RBAC: Authorizing `identity:get_project(project_id=f1e246896b7b4569b9cea667ca2e1386)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:39.188457 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65418baf-f550-488d-ae35-76b8491c33f0 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:39.191169 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 146/286] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jul 4 09:04:39 2022] GET /identity/v3/projects/f1e246896b7b4569b9cea667ca2e1386 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:39.192275 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65418baf-f550-488d-ae35-76b8491c33f0 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:39.199368 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3527dac7-72bd-4f15-ad02-84a2f127976b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:39.200193 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527dac7-72bd-4f15-ad02-84a2f127976b None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:39.200471 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527dac7-72bd-4f15-ad02-84a2f127976b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:39.200742 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527dac7-72bd-4f15-ad02-84a2f127976b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:39.215054 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3527dac7-72bd-4f15-ad02-84a2f127976b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:04:39.225590 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-3527dac7-72bd-4f15-ad02-84a2f127976b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:04:39.225590 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:04:39.225590 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:04:39.225590 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:04:39.225590 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:04:39.225590 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:04:39.225590 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:04:39.225590 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:04:39.225590 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:04:39.225590 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:04:39.225590 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:04:39.225590 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:04:39.225590 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:04:39.225590 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:04:39.225590 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:04:39.225590 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:04:39.226492 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:04:39.226492 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:04:39.226492 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:04:39.226492 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:04:39.226492 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:04:39.226492 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:04:39.226492 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:04:39.226492 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:04:39.226492 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:04:39.226492 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:04:39.226492 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:04:39.226492 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:04:39.226492 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:04:39.226492 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:04:39.226492 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:04:39.226492 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:04:39.227294 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:04:39.227294 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:04:39.227294 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:04:39.227294 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:04:39.227294 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:04:39.227294 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:04:39.227294 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:04:39.227294 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:04:39.227294 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:04:39.227294 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:04:39.227294 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:04:39.227294 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:04:39.227294 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 141/287] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jul 4 09:04:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:04:39.227998 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3527dac7-72bd-4f15-ad02-84a2f127976b None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:39.302721 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:39.310049 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65418baf-f550-488d-ae35-76b8491c33f0 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:39.353008 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff907b2-2322-4b05-8b85-8b7304d0680a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:39.353726 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff907b2-2322-4b05-8b85-8b7304d0680a None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:39.354118 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff907b2-2322-4b05-8b85-8b7304d0680a None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:39.354401 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff907b2-2322-4b05-8b85-8b7304d0680a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:39.355245 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff907b2-2322-4b05-8b85-8b7304d0680a None admin] RBAC: Adding query filter params (role.id=81634e7812344f84afcb29b0dba2687c, user.id=ac70aa3794a24fdab5f21ac515fbbaea, scope.system=all) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:04:39.355790 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff907b2-2322-4b05-8b85-8b7304d0680a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:39.357931 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff907b2-2322-4b05-8b85-8b7304d0680a None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:39.359755 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3527dac7-72bd-4f15-ad02-84a2f127976b None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:39.367964 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 147/288] 10.222.0.42 () {56 vars in 1308 bytes} [Mon Jul 4 09:04:39 2022] GET /identity/v3/role_assignments?user.id=ac70aa3794a24fdab5f21ac515fbbaea&scope.system=all&role.id=81634e7812344f84afcb29b0dba2687c => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:39.369209 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff907b2-2322-4b05-8b85-8b7304d0680a None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:39.377282 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:39.426061 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cc0059-0094-4a3d-ab52-0236e0373779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:39.427356 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc0059-0094-4a3d-ab52-0236e0373779 None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:39.427846 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc0059-0094-4a3d-ab52-0236e0373779 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:39.428350 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc0059-0094-4a3d-ab52-0236e0373779 None admin] PATH_INFO: `/v3/projects/f1e246896b7b4569b9cea667ca2e1386/users/b661bf5ec1794bf08799c21680ea0ca9/roles/a5112c31cfa1478db60e6079627603f6` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:39.430756 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cc0059-0094-4a3d-ab52-0236e0373779 None admin] RBAC: Authorizing `identity:create_grant(project_id=f1e246896b7b4569b9cea667ca2e1386, user_id=b661bf5ec1794bf08799c21680ea0ca9, role_id=a5112c31cfa1478db60e6079627603f6)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:39.432864 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cc0059-0094-4a3d-ab52-0236e0373779 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:39.457778 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 142/289] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Jul 4 09:04:39 2022] PUT /identity/v3/projects/f1e246896b7b4569b9cea667ca2e1386/users/b661bf5ec1794bf08799c21680ea0ca9/roles/a5112c31cfa1478db60e6079627603f6 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:04:39.530421 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff907b2-2322-4b05-8b85-8b7304d0680a None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:39.580686 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8991ca7a-a0da-41c6-8a51-06ccc4f395cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:39.581388 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991ca7a-a0da-41c6-8a51-06ccc4f395cc None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:39.581675 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991ca7a-a0da-41c6-8a51-06ccc4f395cc None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:39.581950 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991ca7a-a0da-41c6-8a51-06ccc4f395cc None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:39.582766 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8991ca7a-a0da-41c6-8a51-06ccc4f395cc None admin] RBAC: Adding query filter params (name=member) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:04:39.583075 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8991ca7a-a0da-41c6-8a51-06ccc4f395cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:39.584602 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8991ca7a-a0da-41c6-8a51-06ccc4f395cc None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:39.594548 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 148/290] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Jul 4 09:04:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:39.600480 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cc0059-0094-4a3d-ab52-0236e0373779 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:39.725770 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cc0059-0094-4a3d-ab52-0236e0373779 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:39.763836 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f7025c-d0e7-4662-a710-d5a0fb5c82bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:39.764747 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f7025c-d0e7-4662-a710-d5a0fb5c82bd None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:39.765028 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f7025c-d0e7-4662-a710-d5a0fb5c82bd None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:39.765369 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f7025c-d0e7-4662-a710-d5a0fb5c82bd None admin] PATH_INFO: `/v3/users/f26ad617d9a7448ba7c3b3a9796bbba6` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:39.766637 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f7025c-d0e7-4662-a710-d5a0fb5c82bd None admin] RBAC: Authorizing `identity:get_user(user_id=f26ad617d9a7448ba7c3b3a9796bbba6)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:39.768136 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f7025c-d0e7-4662-a710-d5a0fb5c82bd None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:39.770092 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 143/291] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Jul 4 09:04:39 2022] GET /identity/v3/users/f26ad617d9a7448ba7c3b3a9796bbba6 => generated 297 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:04:39.775437 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8991ca7a-a0da-41c6-8a51-06ccc4f395cc None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:39.802362 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:39.880157 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8991ca7a-a0da-41c6-8a51-06ccc4f395cc None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:39.914129 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b27672c-87f3-4f95-b862-6b0a0fb74d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:39.914786 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b27672c-87f3-4f95-b862-6b0a0fb74d69 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:39.915069 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b27672c-87f3-4f95-b862-6b0a0fb74d69 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:39.915341 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b27672c-87f3-4f95-b862-6b0a0fb74d69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:39.994697 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b27672c-87f3-4f95-b862-6b0a0fb74d69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:39.996122 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b27672c-87f3-4f95-b862-6b0a0fb74d69 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:40.029708 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:40.127799 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 149/292] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jul 4 09:04:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:04:40.133200 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f7025c-d0e7-4662-a710-d5a0fb5c82bd None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:40.186787 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:40.249827 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f7025c-d0e7-4662-a710-d5a0fb5c82bd None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:40.283146 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1b8c69-ffb9-4779-9e1d-4acbaf35ec57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:40.284041 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b8c69-ffb9-4779-9e1d-4acbaf35ec57 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:40.284328 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b8c69-ffb9-4779-9e1d-4acbaf35ec57 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:40.284608 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b8c69-ffb9-4779-9e1d-4acbaf35ec57 None admin] PATH_INFO: `/v3/projects/f1e246896b7b4569b9cea667ca2e1386` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:40.285795 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1b8c69-ffb9-4779-9e1d-4acbaf35ec57 None admin] RBAC: Authorizing `identity:get_project(project_id=f1e246896b7b4569b9cea667ca2e1386)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:40.287329 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1b8c69-ffb9-4779-9e1d-4acbaf35ec57 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:40.289436 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 144/293] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jul 4 09:04:40 2022] GET /identity/v3/projects/f1e246896b7b4569b9cea667ca2e1386 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:40.296486 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b27672c-87f3-4f95-b862-6b0a0fb74d69 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:40.428042 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b27672c-87f3-4f95-b862-6b0a0fb74d69 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:40.462562 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:40.477997 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a0bdd4-0d4f-403e-a1c8-befade9e0a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:40.478621 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a0bdd4-0d4f-403e-a1c8-befade9e0a53 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:40.479127 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a0bdd4-0d4f-403e-a1c8-befade9e0a53 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:40.479595 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a0bdd4-0d4f-403e-a1c8-befade9e0a53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:40.480722 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a0bdd4-0d4f-403e-a1c8-befade9e0a53 None admin] RBAC: Adding query filter params (role.id=81634e7812344f84afcb29b0dba2687c, scope.project.id=f1e246896b7b4569b9cea667ca2e1386, user.id=f26ad617d9a7448ba7c3b3a9796bbba6) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:04:40.481039 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a0bdd4-0d4f-403e-a1c8-befade9e0a53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:40.482501 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a0bdd4-0d4f-403e-a1c8-befade9e0a53 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:40.490989 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 150/294] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Jul 4 09:04:40 2022] GET /identity/v3/role_assignments?user.id=f26ad617d9a7448ba7c3b3a9796bbba6&scope.project.id=f1e246896b7b4569b9cea667ca2e1386&role.id=81634e7812344f84afcb29b0dba2687c => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:41.140562 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cc658d-4b27-4541-9761-8a0cbfd8e1bd None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:41.141528 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cc658d-4b27-4541-9761-8a0cbfd8e1bd None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:41.142087 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cc658d-4b27-4541-9761-8a0cbfd8e1bd None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:41.144138 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 145/295] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:04:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:04:41.149866 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3361c1eb-8a6e-4466-9278-c85a17ec44ab None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:41.150475 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3361c1eb-8a6e-4466-9278-c85a17ec44ab None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:41.150951 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3361c1eb-8a6e-4466-9278-c85a17ec44ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:41.168947 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-3361c1eb-8a6e-4466-9278-c85a17ec44ab None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:04:41.170489 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-3361c1eb-8a6e-4466-9278-c85a17ec44ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:04:41.244777 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 151/296] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:04:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:04:41.269246 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cc658d-4b27-4541-9761-8a0cbfd8e1bd None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:41.288224 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb079b55-e2cb-4896-b172-e29e8c13cdb9 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:41.288818 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb079b55-e2cb-4896-b172-e29e8c13cdb9 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:41.289335 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb079b55-e2cb-4896-b172-e29e8c13cdb9 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:41.291046 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 152/297] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:04:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:04:41.296858 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f4871-eac8-44d0-a9b1-1cfd6211a7d5 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:41.297793 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f4871-eac8-44d0-a9b1-1cfd6211a7d5 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:41.298282 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f4871-eac8-44d0-a9b1-1cfd6211a7d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:41.315226 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-5f5f4871-eac8-44d0-a9b1-1cfd6211a7d5 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:04:41.316780 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-5f5f4871-eac8-44d0-a9b1-1cfd6211a7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:04:41.386351 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 153/298] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:04:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 09:04:41.396143 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cc658d-4b27-4541-9761-8a0cbfd8e1bd None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:41.403315 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:41.410846 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5f4871-eac8-44d0-a9b1-1cfd6211a7d5 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:41.443232 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae293b7d-bf68-49a6-8d9e-fc3d61fafbe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:41.445001 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae293b7d-bf68-49a6-8d9e-fc3d61fafbe6 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:41.445463 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae293b7d-bf68-49a6-8d9e-fc3d61fafbe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:41.446080 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae293b7d-bf68-49a6-8d9e-fc3d61fafbe6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:41.448055 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae293b7d-bf68-49a6-8d9e-fc3d61fafbe6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:41.449939 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae293b7d-bf68-49a6-8d9e-fc3d61fafbe6 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:41.453009 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 146/299] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:04:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:41.458388 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae293b7d-bf68-49a6-8d9e-fc3d61fafbe6 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:41.466735 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:41.538333 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5f4871-eac8-44d0-a9b1-1cfd6211a7d5 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:41.567777 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae293b7d-bf68-49a6-8d9e-fc3d61fafbe6 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:41.577538 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4b54fc-7dd8-4e52-80cf-0d1583cf2c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:41.578415 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4b54fc-7dd8-4e52-80cf-0d1583cf2c52 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:41.578685 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4b54fc-7dd8-4e52-80cf-0d1583cf2c52 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:41.578963 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4b54fc-7dd8-4e52-80cf-0d1583cf2c52 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:41.589985 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4b54fc-7dd8-4e52-80cf-0d1583cf2c52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:04:41.597939 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-bd4b54fc-7dd8-4e52-80cf-0d1583cf2c52 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 09:04:41.597939 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:04:41.597939 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:04:41.597939 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:04:41.597939 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:04:41.597939 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:04:41.597939 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:04:41.597939 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:04:41.597939 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:04:41.597939 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:04:41.597939 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:04:41.597939 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:04:41.597939 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:04:41.597939 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:04:41.597939 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:04:41.597939 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:04:41.598869 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:04:41.598869 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:04:41.598869 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:04:41.598869 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:04:41.598869 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:04:41.598869 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:04:41.598869 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:04:41.598869 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:04:41.598869 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:04:41.598869 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:04:41.598869 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:04:41.598869 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:04:41.598869 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:04:41.598869 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:04:41.598869 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:04:41.598869 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:04:41.599670 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:04:41.599670 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:04:41.599670 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:04:41.599670 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:04:41.599670 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:04:41.599670 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:04:41.599670 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:04:41.599670 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:04:41.599670 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:04:41.599670 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:04:41.599670 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 09:04:41.599670 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:04:41.604026 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 154/300] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jul 4 09:04:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:04:41.605282 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4b54fc-7dd8-4e52-80cf-0d1583cf2c52 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:41.611941 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664e1262-3c8b-4cdf-b3ba-9756efab21df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:41.612883 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e1262-3c8b-4cdf-b3ba-9756efab21df None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:41.613358 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e1262-3c8b-4cdf-b3ba-9756efab21df None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:41.613824 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e1262-3c8b-4cdf-b3ba-9756efab21df None admin] PATH_INFO: `/v3/groups` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:41.614808 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664e1262-3c8b-4cdf-b3ba-9756efab21df None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:41.616516 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664e1262-3c8b-4cdf-b3ba-9756efab21df None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:41.644199 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 147/301] 10.222.0.42 () {60 vars in 1134 bytes} [Mon Jul 4 09:04:41 2022] POST /identity/v3/groups => generated 229 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:04:41.722007 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4b54fc-7dd8-4e52-80cf-0d1583cf2c52 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:41.729714 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:41.759949 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e3130b-f6b3-4d49-bc31-722f3e95635e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:41.760643 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3130b-f6b3-4d49-bc31-722f3e95635e None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:41.760927 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3130b-f6b3-4d49-bc31-722f3e95635e None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:41.761202 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3130b-f6b3-4d49-bc31-722f3e95635e None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:41.761979 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e3130b-f6b3-4d49-bc31-722f3e95635e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:04:41.762289 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e3130b-f6b3-4d49-bc31-722f3e95635e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:41.763712 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e3130b-f6b3-4d49-bc31-722f3e95635e None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:41.777834 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 155/302] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Jul 4 09:04:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:04:41.779269 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664e1262-3c8b-4cdf-b3ba-9756efab21df None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:41.820611 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:41.839799 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d0ea7-ef39-4de8-b71b-54e87b91dd11 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:41.840161 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d0ea7-ef39-4de8-b71b-54e87b91dd11 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:41.840439 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d0ea7-ef39-4de8-b71b-54e87b91dd11 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:41.841864 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 156/303] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:04:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:04:41.847294 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d0f9b-35db-436e-a5e1-4f0ac76da428 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:41.847774 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d0f9b-35db-436e-a5e1-4f0ac76da428 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:41.848222 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d0f9b-35db-436e-a5e1-4f0ac76da428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:41.868066 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-427d0f9b-35db-436e-a5e1-4f0ac76da428 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:04:41.869611 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-427d0f9b-35db-436e-a5e1-4f0ac76da428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:04:41.904547 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664e1262-3c8b-4cdf-b3ba-9756efab21df None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:41.942360 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117bc6f5-8e60-4860-b847-5f85ca74dbaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:41.943247 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117bc6f5-8e60-4860-b847-5f85ca74dbaa None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:41.943530 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117bc6f5-8e60-4860-b847-5f85ca74dbaa None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:41.943699 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 157/304] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:04:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:04:41.943892 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117bc6f5-8e60-4860-b847-5f85ca74dbaa None admin] PATH_INFO: `/v3/users/cdb375e2c7cc48f2aaa40b6a51f8c933` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:41.958440 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117bc6f5-8e60-4860-b847-5f85ca74dbaa None admin] RBAC: Authorizing `identity:get_user(user_id=cdb375e2c7cc48f2aaa40b6a51f8c933)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:41.959978 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117bc6f5-8e60-4860-b847-5f85ca74dbaa None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:41.965624 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427d0f9b-35db-436e-a5e1-4f0ac76da428 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:41.966591 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 148/305] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Jul 4 09:04:41 2022] GET /identity/v3/users/cdb375e2c7cc48f2aaa40b6a51f8c933 => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:41.967841 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117bc6f5-8e60-4860-b847-5f85ca74dbaa None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:42.068814 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:42.078729 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117bc6f5-8e60-4860-b847-5f85ca74dbaa None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:42.087957 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:42.094547 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427d0f9b-35db-436e-a5e1-4f0ac76da428 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:42.116172 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b061444-53d4-43aa-b675-69e0a6155cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:42.116830 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b061444-53d4-43aa-b675-69e0a6155cce None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:42.117109 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b061444-53d4-43aa-b675-69e0a6155cce None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:42.117380 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b061444-53d4-43aa-b675-69e0a6155cce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:42.118209 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b061444-53d4-43aa-b675-69e0a6155cce None admin] RBAC: Adding query filter params (role.id=a5112c31cfa1478db60e6079627603f6, user.id=cdb375e2c7cc48f2aaa40b6a51f8c933, scope.system=all) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:04:42.118519 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b061444-53d4-43aa-b675-69e0a6155cce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:42.120005 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b061444-53d4-43aa-b675-69e0a6155cce None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:42.129525 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 149/306] 10.222.0.42 () {56 vars in 1308 bytes} [Mon Jul 4 09:04:41 2022] GET /identity/v3/role_assignments?user.id=cdb375e2c7cc48f2aaa40b6a51f8c933&scope.system=all&role.id=a5112c31cfa1478db60e6079627603f6 => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:42.129525 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d653de7-4e64-416e-8858-022425bf5063 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:42.129525 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d653de7-4e64-416e-8858-022425bf5063 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:42.129525 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d653de7-4e64-416e-8858-022425bf5063 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:42.129525 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 150/307] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:04:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:04:42.134301 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e42f4d-220d-4770-9289-d3d2295ee0f3 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:42.134585 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e42f4d-220d-4770-9289-d3d2295ee0f3 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:42.134841 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e42f4d-220d-4770-9289-d3d2295ee0f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:42.141411 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e368b298-020a-45f5-9ab9-906709e2eeb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:42.142591 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e368b298-020a-45f5-9ab9-906709e2eeb9 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:42.143076 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e368b298-020a-45f5-9ab9-906709e2eeb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:42.143587 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e368b298-020a-45f5-9ab9-906709e2eeb9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:42.152789 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-a9e42f4d-220d-4770-9289-d3d2295ee0f3 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:04:42.154078 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a9e42f4d-220d-4770-9289-d3d2295ee0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:04:42.156917 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e368b298-020a-45f5-9ab9-906709e2eeb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:04:42.165202 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-e368b298-020a-45f5-9ab9-906709e2eeb9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:04:42.165202 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:04:42.165202 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:04:42.165202 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:04:42.165202 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:04:42.165202 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:04:42.165202 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:04:42.165202 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:04:42.165202 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:04:42.165202 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:04:42.165202 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:04:42.165202 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:04:42.165202 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:04:42.165202 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:04:42.165202 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:04:42.165202 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:04:42.166184 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:04:42.166184 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:04:42.166184 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:04:42.166184 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:04:42.166184 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:04:42.166184 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:04:42.166184 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:04:42.166184 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:04:42.166184 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:04:42.166184 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:04:42.166184 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:04:42.166184 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:04:42.166184 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:04:42.166184 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:04:42.166184 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:04:42.166184 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:04:42.166982 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:04:42.166982 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:04:42.166982 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:04:42.166982 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:04:42.166982 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:04:42.166982 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:04:42.166982 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:04:42.166982 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:04:42.166982 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:04:42.166982 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:04:42.166982 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:04:42.166982 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:04:42.169796 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 158/308] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jul 4 09:04:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:04:42.176436 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e368b298-020a-45f5-9ab9-906709e2eeb9 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:42.257699 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 151/309] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:04:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:04:42.282672 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e42f4d-220d-4770-9289-d3d2295ee0f3 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:42.301125 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e368b298-020a-45f5-9ab9-906709e2eeb9 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:42.342261 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f5e1e-aee9-44b5-bcbe-cff307f95907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:42.343395 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f5e1e-aee9-44b5-bcbe-cff307f95907 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:42.344028 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f5e1e-aee9-44b5-bcbe-cff307f95907 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:42.344544 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f5e1e-aee9-44b5-bcbe-cff307f95907 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:42.345570 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5f5e1e-aee9-44b5-bcbe-cff307f95907 None admin] RBAC: Adding query filter params (name=member) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:04:42.346075 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5f5e1e-aee9-44b5-bcbe-cff307f95907 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:42.347880 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5f5e1e-aee9-44b5-bcbe-cff307f95907 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:42.357155 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 159/310] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Jul 4 09:04:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:42.363621 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f5e1e-aee9-44b5-bcbe-cff307f95907 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:42.386680 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:42.389886 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:42.407553 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e42f4d-220d-4770-9289-d3d2295ee0f3 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:42.447424 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f35f07-0496-4d50-abbc-11250a111892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:42.448747 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f35f07-0496-4d50-abbc-11250a111892 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:42.449332 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f35f07-0496-4d50-abbc-11250a111892 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:42.449825 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f35f07-0496-4d50-abbc-11250a111892 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:42.461908 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f35f07-0496-4d50-abbc-11250a111892 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:04:42.470565 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-14f35f07-0496-4d50-abbc-11250a111892 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 09:04:42.470565 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:04:42.470565 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:04:42.470565 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:04:42.470565 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:04:42.470565 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:04:42.470565 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:04:42.470565 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:04:42.470565 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:04:42.470565 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:04:42.470565 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:04:42.470565 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:04:42.470565 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:04:42.470565 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:04:42.470565 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:04:42.470565 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:04:42.471495 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:04:42.471495 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:04:42.471495 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:04:42.471495 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:04:42.471495 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:04:42.471495 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:04:42.471495 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:04:42.471495 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:04:42.471495 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:04:42.471495 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:04:42.471495 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:04:42.471495 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:04:42.471495 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:04:42.471495 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:04:42.471495 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:04:42.471495 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:04:42.472317 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:04:42.472317 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:04:42.472317 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:04:42.472317 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:04:42.472317 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:04:42.472317 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:04:42.472317 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:04:42.472317 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:04:42.472317 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:04:42.472317 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:04:42.472317 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 09:04:42.472317 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:04:42.472982 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f5e1e-aee9-44b5-bcbe-cff307f95907 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:42.475294 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 152/311] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jul 4 09:04:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:04:42.480963 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f35f07-0496-4d50-abbc-11250a111892 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:42.513376 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f93399e-f1f3-41f6-bdbb-d5b422e2ecb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:42.514528 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93399e-f1f3-41f6-bdbb-d5b422e2ecb1 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:42.514813 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93399e-f1f3-41f6-bdbb-d5b422e2ecb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:42.515149 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93399e-f1f3-41f6-bdbb-d5b422e2ecb1 None admin] PATH_INFO: `/v3/users/ac70aa3794a24fdab5f21ac515fbbaea` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:42.516560 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f93399e-f1f3-41f6-bdbb-d5b422e2ecb1 None admin] RBAC: Authorizing `identity:get_user(user_id=ac70aa3794a24fdab5f21ac515fbbaea)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:42.518620 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f93399e-f1f3-41f6-bdbb-d5b422e2ecb1 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:42.520477 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 160/312] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Jul 4 09:04:42 2022] GET /identity/v3/users/ac70aa3794a24fdab5f21ac515fbbaea => generated 293 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:04:42.525806 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f93399e-f1f3-41f6-bdbb-d5b422e2ecb1 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:42.595403 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f35f07-0496-4d50-abbc-11250a111892 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:42.619861 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:42.636484 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e4254d-9299-43a8-bbd5-9f91f7f7253c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:42.636954 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f93399e-f1f3-41f6-bdbb-d5b422e2ecb1 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:42.637765 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4254d-9299-43a8-bbd5-9f91f7f7253c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:42.638523 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4254d-9299-43a8-bbd5-9f91f7f7253c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:42.638995 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4254d-9299-43a8-bbd5-9f91f7f7253c None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:42.640846 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e4254d-9299-43a8-bbd5-9f91f7f7253c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:04:42.641358 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e4254d-9299-43a8-bbd5-9f91f7f7253c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:42.643011 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e4254d-9299-43a8-bbd5-9f91f7f7253c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:42.655023 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 153/313] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Jul 4 09:04:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:42.667900 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e4254d-9299-43a8-bbd5-9f91f7f7253c None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:42.672205 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:42.683218 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36e5403-489d-46cb-8943-b74b2dbd4fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:42.684109 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36e5403-489d-46cb-8943-b74b2dbd4fe7 None admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:42.684895 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36e5403-489d-46cb-8943-b74b2dbd4fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:42.685175 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36e5403-489d-46cb-8943-b74b2dbd4fe7 None admin] PATH_INFO: `/v3/system/users/ac70aa3794a24fdab5f21ac515fbbaea/roles/81634e7812344f84afcb29b0dba2687c` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:42.687393 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36e5403-489d-46cb-8943-b74b2dbd4fe7 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ac70aa3794a24fdab5f21ac515fbbaea, role_id=81634e7812344f84afcb29b0dba2687c)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:42.689454 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36e5403-489d-46cb-8943-b74b2dbd4fe7 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:42.702979 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 161/314] 10.222.0.42 () {58 vars in 1334 bytes} [Mon Jul 4 09:04:42 2022] PUT /identity/v3/system/users/ac70aa3794a24fdab5f21ac515fbbaea/roles/81634e7812344f84afcb29b0dba2687c => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:04:42.777922 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e4254d-9299-43a8-bbd5-9f91f7f7253c None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:42.815657 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcdaa7d-1614-441f-a54e-98518112ab78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:42.816639 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcdaa7d-1614-441f-a54e-98518112ab78 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:42.816917 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcdaa7d-1614-441f-a54e-98518112ab78 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:42.817187 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcdaa7d-1614-441f-a54e-98518112ab78 None admin] PATH_INFO: `/v3/users/b661bf5ec1794bf08799c21680ea0ca9` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:42.818461 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcdaa7d-1614-441f-a54e-98518112ab78 None admin] RBAC: Authorizing `identity:get_user(user_id=b661bf5ec1794bf08799c21680ea0ca9)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:42.819974 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcdaa7d-1614-441f-a54e-98518112ab78 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:42.821991 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 154/315] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Jul 4 09:04:42 2022] GET /identity/v3/users/b661bf5ec1794bf08799c21680ea0ca9 => generated 297 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:04:42.829073 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36e5403-489d-46cb-8943-b74b2dbd4fe7 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:42.944703 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36e5403-489d-46cb-8943-b74b2dbd4fe7 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:42.979077 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee60ebbd-0893-4116-a07b-29f7d3ccf81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:42.979738 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee60ebbd-0893-4116-a07b-29f7d3ccf81e None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:42.980049 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee60ebbd-0893-4116-a07b-29f7d3ccf81e None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:42.980327 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee60ebbd-0893-4116-a07b-29f7d3ccf81e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:43.002587 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:43.055429 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee60ebbd-0893-4116-a07b-29f7d3ccf81e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:43.057173 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee60ebbd-0893-4116-a07b-29f7d3ccf81e None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:43.158575 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 162/316] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jul 4 09:04:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:04:43.164984 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcdaa7d-1614-441f-a54e-98518112ab78 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:43.247766 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:43.271508 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcdaa7d-1614-441f-a54e-98518112ab78 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:43.306699 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece8aa53-3ecb-4289-af78-3e06b9a94466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:43.307564 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8aa53-3ecb-4289-af78-3e06b9a94466 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:43.307844 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8aa53-3ecb-4289-af78-3e06b9a94466 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:43.308136 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8aa53-3ecb-4289-af78-3e06b9a94466 None admin] PATH_INFO: `/v3/projects/f1e246896b7b4569b9cea667ca2e1386` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:43.309301 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece8aa53-3ecb-4289-af78-3e06b9a94466 None admin] RBAC: Authorizing `identity:get_project(project_id=f1e246896b7b4569b9cea667ca2e1386)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:43.310772 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece8aa53-3ecb-4289-af78-3e06b9a94466 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:43.312524 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 155/317] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jul 4 09:04:43 2022] GET /identity/v3/projects/f1e246896b7b4569b9cea667ca2e1386 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:43.318338 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee60ebbd-0893-4116-a07b-29f7d3ccf81e None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:43.372336 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:43.420138 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee60ebbd-0893-4116-a07b-29f7d3ccf81e None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:43.454218 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7679703-e918-450a-bac2-53c30b4d2cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:43.454880 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7679703-e918-450a-bac2-53c30b4d2cc3 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:43.455163 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7679703-e918-450a-bac2-53c30b4d2cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:43.455438 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7679703-e918-450a-bac2-53c30b4d2cc3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:43.456305 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7679703-e918-450a-bac2-53c30b4d2cc3 None admin] RBAC: Adding query filter params (role.id=a5112c31cfa1478db60e6079627603f6, scope.project.id=f1e246896b7b4569b9cea667ca2e1386, user.id=b661bf5ec1794bf08799c21680ea0ca9) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:04:43.456617 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7679703-e918-450a-bac2-53c30b4d2cc3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:43.458079 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7679703-e918-450a-bac2-53c30b4d2cc3 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:43.464710 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 163/318] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Jul 4 09:04:43 2022] GET /identity/v3/role_assignments?user.id=b661bf5ec1794bf08799c21680ea0ca9&scope.project.id=f1e246896b7b4569b9cea667ca2e1386&role.id=a5112c31cfa1478db60e6079627603f6 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:43.854544 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30efb692-0d0c-49dc-8308-0a5231b1a43b None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:43.854722 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30efb692-0d0c-49dc-8308-0a5231b1a43b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:43.855110 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30efb692-0d0c-49dc-8308-0a5231b1a43b None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:43.856726 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 156/319] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:04:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:04:43.862377 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9a661-31cb-40cc-b3a7-4af3f0c5d69e None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:43.862629 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9a661-31cb-40cc-b3a7-4af3f0c5d69e None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:43.862940 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9a661-31cb-40cc-b3a7-4af3f0c5d69e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:43.882912 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-87d9a661-31cb-40cc-b3a7-4af3f0c5d69e None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:04:43.884183 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-87d9a661-31cb-40cc-b3a7-4af3f0c5d69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:04:43.959948 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 164/320] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:04:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:04:43.979643 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30efb692-0d0c-49dc-8308-0a5231b1a43b None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:44.090055 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30efb692-0d0c-49dc-8308-0a5231b1a43b None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:44.125815 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4646925c-eaa3-432d-a86e-baccf59daa9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:44.126847 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646925c-eaa3-432d-a86e-baccf59daa9e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:44.127301 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646925c-eaa3-432d-a86e-baccf59daa9e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:44.127743 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646925c-eaa3-432d-a86e-baccf59daa9e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:44.129228 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4646925c-eaa3-432d-a86e-baccf59daa9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:44.130889 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4646925c-eaa3-432d-a86e-baccf59daa9e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:44.132721 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 157/321] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:04:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:44.138298 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d9a661-31cb-40cc-b3a7-4af3f0c5d69e None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:44.186077 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:44.199577 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff1180b-a68b-464f-830b-1a0801e18464 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:44.200113 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff1180b-a68b-464f-830b-1a0801e18464 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:44.200190 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff1180b-a68b-464f-830b-1a0801e18464 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:44.201954 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 158/322] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:04:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:04:44.207198 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ea54ce-3ec9-49eb-b773-3012e7b8bd03 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:44.207488 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ea54ce-3ec9-49eb-b773-3012e7b8bd03 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:44.207750 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ea54ce-3ec9-49eb-b773-3012e7b8bd03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:44.224304 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-a3ea54ce-3ec9-49eb-b773-3012e7b8bd03 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:04:44.225499 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a3ea54ce-3ec9-49eb-b773-3012e7b8bd03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:04:44.232938 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:44.245770 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d9a661-31cb-40cc-b3a7-4af3f0c5d69e None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:44.286096 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc41ba-a05a-451b-a52c-dc965d896fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:44.286774 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc41ba-a05a-451b-a52c-dc965d896fa3 None admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:44.287055 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc41ba-a05a-451b-a52c-dc965d896fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:44.287329 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc41ba-a05a-451b-a52c-dc965d896fa3 None admin] PATH_INFO: `/v3/groups` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:44.288065 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebc41ba-a05a-451b-a52c-dc965d896fa3 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:44.289531 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebc41ba-a05a-451b-a52c-dc965d896fa3 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:44.297662 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 159/323] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:04:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 09:04:44.311895 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 165/324] 10.222.0.42 () {60 vars in 1134 bytes} [Mon Jul 4 09:04:44 2022] POST /identity/v3/groups => generated 226 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:04:44.320302 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ea54ce-3ec9-49eb-b773-3012e7b8bd03 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:44.429719 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ea54ce-3ec9-49eb-b773-3012e7b8bd03 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:44.467663 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a161f785-2e71-45e9-afb3-249afd771584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:44.468566 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161f785-2e71-45e9-afb3-249afd771584 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:44.468855 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161f785-2e71-45e9-afb3-249afd771584 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:44.469132 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161f785-2e71-45e9-afb3-249afd771584 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:44.479901 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a161f785-2e71-45e9-afb3-249afd771584 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:04:44.488044 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-a161f785-2e71-45e9-afb3-249afd771584 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 09:04:44.488044 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:04:44.488044 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:04:44.488044 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:04:44.488044 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:04:44.488044 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:04:44.488044 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:04:44.488044 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:04:44.488044 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:04:44.488044 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:04:44.488044 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:04:44.488044 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:04:44.488044 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:04:44.488044 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:04:44.488044 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:04:44.488044 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:04:44.488918 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:04:44.488918 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:04:44.488918 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:04:44.488918 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:04:44.488918 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:04:44.488918 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:04:44.488918 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:04:44.488918 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:04:44.488918 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:04:44.488918 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:04:44.488918 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:04:44.488918 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:04:44.488918 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:04:44.488918 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:04:44.488918 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:04:44.488918 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:04:44.489716 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:04:44.489716 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:04:44.489716 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:04:44.489716 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:04:44.489716 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:04:44.489716 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:04:44.489716 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:04:44.489716 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:04:44.489716 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:04:44.489716 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:04:44.489716 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 09:04:44.489716 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:04:44.489716 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 160/325] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jul 4 09:04:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:04:44.495357 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc41ba-a05a-451b-a52c-dc965d896fa3 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:44.600590 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc41ba-a05a-451b-a52c-dc965d896fa3 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:44.610594 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:44.638292 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6d1aeb-84ef-4294-b0cc-acb54bf8d31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:44.638978 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6d1aeb-84ef-4294-b0cc-acb54bf8d31c None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:44.639262 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6d1aeb-84ef-4294-b0cc-acb54bf8d31c None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:44.639536 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6d1aeb-84ef-4294-b0cc-acb54bf8d31c None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:44.640373 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6d1aeb-84ef-4294-b0cc-acb54bf8d31c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:04:44.640756 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6d1aeb-84ef-4294-b0cc-acb54bf8d31c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:44.642164 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6d1aeb-84ef-4294-b0cc-acb54bf8d31c None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:44.651772 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 166/326] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Jul 4 09:04:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:44.657647 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a161f785-2e71-45e9-afb3-249afd771584 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:44.660597 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:44.773965 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a161f785-2e71-45e9-afb3-249afd771584 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:44.789617 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475923a1-dbc4-457f-bd53-94a80d50076d None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:44.789913 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475923a1-dbc4-457f-bd53-94a80d50076d None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:44.790229 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475923a1-dbc4-457f-bd53-94a80d50076d None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:44.791903 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 167/327] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:04:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:04:44.797152 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63914bf2-db84-47db-8995-a36e2504ff41 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:44.797444 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63914bf2-db84-47db-8995-a36e2504ff41 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:44.797726 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63914bf2-db84-47db-8995-a36e2504ff41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:44.813105 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0fdc4f-f3ad-43b7-928d-599c662b1682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:44.813987 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0fdc4f-f3ad-43b7-928d-599c662b1682 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:44.814270 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0fdc4f-f3ad-43b7-928d-599c662b1682 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:44.814542 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0fdc4f-f3ad-43b7-928d-599c662b1682 None admin] PATH_INFO: `/v3/users/cdb375e2c7cc48f2aaa40b6a51f8c933` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:44.815743 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0fdc4f-f3ad-43b7-928d-599c662b1682 None admin] RBAC: Authorizing `identity:get_user(user_id=cdb375e2c7cc48f2aaa40b6a51f8c933)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:44.817260 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0fdc4f-f3ad-43b7-928d-599c662b1682 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:44.822067 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-63914bf2-db84-47db-8995-a36e2504ff41 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:04:44.823285 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-63914bf2-db84-47db-8995-a36e2504ff41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:04:44.823564 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 161/328] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Jul 4 09:04:44 2022] GET /identity/v3/users/cdb375e2c7cc48f2aaa40b6a51f8c933 => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:44.824835 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0fdc4f-f3ad-43b7-928d-599c662b1682 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:44.915604 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 168/329] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:04:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:04:44.924845 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:44.948599 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63914bf2-db84-47db-8995-a36e2504ff41 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:44.962330 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0fdc4f-f3ad-43b7-928d-599c662b1682 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:45.001061 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b002a5-7d9f-4301-a3c6-17fec11093a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:45.002276 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b002a5-7d9f-4301-a3c6-17fec11093a7 None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:45.002827 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b002a5-7d9f-4301-a3c6-17fec11093a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:45.003315 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b002a5-7d9f-4301-a3c6-17fec11093a7 None admin] PATH_INFO: `/v3/system/users/cdb375e2c7cc48f2aaa40b6a51f8c933/roles/a5112c31cfa1478db60e6079627603f6` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:45.005087 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b002a5-7d9f-4301-a3c6-17fec11093a7 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=cdb375e2c7cc48f2aaa40b6a51f8c933, role_id=a5112c31cfa1478db60e6079627603f6)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:45.006791 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b002a5-7d9f-4301-a3c6-17fec11093a7 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:45.022849 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 162/330] 10.222.0.42 () {58 vars in 1334 bytes} [Mon Jul 4 09:04:44 2022] PUT /identity/v3/system/users/cdb375e2c7cc48f2aaa40b6a51f8c933/roles/a5112c31cfa1478db60e6079627603f6 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:04:45.076089 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:45.080860 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63914bf2-db84-47db-8995-a36e2504ff41 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:45.122793 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c127a6f1-2cb7-4695-8cb8-9dc706892fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:45.124302 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c127a6f1-2cb7-4695-8cb8-9dc706892fc7 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:45.125088 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c127a6f1-2cb7-4695-8cb8-9dc706892fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:45.125834 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c127a6f1-2cb7-4695-8cb8-9dc706892fc7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:45.139576 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c127a6f1-2cb7-4695-8cb8-9dc706892fc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:04:45.148175 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-c127a6f1-2cb7-4695-8cb8-9dc706892fc7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:04:45.148175 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:04:45.148175 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:04:45.148175 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:04:45.148175 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:04:45.148175 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:04:45.148175 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:04:45.148175 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:04:45.148175 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:04:45.148175 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:04:45.148175 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:04:45.148175 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:04:45.148175 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:04:45.148175 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:04:45.148175 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:04:45.148175 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:04:45.149129 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:04:45.149129 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:04:45.149129 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:04:45.149129 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:04:45.149129 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:04:45.149129 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:04:45.149129 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:04:45.149129 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:04:45.149129 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:04:45.149129 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:04:45.149129 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:04:45.149129 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:04:45.149129 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:04:45.149129 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:04:45.149129 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:04:45.149129 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:04:45.149907 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:04:45.149907 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:04:45.149907 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:04:45.149907 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:04:45.149907 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:04:45.149907 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:04:45.149907 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:04:45.149907 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:04:45.149907 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:04:45.149907 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:04:45.149907 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:04:45.149907 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:04:45.152850 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 169/331] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jul 4 09:04:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:04:45.159172 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b002a5-7d9f-4301-a3c6-17fec11093a7 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:45.270681 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b002a5-7d9f-4301-a3c6-17fec11093a7 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:45.306431 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2a3b0e-4f06-42d7-a915-e64d0a8917b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:45.307458 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a3b0e-4f06-42d7-a915-e64d0a8917b7 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:45.307951 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a3b0e-4f06-42d7-a915-e64d0a8917b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:45.308418 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a3b0e-4f06-42d7-a915-e64d0a8917b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:45.309379 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2a3b0e-4f06-42d7-a915-e64d0a8917b7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:04:45.309868 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2a3b0e-4f06-42d7-a915-e64d0a8917b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:45.311460 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2a3b0e-4f06-42d7-a915-e64d0a8917b7 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:45.313242 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:45.324057 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 163/332] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Jul 4 09:04:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:45.327988 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c127a6f1-2cb7-4695-8cb8-9dc706892fc7 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:45.431382 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c127a6f1-2cb7-4695-8cb8-9dc706892fc7 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:45.465245 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8265a8-c19e-44be-a460-a061baafb79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:45.466499 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8265a8-c19e-44be-a460-a061baafb79b None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:45.466970 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8265a8-c19e-44be-a460-a061baafb79b None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:45.467452 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8265a8-c19e-44be-a460-a061baafb79b None admin] PATH_INFO: `/v3/users/ac70aa3794a24fdab5f21ac515fbbaea` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:45.468982 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8265a8-c19e-44be-a460-a061baafb79b None admin] RBAC: Authorizing `identity:get_user(user_id=ac70aa3794a24fdab5f21ac515fbbaea)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:45.470762 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8265a8-c19e-44be-a460-a061baafb79b None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:45.473241 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 170/333] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Jul 4 09:04:45 2022] GET /identity/v3/users/ac70aa3794a24fdab5f21ac515fbbaea => generated 293 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:45.479208 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2a3b0e-4f06-42d7-a915-e64d0a8917b7 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:45.584184 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2a3b0e-4f06-42d7-a915-e64d0a8917b7 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:45.626194 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4fee50-d929-4ac0-8e6d-25cd1d064c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:45.627187 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4fee50-d929-4ac0-8e6d-25cd1d064c7e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:45.627656 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4fee50-d929-4ac0-8e6d-25cd1d064c7e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:45.628135 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4fee50-d929-4ac0-8e6d-25cd1d064c7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:45.629172 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4fee50-d929-4ac0-8e6d-25cd1d064c7e None admin] RBAC: Adding query filter params (role.id=81634e7812344f84afcb29b0dba2687c, user.id=ac70aa3794a24fdab5f21ac515fbbaea, scope.system=all) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:04:45.629684 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4fee50-d929-4ac0-8e6d-25cd1d064c7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:45.631140 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4fee50-d929-4ac0-8e6d-25cd1d064c7e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:45.647612 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 164/334] 10.222.0.42 () {56 vars in 1308 bytes} [Mon Jul 4 09:04:45 2022] GET /identity/v3/role_assignments?user.id=ac70aa3794a24fdab5f21ac515fbbaea&scope.system=all&role.id=81634e7812344f84afcb29b0dba2687c => generated 510 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:47.136714 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d39b6-8d42-4e79-8e4e-c26cd5254f1d None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:47.137220 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d39b6-8d42-4e79-8e4e-c26cd5254f1d None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:47.137295 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d39b6-8d42-4e79-8e4e-c26cd5254f1d None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:47.138901 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 171/335] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:04:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:04:47.154111 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f904e85-829f-485b-a6a5-d193014d3b23 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:47.154686 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f904e85-829f-485b-a6a5-d193014d3b23 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:47.154686 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f904e85-829f-485b-a6a5-d193014d3b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:47.167328 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e83a92-1fc4-4202-9b2f-0cb3ef302187 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:47.167612 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e83a92-1fc4-4202-9b2f-0cb3ef302187 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:47.167906 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e83a92-1fc4-4202-9b2f-0cb3ef302187 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:47.169639 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 172/336] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:04:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:04:47.174806 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30330400-12ef-4395-a757-581769cb3396 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:47.175082 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30330400-12ef-4395-a757-581769cb3396 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:47.175353 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30330400-12ef-4395-a757-581769cb3396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:47.198648 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-2f904e85-829f-485b-a6a5-d193014d3b23 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:04:47.199889 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-2f904e85-829f-485b-a6a5-d193014d3b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:04:47.203181 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-30330400-12ef-4395-a757-581769cb3396 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:04:47.206969 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-30330400-12ef-4395-a757-581769cb3396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:04:47.258114 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:47.328790 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:47.373699 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 173/337] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:04:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 09:04:47.374082 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 165/338] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:04:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:04:47.417693 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30330400-12ef-4395-a757-581769cb3396 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:47.437437 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f904e85-829f-485b-a6a5-d193014d3b23 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:47.640120 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30330400-12ef-4395-a757-581769cb3396 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:47.662030 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f904e85-829f-485b-a6a5-d193014d3b23 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:47.683055 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606cfec3-20d3-4560-9010-ce4dd889cafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:47.683784 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606cfec3-20d3-4560-9010-ce4dd889cafa None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:47.684085 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606cfec3-20d3-4560-9010-ce4dd889cafa None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:47.684356 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606cfec3-20d3-4560-9010-ce4dd889cafa None admin] PATH_INFO: `/v3/roles/member` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:47.695446 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606cfec3-20d3-4560-9010-ce4dd889cafa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:04:47.703695 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-606cfec3-20d3-4560-9010-ce4dd889cafa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:04:47.703695 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:04:47.703695 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:04:47.703695 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:04:47.703695 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:04:47.703695 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:04:47.703695 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:04:47.703695 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:04:47.703695 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:04:47.703695 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:04:47.703695 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:04:47.703695 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:04:47.703695 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:04:47.703695 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:04:47.703695 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:04:47.703695 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:04:47.704631 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:04:47.704631 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:04:47.704631 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:04:47.704631 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:04:47.704631 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:04:47.704631 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:04:47.704631 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:04:47.704631 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:04:47.704631 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:04:47.704631 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:04:47.704631 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:04:47.704631 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:04:47.704631 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:04:47.704631 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:04:47.704631 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:04:47.704631 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:04:47.705860 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:04:47.705860 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:04:47.705860 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:04:47.705860 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:04:47.705860 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:04:47.705860 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:04:47.705860 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:04:47.705860 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:04:47.705860 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:04:47.705860 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:04:47.705860 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:04:47.705860 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:04:47.705860 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 174/339] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jul 4 09:04:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:04:47.707738 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f6ba1-5d27-4335-9d14-1db4c0b48285 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:47.707738 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f6ba1-5d27-4335-9d14-1db4c0b48285 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:47.707738 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f6ba1-5d27-4335-9d14-1db4c0b48285 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:47.708812 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 175/340] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:04:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:04:47.716337 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f6ba1-5d27-4335-9d14-1db4c0b48285 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:47.744278 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:47.744618 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f809ae70-94d3-4f51-9051-36cd23113d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:47.745465 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809ae70-94d3-4f51-9051-36cd23113d70 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:47.745751 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809ae70-94d3-4f51-9051-36cd23113d70 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:47.746025 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809ae70-94d3-4f51-9051-36cd23113d70 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:47.763674 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f809ae70-94d3-4f51-9051-36cd23113d70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:04:47.781046 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-f809ae70-94d3-4f51-9051-36cd23113d70 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 09:04:47.781046 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:04:47.781046 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:04:47.781046 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:04:47.781046 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:04:47.781046 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:04:47.781046 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:04:47.781046 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:04:47.781046 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:04:47.781046 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:04:47.781046 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:04:47.781046 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:04:47.781046 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:04:47.781046 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:04:47.781046 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:04:47.781046 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:04:47.781999 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:04:47.781999 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:04:47.781999 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:04:47.781999 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:04:47.781999 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:04:47.781999 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:04:47.781999 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:04:47.781999 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:04:47.781999 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:04:47.781999 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:04:47.781999 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:04:47.781999 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:04:47.781999 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:04:47.781999 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:04:47.781999 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:04:47.781999 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:04:47.782790 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:04:47.782790 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:04:47.782790 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:04:47.782790 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:04:47.782790 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:04:47.782790 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:04:47.782790 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:04:47.782790 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:04:47.782790 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:04:47.782790 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:04:47.782790 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 09:04:47.782790 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:04:47.785563 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 166/341] 10.222.0.42 () {56 vars in 1114 bytes} [Mon Jul 4 09:04:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:04:47.786814 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28435fab-08eb-456b-a013-e7109bfddced None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:47.787090 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28435fab-08eb-456b-a013-e7109bfddced None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:47.787360 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28435fab-08eb-456b-a013-e7109bfddced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:47.827981 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-28435fab-08eb-456b-a013-e7109bfddced None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:04:47.829391 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-28435fab-08eb-456b-a013-e7109bfddced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:04:47.873103 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f6ba1-5d27-4335-9d14-1db4c0b48285 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:47.934557 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:47.962663 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e869fe67-d08d-4ab6-a763-d86fa8891c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:47.963352 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e869fe67-d08d-4ab6-a763-d86fa8891c4a None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:47.963639 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e869fe67-d08d-4ab6-a763-d86fa8891c4a None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:47.963940 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e869fe67-d08d-4ab6-a763-d86fa8891c4a None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:47.964714 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e869fe67-d08d-4ab6-a763-d86fa8891c4a None admin] RBAC: Adding query filter params (name=member) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:04:47.965020 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e869fe67-d08d-4ab6-a763-d86fa8891c4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:47.967629 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e869fe67-d08d-4ab6-a763-d86fa8891c4a None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:47.988817 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 176/342] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Jul 4 09:04:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:47.989731 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e869fe67-d08d-4ab6-a763-d86fa8891c4a None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:47.994551 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 167/343] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:04:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:04:47.995420 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28435fab-08eb-456b-a013-e7109bfddced None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:48.120277 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:48.162094 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e869fe67-d08d-4ab6-a763-d86fa8891c4a None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:48.191110 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28435fab-08eb-456b-a013-e7109bfddced None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:48.233425 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7397cc-7212-4470-9d65-37b0fbdece6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:48.234429 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7397cc-7212-4470-9d65-37b0fbdece6f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:48.235002 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7397cc-7212-4470-9d65-37b0fbdece6f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:48.237758 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7397cc-7212-4470-9d65-37b0fbdece6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:48.258935 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a69185-4652-4d58-a800-f68e9ac05793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:48.259908 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a69185-4652-4d58-a800-f68e9ac05793 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:48.260285 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a69185-4652-4d58-a800-f68e9ac05793 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:48.260796 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a69185-4652-4d58-a800-f68e9ac05793 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:48.262316 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a69185-4652-4d58-a800-f68e9ac05793 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:04:48.263209 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a69185-4652-4d58-a800-f68e9ac05793 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:48.265340 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a69185-4652-4d58-a800-f68e9ac05793 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:48.279048 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 177/344] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jul 4 09:04:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:48.280353 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a69185-4652-4d58-a800-f68e9ac05793 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:48.291308 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:48.325876 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7397cc-7212-4470-9d65-37b0fbdece6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:48.327671 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7397cc-7212-4470-9d65-37b0fbdece6f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:48.440464 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 168/345] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jul 4 09:04:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:04:48.441803 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7397cc-7212-4470-9d65-37b0fbdece6f None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:48.487730 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a69185-4652-4d58-a800-f68e9ac05793 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:48.533537 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992c3a12-b8b8-4958-9a21-905fda76a8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:48.534504 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c3a12-b8b8-4958-9a21-905fda76a8c8 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:48.534794 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c3a12-b8b8-4958-9a21-905fda76a8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:48.535070 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c3a12-b8b8-4958-9a21-905fda76a8c8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:48.543672 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:48.545654 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:48.552747 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992c3a12-b8b8-4958-9a21-905fda76a8c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:04:48.560797 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-992c3a12-b8b8-4958-9a21-905fda76a8c8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:04:48.560797 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:04:48.560797 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:04:48.560797 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:04:48.560797 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:04:48.560797 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:04:48.560797 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:04:48.560797 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:04:48.560797 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:04:48.560797 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:04:48.560797 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:04:48.560797 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:04:48.560797 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:04:48.560797 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:04:48.560797 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:04:48.560797 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:04:48.561881 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:04:48.561881 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:04:48.561881 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:04:48.561881 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:04:48.561881 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:04:48.561881 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:04:48.561881 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:04:48.561881 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:04:48.561881 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:04:48.561881 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:04:48.561881 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:04:48.561881 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:04:48.561881 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:04:48.561881 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:04:48.561881 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:04:48.561881 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:04:48.562760 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:04:48.562760 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:04:48.562760 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:04:48.562760 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:04:48.562760 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:04:48.562760 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:04:48.562760 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:04:48.562760 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:04:48.562760 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:04:48.562760 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:04:48.562760 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:04:48.562760 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:04:48.565355 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 178/346] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jul 4 09:04:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:04:48.565585 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf032f58-851b-434d-b758-041419778e71 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:48.565869 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf032f58-851b-434d-b758-041419778e71 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:48.566142 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf032f58-851b-434d-b758-041419778e71 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:48.567599 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 179/347] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:04:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:04:48.572745 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf032f58-851b-434d-b758-041419778e71 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:48.583415 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7397cc-7212-4470-9d65-37b0fbdece6f None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:48.629342 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1127ad-a16e-44e1-ae07-82d3a602dd1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:48.630514 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1127ad-a16e-44e1-ae07-82d3a602dd1f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:48.631019 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1127ad-a16e-44e1-ae07-82d3a602dd1f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:48.631514 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1127ad-a16e-44e1-ae07-82d3a602dd1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:48.708870 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf032f58-851b-434d-b758-041419778e71 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:48.714260 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1127ad-a16e-44e1-ae07-82d3a602dd1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:48.716020 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1127ad-a16e-44e1-ae07-82d3a602dd1f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:48.750577 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d0aff-d295-46b6-b9a0-b73f633914f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:48.751444 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d0aff-d295-46b6-b9a0-b73f633914f5 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:48.751903 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d0aff-d295-46b6-b9a0-b73f633914f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:48.752326 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d0aff-d295-46b6-b9a0-b73f633914f5 None admin] PATH_INFO: `/v3/projects/4dd04e5b7dd24f0e8050b45d6060f68c` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:48.753638 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129d0aff-d295-46b6-b9a0-b73f633914f5 None admin] RBAC: Authorizing `identity:get_project(project_id=4dd04e5b7dd24f0e8050b45d6060f68c)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:48.755252 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129d0aff-d295-46b6-b9a0-b73f633914f5 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:48.757317 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 180/348] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jul 4 09:04:48 2022] GET /identity/v3/projects/4dd04e5b7dd24f0e8050b45d6060f68c => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:48.758320 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb26cf4-c3dd-4a53-87b6-404d6381fde2 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:48.759443 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb26cf4-c3dd-4a53-87b6-404d6381fde2 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:48.759986 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb26cf4-c3dd-4a53-87b6-404d6381fde2 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:48.761447 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 181/349] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:04:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:04:48.762722 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd172292-f0fb-4ba1-977c-975b31a792ac None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:48.763228 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd172292-f0fb-4ba1-977c-975b31a792ac None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:48.763507 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd172292-f0fb-4ba1-977c-975b31a792ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:48.782082 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-bd172292-f0fb-4ba1-977c-975b31a792ac None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:04:48.783922 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-bd172292-f0fb-4ba1-977c-975b31a792ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:04:48.819258 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:48.851198 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 169/350] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jul 4 09:04:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:04:48.852521 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1127ad-a16e-44e1-ae07-82d3a602dd1f None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:48.858790 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:48.868408 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 182/351] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:04:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:04:48.869258 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd172292-f0fb-4ba1-977c-975b31a792ac None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:48.976101 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1127ad-a16e-44e1-ae07-82d3a602dd1f None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:48.992655 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd172292-f0fb-4ba1-977c-975b31a792ac None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:49.023276 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c6335a-cd20-4c7d-89fd-1a4e86722086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:49.023979 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6335a-cd20-4c7d-89fd-1a4e86722086 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:49.024264 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6335a-cd20-4c7d-89fd-1a4e86722086 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:49.024726 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6335a-cd20-4c7d-89fd-1a4e86722086 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:49.025273 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c6335a-cd20-4c7d-89fd-1a4e86722086 None admin] RBAC: Adding query filter params (name=member) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:04:49.025577 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c6335a-cd20-4c7d-89fd-1a4e86722086 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:49.026971 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c6335a-cd20-4c7d-89fd-1a4e86722086 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:49.033932 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a2cfaa-4957-431f-a12a-4689cf5088ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:49.034794 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a2cfaa-4957-431f-a12a-4689cf5088ef None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:49.035075 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a2cfaa-4957-431f-a12a-4689cf5088ef None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:49.035372 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a2cfaa-4957-431f-a12a-4689cf5088ef None admin] PATH_INFO: `/v3/groups/bb530dfce3084a96b84f1e7008f90b1d` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:49.036496 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 170/352] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Jul 4 09:04:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:49.037722 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea5335-3542-4ba7-a130-c095a57fe5df None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:49.038234 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea5335-3542-4ba7-a130-c095a57fe5df None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:49.038507 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea5335-3542-4ba7-a130-c095a57fe5df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:49.042538 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a2cfaa-4957-431f-a12a-4689cf5088ef None admin] RBAC: Authorizing `identity:get_group(group_id=bb530dfce3084a96b84f1e7008f90b1d)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:49.044306 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a2cfaa-4957-431f-a12a-4689cf5088ef None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:49.047054 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 183/353] 10.222.0.42 () {56 vars in 1180 bytes} [Mon Jul 4 09:04:48 2022] GET /identity/v3/groups/bb530dfce3084a96b84f1e7008f90b1d => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:49.052446 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a2cfaa-4957-431f-a12a-4689cf5088ef None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:49.056941 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-2dea5335-3542-4ba7-a130-c095a57fe5df None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:04:49.058204 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-2dea5335-3542-4ba7-a130-c095a57fe5df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:04:49.092161 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:49.126048 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:49.137164 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 171/354] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:04:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:04:49.139517 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ebfcd2-1faa-415a-9653-946c0a40a868 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:49.140116 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ebfcd2-1faa-415a-9653-946c0a40a868 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:49.140397 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ebfcd2-1faa-415a-9653-946c0a40a868 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:49.141833 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 172/355] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:04:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:04:49.142709 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ebfcd2-1faa-415a-9653-946c0a40a868 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:49.178520 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a2cfaa-4957-431f-a12a-4689cf5088ef None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:49.225017 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70929d36-d6f9-423f-b76f-3b63e543226b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:49.225898 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70929d36-d6f9-423f-b76f-3b63e543226b None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:49.226221 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70929d36-d6f9-423f-b76f-3b63e543226b None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:49.227044 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70929d36-d6f9-423f-b76f-3b63e543226b None admin] PATH_INFO: `/v3/projects/4dd04e5b7dd24f0e8050b45d6060f68c` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:49.228170 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70929d36-d6f9-423f-b76f-3b63e543226b None admin] RBAC: Authorizing `identity:get_project(project_id=4dd04e5b7dd24f0e8050b45d6060f68c)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:49.229998 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70929d36-d6f9-423f-b76f-3b63e543226b None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:49.232810 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 184/356] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jul 4 09:04:49 2022] GET /identity/v3/projects/4dd04e5b7dd24f0e8050b45d6060f68c => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:49.234049 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70929d36-d6f9-423f-b76f-3b63e543226b None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:49.261572 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ebfcd2-1faa-415a-9653-946c0a40a868 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:49.304710 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d456c-cf73-4b79-8991-c8006469a7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:49.305703 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d456c-cf73-4b79-8991-c8006469a7de None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:49.305983 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d456c-cf73-4b79-8991-c8006469a7de None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:49.306251 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d456c-cf73-4b79-8991-c8006469a7de None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:49.319500 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5d456c-cf73-4b79-8991-c8006469a7de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:04:49.327664 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-3d5d456c-cf73-4b79-8991-c8006469a7de None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 09:04:49.327664 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:04:49.327664 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:04:49.327664 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:04:49.327664 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:04:49.327664 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:04:49.327664 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:04:49.327664 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:04:49.327664 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:04:49.327664 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:04:49.327664 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:04:49.327664 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:04:49.327664 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:04:49.327664 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:04:49.327664 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:04:49.327664 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:04:49.328658 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:04:49.328658 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:04:49.328658 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:04:49.328658 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:04:49.328658 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:04:49.328658 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:04:49.328658 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:04:49.328658 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:04:49.328658 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:04:49.328658 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:04:49.328658 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:04:49.328658 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:04:49.328658 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:04:49.328658 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:04:49.328658 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:04:49.328658 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:04:49.329469 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:04:49.329469 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:04:49.329469 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:04:49.329469 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:04:49.329469 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:04:49.329469 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:04:49.329469 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:04:49.329469 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:04:49.329469 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:04:49.329469 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:04:49.329469 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 09:04:49.329469 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:04:49.329469 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 173/357] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jul 4 09:04:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:04:49.330134 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d456c-cf73-4b79-8991-c8006469a7de None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:49.351490 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70929d36-d6f9-423f-b76f-3b63e543226b None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:49.361934 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:49.385214 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:49.394632 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0165e14b-5cdf-4661-930f-2ddc0dde01f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:49.395302 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0165e14b-5cdf-4661-930f-2ddc0dde01f1 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:49.396074 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0165e14b-5cdf-4661-930f-2ddc0dde01f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:49.396074 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0165e14b-5cdf-4661-930f-2ddc0dde01f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:49.450219 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d456c-cf73-4b79-8991-c8006469a7de None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:49.471202 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0165e14b-5cdf-4661-930f-2ddc0dde01f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:49.472723 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0165e14b-5cdf-4661-930f-2ddc0dde01f1 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:49.493041 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b79ca84-48b2-481d-ad9b-539139393430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:49.493597 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79ca84-48b2-481d-ad9b-539139393430 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:49.493876 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79ca84-48b2-481d-ad9b-539139393430 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:49.494147 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79ca84-48b2-481d-ad9b-539139393430 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:49.494987 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b79ca84-48b2-481d-ad9b-539139393430 None admin] RBAC: Adding query filter params (group.id=bb530dfce3084a96b84f1e7008f90b1d, role.id=81634e7812344f84afcb29b0dba2687c, scope.project.id=4dd04e5b7dd24f0e8050b45d6060f68c) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:04:49.495291 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b79ca84-48b2-481d-ad9b-539139393430 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:49.496862 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b79ca84-48b2-481d-ad9b-539139393430 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:49.504503 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 174/358] 10.222.0.42 () {56 vars in 1376 bytes} [Mon Jul 4 09:04:49 2022] GET /identity/v3/role_assignments?group.id=bb530dfce3084a96b84f1e7008f90b1d&scope.project.id=4dd04e5b7dd24f0e8050b45d6060f68c&role.id=81634e7812344f84afcb29b0dba2687c => generated 260 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:49.505711 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb5f0f-527d-44fa-99d6-b11666bc3f09 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:49.505998 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb5f0f-527d-44fa-99d6-b11666bc3f09 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:49.506275 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb5f0f-527d-44fa-99d6-b11666bc3f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:49.529828 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-5bbb5f0f-527d-44fa-99d6-b11666bc3f09 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:04:49.531460 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-5bbb5f0f-527d-44fa-99d6-b11666bc3f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:04:49.611500 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 185/359] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jul 4 09:04:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:04:49.612694 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0165e14b-5cdf-4661-930f-2ddc0dde01f1 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:49.633737 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 175/360] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:04:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:04:49.637321 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbb5f0f-527d-44fa-99d6-b11666bc3f09 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:49.655239 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:49.662695 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:49.739669 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0165e14b-5cdf-4661-930f-2ddc0dde01f1 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:49.769540 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbb5f0f-527d-44fa-99d6-b11666bc3f09 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:49.788691 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995b7c3b-21da-4057-92a0-41e89c549fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:49.789507 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995b7c3b-21da-4057-92a0-41e89c549fe3 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:49.789790 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995b7c3b-21da-4057-92a0-41e89c549fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:49.790062 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995b7c3b-21da-4057-92a0-41e89c549fe3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:49.806370 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bee474-e0a7-476a-a69e-6b288a37a421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:49.806897 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995b7c3b-21da-4057-92a0-41e89c549fe3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:04:49.807232 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bee474-e0a7-476a-a69e-6b288a37a421 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:49.807512 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bee474-e0a7-476a-a69e-6b288a37a421 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:49.807785 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bee474-e0a7-476a-a69e-6b288a37a421 None admin] PATH_INFO: `/v3/groups/bb530dfce3084a96b84f1e7008f90b1d` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:49.808984 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bee474-e0a7-476a-a69e-6b288a37a421 None admin] RBAC: Authorizing `identity:get_group(group_id=bb530dfce3084a96b84f1e7008f90b1d)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:49.810459 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bee474-e0a7-476a-a69e-6b288a37a421 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:49.815993 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 176/361] 10.222.0.42 () {56 vars in 1180 bytes} [Mon Jul 4 09:04:49 2022] GET /identity/v3/groups/bb530dfce3084a96b84f1e7008f90b1d => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:49.816796 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-995b7c3b-21da-4057-92a0-41e89c549fe3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 09:04:49.816796 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:04:49.816796 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:04:49.816796 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:04:49.816796 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:04:49.816796 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:04:49.816796 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:04:49.816796 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:04:49.816796 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:04:49.816796 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:04:49.816796 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:04:49.816796 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:04:49.816796 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:04:49.816796 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:04:49.816796 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:04:49.816796 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:04:49.817764 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:04:49.817764 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:04:49.817764 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:04:49.817764 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:04:49.817764 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:04:49.817764 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:04:49.817764 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:04:49.817764 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:04:49.817764 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:04:49.817764 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:04:49.817764 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:04:49.817764 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:04:49.817764 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:04:49.817764 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:04:49.817764 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:04:49.817764 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:04:49.818570 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:04:49.818570 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:04:49.818570 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:04:49.818570 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:04:49.818570 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:04:49.818570 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:04:49.818570 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:04:49.818570 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:04:49.818570 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:04:49.818570 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:04:49.818570 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 09:04:49.818570 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:04:49.819179 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bee474-e0a7-476a-a69e-6b288a37a421 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:49.820878 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 186/362] 10.222.0.42 () {56 vars in 1114 bytes} [Mon Jul 4 09:04:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:04:49.821826 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995b7c3b-21da-4057-92a0-41e89c549fe3 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:49.937836 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:49.938642 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:49.951266 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995b7c3b-21da-4057-92a0-41e89c549fe3 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:49.951950 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bee474-e0a7-476a-a69e-6b288a37a421 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:49.995258 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2be486-7e46-43fb-9730-c45473f5750f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:49.996170 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2be486-7e46-43fb-9730-c45473f5750f None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:49.996455 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2be486-7e46-43fb-9730-c45473f5750f None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:49.996733 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2be486-7e46-43fb-9730-c45473f5750f None admin] PATH_INFO: `/v3/projects/f1e246896b7b4569b9cea667ca2e1386` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:49.997569 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d0e80d-67af-43cf-9de3-0aff7a5f1b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:49.997924 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2be486-7e46-43fb-9730-c45473f5750f None admin] RBAC: Authorizing `identity:get_project(project_id=f1e246896b7b4569b9cea667ca2e1386)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:49.998237 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d0e80d-67af-43cf-9de3-0aff7a5f1b9f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:49.998515 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d0e80d-67af-43cf-9de3-0aff7a5f1b9f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:49.998786 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d0e80d-67af-43cf-9de3-0aff7a5f1b9f None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:49.999429 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2be486-7e46-43fb-9730-c45473f5750f None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:49.999602 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d0e80d-67af-43cf-9de3-0aff7a5f1b9f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:04:49.999910 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d0e80d-67af-43cf-9de3-0aff7a5f1b9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:50.001209 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 187/363] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jul 4 09:04:49 2022] GET /identity/v3/projects/f1e246896b7b4569b9cea667ca2e1386 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:50.001315 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d0e80d-67af-43cf-9de3-0aff7a5f1b9f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:50.004348 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2be486-7e46-43fb-9730-c45473f5750f None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:50.011247 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 177/364] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Jul 4 09:04:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:50.011681 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d0e80d-67af-43cf-9de3-0aff7a5f1b9f None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:50.129717 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d0e80d-67af-43cf-9de3-0aff7a5f1b9f None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:50.135803 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2be486-7e46-43fb-9730-c45473f5750f None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:50.171889 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe90ad3-24fc-489f-97fb-936bbcb97c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:50.172889 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe90ad3-24fc-489f-97fb-936bbcb97c0f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:50.173172 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe90ad3-24fc-489f-97fb-936bbcb97c0f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:50.173446 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe90ad3-24fc-489f-97fb-936bbcb97c0f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:50.174281 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe90ad3-24fc-489f-97fb-936bbcb97c0f None admin] RBAC: Adding query filter params (group.id=bb530dfce3084a96b84f1e7008f90b1d, role.id=157d1a80161e43a3ad84446eeca98e0b, scope.project.id=4dd04e5b7dd24f0e8050b45d6060f68c) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:04:50.174589 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe90ad3-24fc-489f-97fb-936bbcb97c0f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:50.176147 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe90ad3-24fc-489f-97fb-936bbcb97c0f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:50.182743 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 178/365] 10.222.0.42 () {56 vars in 1376 bytes} [Mon Jul 4 09:04:50 2022] GET /identity/v3/role_assignments?group.id=bb530dfce3084a96b84f1e7008f90b1d&scope.project.id=4dd04e5b7dd24f0e8050b45d6060f68c&role.id=157d1a80161e43a3ad84446eeca98e0b => generated 260 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:50.183542 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe90ad3-24fc-489f-97fb-936bbcb97c0f None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:50.183785 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09cedff-2be1-4134-92bd-e59b3a9dae78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:50.185183 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09cedff-2be1-4134-92bd-e59b3a9dae78 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:50.185669 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09cedff-2be1-4134-92bd-e59b3a9dae78 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:50.186141 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09cedff-2be1-4134-92bd-e59b3a9dae78 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:50.202040 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09cedff-2be1-4134-92bd-e59b3a9dae78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:04:50.209727 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:50.213853 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-a09cedff-2be1-4134-92bd-e59b3a9dae78 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:04:50.213853 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:04:50.213853 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:04:50.213853 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:04:50.213853 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:04:50.213853 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:04:50.213853 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:04:50.213853 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:04:50.213853 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:04:50.213853 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:04:50.213853 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:04:50.213853 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:04:50.213853 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:04:50.213853 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:04:50.213853 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:04:50.213853 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:04:50.214822 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:04:50.214822 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:04:50.214822 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:04:50.214822 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:04:50.214822 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:04:50.214822 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:04:50.214822 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:04:50.214822 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:04:50.214822 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:04:50.214822 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:04:50.214822 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:04:50.214822 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:04:50.214822 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:04:50.214822 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:04:50.214822 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:04:50.214822 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:04:50.215611 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:04:50.215611 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:04:50.215611 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:04:50.215611 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:04:50.215611 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:04:50.215611 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:04:50.215611 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:04:50.215611 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:04:50.215611 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:04:50.215611 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:04:50.215611 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:04:50.215611 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:04:50.223036 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 188/366] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Jul 4 09:04:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:04:50.223036 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09cedff-2be1-4134-92bd-e59b3a9dae78 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:50.250894 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:50.315087 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe90ad3-24fc-489f-97fb-936bbcb97c0f None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:50.355569 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1698074e-c2d3-4fe3-87e6-dd97f5422e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:50.356516 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1698074e-c2d3-4fe3-87e6-dd97f5422e78 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:50.356626 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1698074e-c2d3-4fe3-87e6-dd97f5422e78 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:50.356829 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1698074e-c2d3-4fe3-87e6-dd97f5422e78 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:50.358850 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1698074e-c2d3-4fe3-87e6-dd97f5422e78 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:04:50.358850 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1698074e-c2d3-4fe3-87e6-dd97f5422e78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:50.359806 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1698074e-c2d3-4fe3-87e6-dd97f5422e78 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:50.371066 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 179/367] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jul 4 09:04:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:50.371954 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1698074e-c2d3-4fe3-87e6-dd97f5422e78 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:50.377804 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09cedff-2be1-4134-92bd-e59b3a9dae78 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:50.413438 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46206a2-cb80-43c7-b6b8-0e5ea8c7cebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:50.414524 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46206a2-cb80-43c7-b6b8-0e5ea8c7cebf None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:50.414966 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46206a2-cb80-43c7-b6b8-0e5ea8c7cebf None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:50.415438 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46206a2-cb80-43c7-b6b8-0e5ea8c7cebf None admin] PATH_INFO: `/v3/groups/bb530dfce3084a96b84f1e7008f90b1d` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:50.417383 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46206a2-cb80-43c7-b6b8-0e5ea8c7cebf None admin] RBAC: Authorizing `identity:get_group(group_id=bb530dfce3084a96b84f1e7008f90b1d)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:50.419026 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46206a2-cb80-43c7-b6b8-0e5ea8c7cebf None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:50.425798 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 189/368] 10.222.0.42 () {56 vars in 1180 bytes} [Mon Jul 4 09:04:50 2022] GET /identity/v3/groups/bb530dfce3084a96b84f1e7008f90b1d => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:50.426855 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46206a2-cb80-43c7-b6b8-0e5ea8c7cebf None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:50.459833 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:50.484932 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1698074e-c2d3-4fe3-87e6-dd97f5422e78 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:50.516824 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:50.523529 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eb609e-f352-4741-a11b-0614fac8b462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:50.524949 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb609e-f352-4741-a11b-0614fac8b462 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:50.525818 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb609e-f352-4741-a11b-0614fac8b462 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:50.526586 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb609e-f352-4741-a11b-0614fac8b462 None admin] PATH_INFO: `/v3/users/cdb375e2c7cc48f2aaa40b6a51f8c933` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:50.528682 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eb609e-f352-4741-a11b-0614fac8b462 None admin] RBAC: Authorizing `identity:get_user(user_id=cdb375e2c7cc48f2aaa40b6a51f8c933)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:50.530939 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eb609e-f352-4741-a11b-0614fac8b462 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:50.533775 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 180/369] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Jul 4 09:04:50 2022] GET /identity/v3/users/cdb375e2c7cc48f2aaa40b6a51f8c933 => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:50.534833 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eb609e-f352-4741-a11b-0614fac8b462 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:50.536269 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46206a2-cb80-43c7-b6b8-0e5ea8c7cebf None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:50.580043 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb283cb1-b783-43ca-8946-6983517aa82c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:50.580718 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb283cb1-b783-43ca-8946-6983517aa82c None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:50.581003 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb283cb1-b783-43ca-8946-6983517aa82c None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:50.581282 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb283cb1-b783-43ca-8946-6983517aa82c None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:50.582295 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb283cb1-b783-43ca-8946-6983517aa82c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:04:50.582606 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb283cb1-b783-43ca-8946-6983517aa82c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:50.585219 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb283cb1-b783-43ca-8946-6983517aa82c None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:50.601780 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 190/370] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jul 4 09:04:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:50.603049 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb283cb1-b783-43ca-8946-6983517aa82c None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:50.676927 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eb609e-f352-4741-a11b-0614fac8b462 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:50.714115 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb283cb1-b783-43ca-8946-6983517aa82c None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:50.726959 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dbfa61-98e1-4c63-8eeb-dec39390c1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:50.727906 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dbfa61-98e1-4c63-8eeb-dec39390c1eb None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:50.728198 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dbfa61-98e1-4c63-8eeb-dec39390c1eb None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:50.728477 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dbfa61-98e1-4c63-8eeb-dec39390c1eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:50.748863 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:50.752763 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7eb6ad-f3d0-421a-8b1f-e8f8c79d8a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:50.753701 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7eb6ad-f3d0-421a-8b1f-e8f8c79d8a60 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:50.754189 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7eb6ad-f3d0-421a-8b1f-e8f8c79d8a60 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:50.754685 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7eb6ad-f3d0-421a-8b1f-e8f8c79d8a60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:50.755714 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7eb6ad-f3d0-421a-8b1f-e8f8c79d8a60 None admin] RBAC: Adding query filter params (group.id=bb530dfce3084a96b84f1e7008f90b1d, role.id=81634e7812344f84afcb29b0dba2687c, scope.project.id=f1e246896b7b4569b9cea667ca2e1386) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:04:50.756297 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7eb6ad-f3d0-421a-8b1f-e8f8c79d8a60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:50.757961 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7eb6ad-f3d0-421a-8b1f-e8f8c79d8a60 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:50.763964 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 191/371] 10.222.0.42 () {56 vars in 1376 bytes} [Mon Jul 4 09:04:50 2022] GET /identity/v3/role_assignments?group.id=bb530dfce3084a96b84f1e7008f90b1d&scope.project.id=f1e246896b7b4569b9cea667ca2e1386&role.id=81634e7812344f84afcb29b0dba2687c => generated 260 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:50.773359 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7eb6ad-f3d0-421a-8b1f-e8f8c79d8a60 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:50.799172 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:50.814946 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dbfa61-98e1-4c63-8eeb-dec39390c1eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:50.815931 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dbfa61-98e1-4c63-8eeb-dec39390c1eb None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:50.942800 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 181/372] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jul 4 09:04:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:04:50.943721 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dbfa61-98e1-4c63-8eeb-dec39390c1eb None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:50.998006 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:51.026903 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7eb6ad-f3d0-421a-8b1f-e8f8c79d8a60 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:51.073873 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fef1c3f-ea13-45b6-95b0-d813e03c1f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:51.074727 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fef1c3f-ea13-45b6-95b0-d813e03c1f99 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:51.076154 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fef1c3f-ea13-45b6-95b0-d813e03c1f99 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:51.076154 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fef1c3f-ea13-45b6-95b0-d813e03c1f99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:51.078136 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fef1c3f-ea13-45b6-95b0-d813e03c1f99 None admin] RBAC: Adding query filter params (role.id=a5112c31cfa1478db60e6079627603f6, user.id=cdb375e2c7cc48f2aaa40b6a51f8c933, scope.system=all) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:04:51.080122 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dbfa61-98e1-4c63-8eeb-dec39390c1eb None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:51.080649 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fef1c3f-ea13-45b6-95b0-d813e03c1f99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:51.082274 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fef1c3f-ea13-45b6-95b0-d813e03c1f99 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:51.107655 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 192/373] 10.222.0.42 () {56 vars in 1308 bytes} [Mon Jul 4 09:04:50 2022] GET /identity/v3/role_assignments?user.id=cdb375e2c7cc48f2aaa40b6a51f8c933&scope.system=all&role.id=a5112c31cfa1478db60e6079627603f6 => generated 510 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:51.108796 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fef1c3f-ea13-45b6-95b0-d813e03c1f99 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:51.182023 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18e6827-ca86-4845-9b3e-afef12d2cbc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:51.182686 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e6827-ca86-4845-9b3e-afef12d2cbc7 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:51.183235 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e6827-ca86-4845-9b3e-afef12d2cbc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:51.183235 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e6827-ca86-4845-9b3e-afef12d2cbc7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:51.198845 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:51.237239 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fef1c3f-ea13-45b6-95b0-d813e03c1f99 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:51.280349 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6141704e-6707-4a80-9e65-0f780f74c9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:51.280349 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6141704e-6707-4a80-9e65-0f780f74c9f2 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:51.280349 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6141704e-6707-4a80-9e65-0f780f74c9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:51.280349 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6141704e-6707-4a80-9e65-0f780f74c9f2 None admin] PATH_INFO: `/v3/projects/f1e246896b7b4569b9cea667ca2e1386` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:51.282018 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6141704e-6707-4a80-9e65-0f780f74c9f2 None admin] RBAC: Authorizing `identity:get_project(project_id=f1e246896b7b4569b9cea667ca2e1386)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:51.285724 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6141704e-6707-4a80-9e65-0f780f74c9f2 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:51.287486 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 193/374] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jul 4 09:04:51 2022] GET /identity/v3/projects/f1e246896b7b4569b9cea667ca2e1386 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:51.299061 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6141704e-6707-4a80-9e65-0f780f74c9f2 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:51.349378 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18e6827-ca86-4845-9b3e-afef12d2cbc7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:51.350905 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18e6827-ca86-4845-9b3e-afef12d2cbc7 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:51.447905 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:51.486946 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6141704e-6707-4a80-9e65-0f780f74c9f2 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:51.546031 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 182/375] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jul 4 09:04:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 603 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:04:51.546708 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f9d972-0a41-4d53-9f49-92240fee8f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:51.547583 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f9d972-0a41-4d53-9f49-92240fee8f4a None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:51.547861 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f9d972-0a41-4d53-9f49-92240fee8f4a None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:51.548157 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f9d972-0a41-4d53-9f49-92240fee8f4a None admin] PATH_INFO: `/v3/groups/bb530dfce3084a96b84f1e7008f90b1d` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:51.549369 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f9d972-0a41-4d53-9f49-92240fee8f4a None admin] RBAC: Authorizing `identity:get_group(group_id=bb530dfce3084a96b84f1e7008f90b1d)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:51.550823 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f9d972-0a41-4d53-9f49-92240fee8f4a None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:51.553125 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18e6827-ca86-4845-9b3e-afef12d2cbc7 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:51.556320 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 194/376] 10.222.0.42 () {56 vars in 1180 bytes} [Mon Jul 4 09:04:51 2022] GET /identity/v3/groups/bb530dfce3084a96b84f1e7008f90b1d => generated 226 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:51.563375 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f9d972-0a41-4d53-9f49-92240fee8f4a None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:51.577982 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:51.739628 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f9d972-0a41-4d53-9f49-92240fee8f4a None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:51.740943 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18e6827-ca86-4845-9b3e-afef12d2cbc7 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:51.778889 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91ee365-7b7d-4663-ac6d-e8412e03216f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:51.779553 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ee365-7b7d-4663-ac6d-e8412e03216f None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:51.779837 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ee365-7b7d-4663-ac6d-e8412e03216f None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:51.780141 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ee365-7b7d-4663-ac6d-e8412e03216f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:51.781015 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91ee365-7b7d-4663-ac6d-e8412e03216f None admin] RBAC: Adding query filter params (group.id=bb530dfce3084a96b84f1e7008f90b1d, role.id=157d1a80161e43a3ad84446eeca98e0b, scope.project.id=f1e246896b7b4569b9cea667ca2e1386) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:04:51.781325 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91ee365-7b7d-4663-ac6d-e8412e03216f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:51.782799 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91ee365-7b7d-4663-ac6d-e8412e03216f None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:51.788136 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9175a8fb-89b8-48d8-a0a6-8607124d88ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:51.789012 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175a8fb-89b8-48d8-a0a6-8607124d88ac None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:51.789292 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175a8fb-89b8-48d8-a0a6-8607124d88ac None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:51.789563 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175a8fb-89b8-48d8-a0a6-8607124d88ac None admin] PATH_INFO: `/v3/projects/bd20857aebd945c0a3035c21bf5f767e` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:51.790769 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 195/377] 10.222.0.42 () {56 vars in 1376 bytes} [Mon Jul 4 09:04:51 2022] GET /identity/v3/role_assignments?group.id=bb530dfce3084a96b84f1e7008f90b1d&scope.project.id=f1e246896b7b4569b9cea667ca2e1386&role.id=157d1a80161e43a3ad84446eeca98e0b => generated 260 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:04:51.791425 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9175a8fb-89b8-48d8-a0a6-8607124d88ac None admin] RBAC: Authorizing `identity:get_project(project_id=bd20857aebd945c0a3035c21bf5f767e)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:51.792514 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc8930-99b1-4e18-b060-7c8d761f4d5c None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:51.792929 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9175a8fb-89b8-48d8-a0a6-8607124d88ac None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:51.793192 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc8930-99b1-4e18-b060-7c8d761f4d5c None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:51.793672 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc8930-99b1-4e18-b060-7c8d761f4d5c None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:51.794982 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 183/378] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jul 4 09:04:51 2022] GET /identity/v3/projects/bd20857aebd945c0a3035c21bf5f767e => generated 344 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:04:51.795417 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 196/379] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:04:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:04:51.800662 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9175a8fb-89b8-48d8-a0a6-8607124d88ac None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:51.801895 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd752bb-dc8f-4c1b-8197-054cc868436b None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:51.802401 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd752bb-dc8f-4c1b-8197-054cc868436b None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:51.802865 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd752bb-dc8f-4c1b-8197-054cc868436b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:51.817445 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:51.837417 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-6fd752bb-dc8f-4c1b-8197-054cc868436b None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:04:51.838391 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-6fd752bb-dc8f-4c1b-8197-054cc868436b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:04:51.917403 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9175a8fb-89b8-48d8-a0a6-8607124d88ac None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:51.942457 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:51.957060 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 197/380] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:04:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:04:51.959298 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eb18f9-39ab-434d-aa08-caf61e3251a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:51.960345 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb18f9-39ab-434d-aa08-caf61e3251a6 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:51.960636 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb18f9-39ab-434d-aa08-caf61e3251a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:51.960984 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb18f9-39ab-434d-aa08-caf61e3251a6 None admin] PATH_INFO: `/v3/groups/a83536b1de544ba1a8312777656bdc2f` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:51.969371 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eb18f9-39ab-434d-aa08-caf61e3251a6 None admin] RBAC: Authorizing `identity:get_group(group_id=a83536b1de544ba1a8312777656bdc2f)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:51.970952 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eb18f9-39ab-434d-aa08-caf61e3251a6 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:51.973117 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 184/381] 10.222.0.42 () {56 vars in 1180 bytes} [Mon Jul 4 09:04:51 2022] GET /identity/v3/groups/a83536b1de544ba1a8312777656bdc2f => generated 229 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:51.979472 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd752bb-dc8f-4c1b-8197-054cc868436b None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:51.990972 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eb18f9-39ab-434d-aa08-caf61e3251a6 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:52.101641 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:52.112276 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd752bb-dc8f-4c1b-8197-054cc868436b None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:52.130812 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eb18f9-39ab-434d-aa08-caf61e3251a6 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:52.152875 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b44a0-bb8d-498f-9c04-1998a7ab8bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:52.153918 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b44a0-bb8d-498f-9c04-1998a7ab8bc3 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:52.154391 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b44a0-bb8d-498f-9c04-1998a7ab8bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:52.154849 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b44a0-bb8d-498f-9c04-1998a7ab8bc3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:52.156124 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7b44a0-bb8d-498f-9c04-1998a7ab8bc3 None admin] RBAC: Adding query filter params (group.id=a83536b1de544ba1a8312777656bdc2f, role.id=965049e7ce6144aaad23c15f3a5e37c3, scope.project.id=bd20857aebd945c0a3035c21bf5f767e) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:04:52.156679 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7b44a0-bb8d-498f-9c04-1998a7ab8bc3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:52.158322 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7b44a0-bb8d-498f-9c04-1998a7ab8bc3 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:52.168047 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 198/382] 10.222.0.42 () {56 vars in 1376 bytes} [Mon Jul 4 09:04:51 2022] GET /identity/v3/role_assignments?group.id=a83536b1de544ba1a8312777656bdc2f&scope.project.id=bd20857aebd945c0a3035c21bf5f767e&role.id=965049e7ce6144aaad23c15f3a5e37c3 => generated 260 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:52.178487 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883ed900-7e1d-4947-9f01-fc2481427f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:52.179661 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ed900-7e1d-4947-9f01-fc2481427f09 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:52.180178 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ed900-7e1d-4947-9f01-fc2481427f09 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:52.180641 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ed900-7e1d-4947-9f01-fc2481427f09 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:52.201058 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883ed900-7e1d-4947-9f01-fc2481427f09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:04:52.209577 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-883ed900-7e1d-4947-9f01-fc2481427f09 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:04:52.209577 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:04:52.209577 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:04:52.209577 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:04:52.209577 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:04:52.209577 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:04:52.209577 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:04:52.209577 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:04:52.209577 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:04:52.209577 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:04:52.209577 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:04:52.209577 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:04:52.209577 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:04:52.209577 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:04:52.209577 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:04:52.209577 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:04:52.210533 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:04:52.210533 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:04:52.210533 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:04:52.210533 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:04:52.210533 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:04:52.210533 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:04:52.210533 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:04:52.210533 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:04:52.210533 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:04:52.210533 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:04:52.210533 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:04:52.210533 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:04:52.210533 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:04:52.210533 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:04:52.210533 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:04:52.210533 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:04:52.211305 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:04:52.211305 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:04:52.211305 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:04:52.211305 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:04:52.211305 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:04:52.211305 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:04:52.211305 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:04:52.211305 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:04:52.211305 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:04:52.211305 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:04:52.211305 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:04:52.211305 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:04:52.214205 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 185/383] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jul 4 09:04:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:04:52.220074 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b44a0-bb8d-498f-9c04-1998a7ab8bc3 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:52.293472 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:52.333946 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b44a0-bb8d-498f-9c04-1998a7ab8bc3 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:52.373811 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2999d84d-7c57-4ae4-b7b5-2102491bd89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:52.374919 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999d84d-7c57-4ae4-b7b5-2102491bd89d None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:52.375428 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999d84d-7c57-4ae4-b7b5-2102491bd89d None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:52.375930 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999d84d-7c57-4ae4-b7b5-2102491bd89d None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:52.376893 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2999d84d-7c57-4ae4-b7b5-2102491bd89d None admin] RBAC: Adding query filter params (name=member) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:04:52.377391 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2999d84d-7c57-4ae4-b7b5-2102491bd89d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:52.378992 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2999d84d-7c57-4ae4-b7b5-2102491bd89d None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:52.390375 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 199/384] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Jul 4 09:04:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:52.396238 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883ed900-7e1d-4947-9f01-fc2481427f09 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:52.509870 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883ed900-7e1d-4947-9f01-fc2481427f09 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:52.552650 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4af629-894b-4dfe-b794-4048f0c9c881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:52.553860 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4af629-894b-4dfe-b794-4048f0c9c881 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:52.554352 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4af629-894b-4dfe-b794-4048f0c9c881 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:52.554815 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4af629-894b-4dfe-b794-4048f0c9c881 None admin] PATH_INFO: `/v3/groups/bb530dfce3084a96b84f1e7008f90b1d` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:52.556366 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4af629-894b-4dfe-b794-4048f0c9c881 None admin] RBAC: Authorizing `identity:get_group(group_id=bb530dfce3084a96b84f1e7008f90b1d)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:52.558026 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4af629-894b-4dfe-b794-4048f0c9c881 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:52.560184 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 186/385] 10.222.0.42 () {56 vars in 1180 bytes} [Mon Jul 4 09:04:52 2022] GET /identity/v3/groups/bb530dfce3084a96b84f1e7008f90b1d => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:52.565554 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2999d84d-7c57-4ae4-b7b5-2102491bd89d None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:52.584523 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaeb163-c2c1-4b1b-ab15-6ccd0ceb44b6 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:52.585145 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaeb163-c2c1-4b1b-ab15-6ccd0ceb44b6 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:52.585606 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaeb163-c2c1-4b1b-ab15-6ccd0ceb44b6 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:52.587264 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 187/386] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:04:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:04:52.592990 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6bc760-ae56-4f0d-8afe-55a1f7ab43fe None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:52.593506 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6bc760-ae56-4f0d-8afe-55a1f7ab43fe None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:52.593943 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6bc760-ae56-4f0d-8afe-55a1f7ab43fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:52.605027 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:52.621188 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-fa6bc760-ae56-4f0d-8afe-55a1f7ab43fe None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:04:52.623213 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-fa6bc760-ae56-4f0d-8afe-55a1f7ab43fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:04:52.747511 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2999d84d-7c57-4ae4-b7b5-2102491bd89d None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:52.751954 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 188/387] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:04:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 09:04:52.784268 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:52.789591 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6bc760-ae56-4f0d-8afe-55a1f7ab43fe None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:52.792253 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf69856-563b-4648-8bac-c7a60b48b735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:52.793501 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf69856-563b-4648-8bac-c7a60b48b735 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:52.794039 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf69856-563b-4648-8bac-c7a60b48b735 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:52.794324 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf69856-563b-4648-8bac-c7a60b48b735 None admin] PATH_INFO: `/v3/projects/4dd04e5b7dd24f0e8050b45d6060f68c` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:52.799592 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf69856-563b-4648-8bac-c7a60b48b735 None admin] RBAC: Authorizing `identity:get_project(project_id=4dd04e5b7dd24f0e8050b45d6060f68c)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:52.801111 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf69856-563b-4648-8bac-c7a60b48b735 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:52.803223 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 200/388] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jul 4 09:04:52 2022] GET /identity/v3/projects/4dd04e5b7dd24f0e8050b45d6060f68c => generated 298 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:04:52.808953 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf69856-563b-4648-8bac-c7a60b48b735 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:52.974743 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6bc760-ae56-4f0d-8afe-55a1f7ab43fe None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:52.999606 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf69856-563b-4648-8bac-c7a60b48b735 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:53.033893 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e222e1a-2b03-49da-b01c-d911ee323995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:53.034710 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e222e1a-2b03-49da-b01c-d911ee323995 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:53.034992 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e222e1a-2b03-49da-b01c-d911ee323995 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:53.035263 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e222e1a-2b03-49da-b01c-d911ee323995 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:53.037307 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:53.049498 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e222e1a-2b03-49da-b01c-d911ee323995 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:04:53.058417 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-7e222e1a-2b03-49da-b01c-d911ee323995 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 09:04:53.058417 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:04:53.058417 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:04:53.058417 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:04:53.058417 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:04:53.058417 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:04:53.058417 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:04:53.058417 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:04:53.058417 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:04:53.058417 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:04:53.058417 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:04:53.058417 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:04:53.058417 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:04:53.058417 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:04:53.058417 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:04:53.058417 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:04:53.059284 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:04:53.059284 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:04:53.059284 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:04:53.059284 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:04:53.059284 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:04:53.059284 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:04:53.059284 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:04:53.059284 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:04:53.059284 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:04:53.059284 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:04:53.059284 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:04:53.059284 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:04:53.059284 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:04:53.059284 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:04:53.059284 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:04:53.059284 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:04:53.060440 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:04:53.060440 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:04:53.060440 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:04:53.060440 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:04:53.060440 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:04:53.060440 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:04:53.060440 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:04:53.060440 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:04:53.060440 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:04:53.060440 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:04:53.060440 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 09:04:53.060440 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:04:53.060440 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 189/389] 10.222.0.42 () {56 vars in 1114 bytes} [Mon Jul 4 09:04:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:04:53.065878 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e222e1a-2b03-49da-b01c-d911ee323995 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:53.088605 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b39607c-fb91-4937-a3fb-e90d0611a927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:53.089494 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b39607c-fb91-4937-a3fb-e90d0611a927 None admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:53.089771 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b39607c-fb91-4937-a3fb-e90d0611a927 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:53.090041 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b39607c-fb91-4937-a3fb-e90d0611a927 None admin] PATH_INFO: `/v3/projects/4dd04e5b7dd24f0e8050b45d6060f68c/groups/bb530dfce3084a96b84f1e7008f90b1d/roles/81634e7812344f84afcb29b0dba2687c` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:53.095044 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b39607c-fb91-4937-a3fb-e90d0611a927 None admin] RBAC: Authorizing `identity:create_grant(project_id=4dd04e5b7dd24f0e8050b45d6060f68c, group_id=bb530dfce3084a96b84f1e7008f90b1d, role_id=81634e7812344f84afcb29b0dba2687c)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:53.096560 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b39607c-fb91-4937-a3fb-e90d0611a927 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:53.119484 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 201/390] 10.222.0.42 () {58 vars in 1442 bytes} [Mon Jul 4 09:04:52 2022] PUT /identity/v3/projects/4dd04e5b7dd24f0e8050b45d6060f68c/groups/bb530dfce3084a96b84f1e7008f90b1d/roles/81634e7812344f84afcb29b0dba2687c => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:04:53.206400 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e222e1a-2b03-49da-b01c-d911ee323995 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:53.257889 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c1d420-2837-4e29-a449-74a1eff32a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:53.258630 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c1d420-2837-4e29-a449-74a1eff32a40 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:53.258992 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c1d420-2837-4e29-a449-74a1eff32a40 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:53.259271 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c1d420-2837-4e29-a449-74a1eff32a40 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:53.260090 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c1d420-2837-4e29-a449-74a1eff32a40 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:04:53.260407 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c1d420-2837-4e29-a449-74a1eff32a40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:53.262064 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c1d420-2837-4e29-a449-74a1eff32a40 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:53.272820 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 190/391] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jul 4 09:04:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:53.278373 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b39607c-fb91-4937-a3fb-e90d0611a927 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:53.368069 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:53.415109 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b39607c-fb91-4937-a3fb-e90d0611a927 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:53.452740 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e2801a-8a61-41eb-aa3d-2236c18417f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:53.453979 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2801a-8a61-41eb-aa3d-2236c18417f2 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:53.454470 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2801a-8a61-41eb-aa3d-2236c18417f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:53.454948 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2801a-8a61-41eb-aa3d-2236c18417f2 None admin] PATH_INFO: `/v3/groups/bb530dfce3084a96b84f1e7008f90b1d` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:53.456357 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e2801a-8a61-41eb-aa3d-2236c18417f2 None admin] RBAC: Authorizing `identity:get_group(group_id=bb530dfce3084a96b84f1e7008f90b1d)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:53.458038 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e2801a-8a61-41eb-aa3d-2236c18417f2 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:53.460246 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 202/392] 10.222.0.42 () {56 vars in 1180 bytes} [Mon Jul 4 09:04:53 2022] GET /identity/v3/groups/bb530dfce3084a96b84f1e7008f90b1d => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:53.466175 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c1d420-2837-4e29-a449-74a1eff32a40 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:53.533230 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:53.589414 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c1d420-2837-4e29-a449-74a1eff32a40 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:53.615054 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512254d-4856-4d5c-8458-b0b70678f4e4 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:53.615712 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512254d-4856-4d5c-8458-b0b70678f4e4 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:53.616233 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512254d-4856-4d5c-8458-b0b70678f4e4 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:53.617888 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 203/393] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:04:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:04:53.623635 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7981dd-df20-45bc-b345-49ec5b21d362 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:53.623986 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7981dd-df20-45bc-b345-49ec5b21d362 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:53.624212 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7981dd-df20-45bc-b345-49ec5b21d362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:53.649866 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed19ccf-b3d9-4f8d-93b0-a3a21b73038c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:53.651127 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed19ccf-b3d9-4f8d-93b0-a3a21b73038c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:53.651614 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed19ccf-b3d9-4f8d-93b0-a3a21b73038c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:53.652117 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed19ccf-b3d9-4f8d-93b0-a3a21b73038c None admin] PATH_INFO: `/v3/projects/4dd04e5b7dd24f0e8050b45d6060f68c` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:53.652319 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-dd7981dd-df20-45bc-b345-49ec5b21d362 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:04:53.653513 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-dd7981dd-df20-45bc-b345-49ec5b21d362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:04:53.654054 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed19ccf-b3d9-4f8d-93b0-a3a21b73038c None admin] RBAC: Authorizing `identity:get_project(project_id=4dd04e5b7dd24f0e8050b45d6060f68c)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:53.655783 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed19ccf-b3d9-4f8d-93b0-a3a21b73038c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:53.658093 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 191/394] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jul 4 09:04:53 2022] GET /identity/v3/projects/4dd04e5b7dd24f0e8050b45d6060f68c => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:53.664839 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed19ccf-b3d9-4f8d-93b0-a3a21b73038c None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:53.778407 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 204/395] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:04:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 09:04:53.799738 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed19ccf-b3d9-4f8d-93b0-a3a21b73038c None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:53.812933 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7981dd-df20-45bc-b345-49ec5b21d362 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:53.835553 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:53.853540 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc596ce-9829-49bd-a2b4-fda7f4d43c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:53.854431 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc596ce-9829-49bd-a2b4-fda7f4d43c83 None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:53.854707 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc596ce-9829-49bd-a2b4-fda7f4d43c83 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:53.854976 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc596ce-9829-49bd-a2b4-fda7f4d43c83 None admin] PATH_INFO: `/v3/projects/4dd04e5b7dd24f0e8050b45d6060f68c/groups/bb530dfce3084a96b84f1e7008f90b1d/roles/157d1a80161e43a3ad84446eeca98e0b` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:53.862391 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc596ce-9829-49bd-a2b4-fda7f4d43c83 None admin] RBAC: Authorizing `identity:create_grant(project_id=4dd04e5b7dd24f0e8050b45d6060f68c, group_id=bb530dfce3084a96b84f1e7008f90b1d, role_id=157d1a80161e43a3ad84446eeca98e0b)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:53.864005 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc596ce-9829-49bd-a2b4-fda7f4d43c83 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:53.888801 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 192/396] 10.222.0.42 () {58 vars in 1442 bytes} [Mon Jul 4 09:04:53 2022] PUT /identity/v3/projects/4dd04e5b7dd24f0e8050b45d6060f68c/groups/bb530dfce3084a96b84f1e7008f90b1d/roles/157d1a80161e43a3ad84446eeca98e0b => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:04:53.903685 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:53.978398 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7981dd-df20-45bc-b345-49ec5b21d362 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:54.028532 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56228f33-f56e-4c27-96a6-0d51a351d5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:54.029781 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56228f33-f56e-4c27-96a6-0d51a351d5d6 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:54.030303 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56228f33-f56e-4c27-96a6-0d51a351d5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:54.030793 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56228f33-f56e-4c27-96a6-0d51a351d5d6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:54.047557 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56228f33-f56e-4c27-96a6-0d51a351d5d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:04:54.055933 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-56228f33-f56e-4c27-96a6-0d51a351d5d6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:04:54.055933 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:04:54.055933 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:04:54.055933 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:04:54.055933 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:04:54.055933 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:04:54.055933 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:04:54.055933 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:04:54.055933 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:04:54.055933 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:04:54.055933 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:04:54.055933 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:04:54.055933 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:04:54.055933 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:04:54.055933 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:04:54.055933 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:04:54.057044 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:04:54.057044 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:04:54.057044 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:04:54.057044 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:04:54.057044 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:04:54.057044 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:04:54.057044 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:04:54.057044 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:04:54.057044 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:04:54.057044 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:04:54.057044 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:04:54.057044 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:04:54.057044 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:04:54.057044 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:04:54.057044 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:04:54.057044 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:04:54.057882 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:04:54.057882 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:04:54.057882 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:04:54.057882 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:04:54.057882 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:04:54.057882 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:04:54.057882 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:04:54.057882 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:04:54.057882 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:04:54.057882 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:04:54.057882 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:04:54.057882 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:04:54.060500 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 205/397] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jul 4 09:04:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:04:54.067913 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc596ce-9829-49bd-a2b4-fda7f4d43c83 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:54.194088 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc596ce-9829-49bd-a2b4-fda7f4d43c83 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:54.237640 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0969a13-65a3-4100-ba03-46b1eb540493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:54.238371 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0969a13-65a3-4100-ba03-46b1eb540493 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:54.238671 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0969a13-65a3-4100-ba03-46b1eb540493 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:54.238969 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0969a13-65a3-4100-ba03-46b1eb540493 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:54.239752 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0969a13-65a3-4100-ba03-46b1eb540493 None admin] RBAC: Adding query filter params (name=member) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:04:54.240118 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0969a13-65a3-4100-ba03-46b1eb540493 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:54.241588 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0969a13-65a3-4100-ba03-46b1eb540493 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:54.256362 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 193/398] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Jul 4 09:04:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:54.261643 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56228f33-f56e-4c27-96a6-0d51a351d5d6 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:54.409075 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f4c09-1741-45b7-9abc-3b0ace06967d None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:54.409432 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f4c09-1741-45b7-9abc-3b0ace06967d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:54.409626 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f4c09-1741-45b7-9abc-3b0ace06967d None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:54.411258 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 194/399] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:04:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:04:54.416195 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1509ee-fef8-4e1b-82e8-8327b2cbaf76 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:54.416484 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1509ee-fef8-4e1b-82e8-8327b2cbaf76 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:54.416760 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1509ee-fef8-4e1b-82e8-8327b2cbaf76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:54.423326 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56228f33-f56e-4c27-96a6-0d51a351d5d6 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:54.438060 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:54.455682 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-cc1509ee-fef8-4e1b-82e8-8327b2cbaf76 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:04:54.456823 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-cc1509ee-fef8-4e1b-82e8-8327b2cbaf76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:04:54.473446 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ddfaf-9682-4642-9fef-d61328821c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:54.474345 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ddfaf-9682-4642-9fef-d61328821c6f None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:54.474668 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ddfaf-9682-4642-9fef-d61328821c6f None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:54.474964 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ddfaf-9682-4642-9fef-d61328821c6f None admin] PATH_INFO: `/v3/groups/bb530dfce3084a96b84f1e7008f90b1d` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:54.476447 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75ddfaf-9682-4642-9fef-d61328821c6f None admin] RBAC: Authorizing `identity:get_group(group_id=bb530dfce3084a96b84f1e7008f90b1d)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:54.478047 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75ddfaf-9682-4642-9fef-d61328821c6f None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:54.486468 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 206/400] 10.222.0.42 () {56 vars in 1180 bytes} [Mon Jul 4 09:04:54 2022] GET /identity/v3/groups/bb530dfce3084a96b84f1e7008f90b1d => generated 226 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:54.490223 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ddfaf-9682-4642-9fef-d61328821c6f None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:54.550740 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:54.589133 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 195/401] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:04:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 09:04:54.601395 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bdd3d4-0aaa-4db4-86ed-380d8a101efe None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:54.601693 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bdd3d4-0aaa-4db4-86ed-380d8a101efe None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:54.601956 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bdd3d4-0aaa-4db4-86ed-380d8a101efe None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:54.603332 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 196/402] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:04:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:04:54.612926 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bdd3d4-0aaa-4db4-86ed-380d8a101efe None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:54.666284 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ddfaf-9682-4642-9fef-d61328821c6f None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:54.701786 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa91a58-082f-4054-95b1-4461a8e07bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:54.702754 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa91a58-082f-4054-95b1-4461a8e07bcb None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:54.703038 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa91a58-082f-4054-95b1-4461a8e07bcb None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:54.703310 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa91a58-082f-4054-95b1-4461a8e07bcb None admin] PATH_INFO: `/v3/projects/f1e246896b7b4569b9cea667ca2e1386` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:54.704520 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa91a58-082f-4054-95b1-4461a8e07bcb None admin] RBAC: Authorizing `identity:get_project(project_id=f1e246896b7b4569b9cea667ca2e1386)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:54.706086 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa91a58-082f-4054-95b1-4461a8e07bcb None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:54.708097 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 207/403] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jul 4 09:04:54 2022] GET /identity/v3/projects/f1e246896b7b4569b9cea667ca2e1386 => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:04:54.709308 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7974e-4ba8-433d-802e-28c3e3385680 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:54.709591 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7974e-4ba8-433d-802e-28c3e3385680 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:54.709863 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7974e-4ba8-433d-802e-28c3e3385680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:54.727135 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-6fb7974e-4ba8-433d-802e-28c3e3385680 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:04:54.728359 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-6fb7974e-4ba8-433d-802e-28c3e3385680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:04:54.760322 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bdd3d4-0aaa-4db4-86ed-380d8a101efe None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:54.774676 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:54.803962 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 208/404] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:04:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:04:54.804810 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb7974e-4ba8-433d-802e-28c3e3385680 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:54.817896 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7844938-126b-4e45-83a1-d6229aeed733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:54.818709 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7844938-126b-4e45-83a1-d6229aeed733 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:54.818988 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7844938-126b-4e45-83a1-d6229aeed733 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:54.819258 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7844938-126b-4e45-83a1-d6229aeed733 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:54.834612 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7844938-126b-4e45-83a1-d6229aeed733 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:04:54.842912 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-a7844938-126b-4e45-83a1-d6229aeed733 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 09:04:54.842912 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:04:54.842912 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:04:54.842912 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:04:54.842912 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:04:54.842912 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:04:54.842912 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:04:54.842912 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:04:54.842912 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:04:54.842912 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:04:54.842912 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:04:54.842912 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:04:54.842912 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:04:54.842912 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:04:54.842912 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:04:54.842912 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:04:54.843775 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:04:54.843775 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:04:54.843775 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:04:54.843775 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:04:54.843775 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:04:54.843775 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:04:54.843775 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:04:54.843775 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:04:54.843775 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:04:54.843775 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:04:54.843775 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:04:54.843775 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:04:54.843775 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:04:54.843775 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:04:54.843775 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:04:54.843775 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:04:54.845344 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:04:54.845344 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:04:54.845344 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:04:54.845344 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:04:54.845344 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:04:54.845344 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:04:54.845344 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:04:54.845344 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:04:54.845344 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:04:54.845344 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:04:54.845344 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 09:04:54.845344 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:04:54.845344 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 197/405] 10.222.0.42 () {56 vars in 1114 bytes} [Mon Jul 4 09:04:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:04:54.845344 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7844938-126b-4e45-83a1-d6229aeed733 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:54.897388 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:54.930232 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb7974e-4ba8-433d-802e-28c3e3385680 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:54.964531 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7844938-126b-4e45-83a1-d6229aeed733 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:54.966715 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba9eb6d-f073-4fc8-8013-9fd413efc2c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:54.968023 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba9eb6d-f073-4fc8-8013-9fd413efc2c9 None admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:54.968023 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba9eb6d-f073-4fc8-8013-9fd413efc2c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:54.968316 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba9eb6d-f073-4fc8-8013-9fd413efc2c9 None admin] PATH_INFO: `/v3/projects/f1e246896b7b4569b9cea667ca2e1386/groups/bb530dfce3084a96b84f1e7008f90b1d/roles/81634e7812344f84afcb29b0dba2687c` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:54.970446 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba9eb6d-f073-4fc8-8013-9fd413efc2c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=f1e246896b7b4569b9cea667ca2e1386, group_id=bb530dfce3084a96b84f1e7008f90b1d, role_id=81634e7812344f84afcb29b0dba2687c)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:54.972095 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba9eb6d-f073-4fc8-8013-9fd413efc2c9 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:54.992541 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 209/406] 10.222.0.42 () {58 vars in 1442 bytes} [Mon Jul 4 09:04:54 2022] PUT /identity/v3/projects/f1e246896b7b4569b9cea667ca2e1386/groups/bb530dfce3084a96b84f1e7008f90b1d/roles/81634e7812344f84afcb29b0dba2687c => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:04:54.993913 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba9eb6d-f073-4fc8-8013-9fd413efc2c9 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:55.005834 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938fc730-a7e2-4e0a-a76a-7354153248e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:55.006954 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938fc730-a7e2-4e0a-a76a-7354153248e8 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:55.007407 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938fc730-a7e2-4e0a-a76a-7354153248e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:55.007854 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938fc730-a7e2-4e0a-a76a-7354153248e8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:55.019947 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938fc730-a7e2-4e0a-a76a-7354153248e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:04:55.028400 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-938fc730-a7e2-4e0a-a76a-7354153248e8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:04:55.028400 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:04:55.028400 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:04:55.028400 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:04:55.028400 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:04:55.028400 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:04:55.028400 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:04:55.028400 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:04:55.028400 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:04:55.028400 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:04:55.028400 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:04:55.028400 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:04:55.028400 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:04:55.028400 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:04:55.028400 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:04:55.028400 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:04:55.029528 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:04:55.029528 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:04:55.029528 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:04:55.029528 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:04:55.029528 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:04:55.029528 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:04:55.029528 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:04:55.029528 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:04:55.029528 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:04:55.029528 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:04:55.029528 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:04:55.029528 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:04:55.029528 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:04:55.029528 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:04:55.029528 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:04:55.029528 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:04:55.030491 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:04:55.030491 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:04:55.030491 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:04:55.030491 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:04:55.030491 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:04:55.030491 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:04:55.030491 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:04:55.030491 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:04:55.030491 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:04:55.030491 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:04:55.030491 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:04:55.030491 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:04:55.032877 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 198/407] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Jul 4 09:04:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:04:55.039624 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938fc730-a7e2-4e0a-a76a-7354153248e8 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:55.051230 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:55.121629 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba9eb6d-f073-4fc8-8013-9fd413efc2c9 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:55.158930 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bab333-ed90-4601-87c2-fe3b32a3bfb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:55.159933 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bab333-ed90-4601-87c2-fe3b32a3bfb3 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:55.160368 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bab333-ed90-4601-87c2-fe3b32a3bfb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:55.160832 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bab333-ed90-4601-87c2-fe3b32a3bfb3 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:55.161733 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bab333-ed90-4601-87c2-fe3b32a3bfb3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:04:55.162183 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bab333-ed90-4601-87c2-fe3b32a3bfb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:55.163791 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bab333-ed90-4601-87c2-fe3b32a3bfb3 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:55.173233 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 210/408] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jul 4 09:04:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:55.178177 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:55.179467 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bab333-ed90-4601-87c2-fe3b32a3bfb3 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:55.188594 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938fc730-a7e2-4e0a-a76a-7354153248e8 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:55.245497 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f702c-9180-4a52-a51f-d9130518de53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:55.246648 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f702c-9180-4a52-a51f-d9130518de53 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:55.248075 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f702c-9180-4a52-a51f-d9130518de53 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:55.249228 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f702c-9180-4a52-a51f-d9130518de53 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:55.250314 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775f702c-9180-4a52-a51f-d9130518de53 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:04:55.251889 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775f702c-9180-4a52-a51f-d9130518de53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:55.253556 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775f702c-9180-4a52-a51f-d9130518de53 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:55.270642 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 199/409] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jul 4 09:04:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:04:55.278050 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f702c-9180-4a52-a51f-d9130518de53 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:55.313842 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:55.318753 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bab333-ed90-4601-87c2-fe3b32a3bfb3 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:55.357768 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de134c73-ce82-42f6-9326-b299a554abc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:55.359006 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de134c73-ce82-42f6-9326-b299a554abc2 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:55.359440 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de134c73-ce82-42f6-9326-b299a554abc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:55.359913 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de134c73-ce82-42f6-9326-b299a554abc2 None admin] PATH_INFO: `/v3/groups/bb530dfce3084a96b84f1e7008f90b1d` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:55.361629 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de134c73-ce82-42f6-9326-b299a554abc2 None admin] RBAC: Authorizing `identity:get_group(group_id=bb530dfce3084a96b84f1e7008f90b1d)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:55.363271 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de134c73-ce82-42f6-9326-b299a554abc2 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:55.365474 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 211/410] 10.222.0.42 () {56 vars in 1180 bytes} [Mon Jul 4 09:04:55 2022] GET /identity/v3/groups/bb530dfce3084a96b84f1e7008f90b1d => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:55.371296 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de134c73-ce82-42f6-9326-b299a554abc2 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:55.406105 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f702c-9180-4a52-a51f-d9130518de53 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:55.445333 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8fcbf-68e3-4588-a63b-e81199281893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:55.446657 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8fcbf-68e3-4588-a63b-e81199281893 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:55.447233 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8fcbf-68e3-4588-a63b-e81199281893 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:55.447703 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8fcbf-68e3-4588-a63b-e81199281893 None admin] PATH_INFO: `/v3/groups/a83536b1de544ba1a8312777656bdc2f` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:55.449194 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf8fcbf-68e3-4588-a63b-e81199281893 None admin] RBAC: Authorizing `identity:get_group(group_id=a83536b1de544ba1a8312777656bdc2f)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:55.451053 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf8fcbf-68e3-4588-a63b-e81199281893 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:55.453469 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 200/411] 10.222.0.42 () {56 vars in 1180 bytes} [Mon Jul 4 09:04:55 2022] GET /identity/v3/groups/a83536b1de544ba1a8312777656bdc2f => generated 229 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:55.473571 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8fcbf-68e3-4588-a63b-e81199281893 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:55.494901 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de134c73-ce82-42f6-9326-b299a554abc2 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:55.531201 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:55.538581 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f187355-0e27-4cec-8b01-2ad6180a5d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:55.540027 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f187355-0e27-4cec-8b01-2ad6180a5d9e None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:55.540930 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f187355-0e27-4cec-8b01-2ad6180a5d9e None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:55.541400 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f187355-0e27-4cec-8b01-2ad6180a5d9e None admin] PATH_INFO: `/v3/projects/f1e246896b7b4569b9cea667ca2e1386` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:55.543103 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f187355-0e27-4cec-8b01-2ad6180a5d9e None admin] RBAC: Authorizing `identity:get_project(project_id=f1e246896b7b4569b9cea667ca2e1386)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:55.544804 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f187355-0e27-4cec-8b01-2ad6180a5d9e None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:55.547306 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 212/412] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jul 4 09:04:55 2022] GET /identity/v3/projects/f1e246896b7b4569b9cea667ca2e1386 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:04:55.558225 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f187355-0e27-4cec-8b01-2ad6180a5d9e None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:55.611508 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:55.657132 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8fcbf-68e3-4588-a63b-e81199281893 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:55.674852 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f187355-0e27-4cec-8b01-2ad6180a5d9e None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:55.697852 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbbdbe8-e95f-4710-9db7-e494f2331982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:55.698839 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbbdbe8-e95f-4710-9db7-e494f2331982 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:55.699126 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbbdbe8-e95f-4710-9db7-e494f2331982 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:55.699539 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbbdbe8-e95f-4710-9db7-e494f2331982 None admin] PATH_INFO: `/v3/projects/bd20857aebd945c0a3035c21bf5f767e` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:55.701205 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbbdbe8-e95f-4710-9db7-e494f2331982 None admin] RBAC: Authorizing `identity:get_project(project_id=bd20857aebd945c0a3035c21bf5f767e)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:55.702999 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbbdbe8-e95f-4710-9db7-e494f2331982 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:55.705633 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 201/413] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jul 4 09:04:55 2022] GET /identity/v3/projects/bd20857aebd945c0a3035c21bf5f767e => generated 344 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:04:55.707011 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5a25f5-b1b0-4ba6-b102-0b5e6b76d364 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:55.707297 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5a25f5-b1b0-4ba6-b102-0b5e6b76d364 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:55.707570 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5a25f5-b1b0-4ba6-b102-0b5e6b76d364 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:55.708824 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 202/414] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:04:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:04:55.712858 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5a25f5-b1b0-4ba6-b102-0b5e6b76d364 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:55.719056 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b2687-5e4a-4284-8f80-ea2218809bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:55.720073 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b2687-5e4a-4284-8f80-ea2218809bd6 None admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:55.720482 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b2687-5e4a-4284-8f80-ea2218809bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:55.720769 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b2687-5e4a-4284-8f80-ea2218809bd6 None admin] PATH_INFO: `/v3/projects/f1e246896b7b4569b9cea667ca2e1386/groups/bb530dfce3084a96b84f1e7008f90b1d/roles/157d1a80161e43a3ad84446eeca98e0b` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:55.723229 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910b2687-5e4a-4284-8f80-ea2218809bd6 None admin] RBAC: Authorizing `identity:create_grant(project_id=f1e246896b7b4569b9cea667ca2e1386, group_id=bb530dfce3084a96b84f1e7008f90b1d, role_id=157d1a80161e43a3ad84446eeca98e0b)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:55.724798 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910b2687-5e4a-4284-8f80-ea2218809bd6 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:55.742061 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 213/415] 10.222.0.42 () {58 vars in 1442 bytes} [Mon Jul 4 09:04:55 2022] PUT /identity/v3/projects/f1e246896b7b4569b9cea667ca2e1386/groups/bb530dfce3084a96b84f1e7008f90b1d/roles/157d1a80161e43a3ad84446eeca98e0b => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:04:55.743627 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a474f20a-2656-4ffb-b3b8-49cb9ab4a4e7 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:55.744107 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a474f20a-2656-4ffb-b3b8-49cb9ab4a4e7 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:55.744416 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a474f20a-2656-4ffb-b3b8-49cb9ab4a4e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:55.765734 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-a474f20a-2656-4ffb-b3b8-49cb9ab4a4e7 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:04:55.766990 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-a474f20a-2656-4ffb-b3b8-49cb9ab4a4e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:04:55.843992 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 214/416] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:04:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:04:55.855284 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:55.870171 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a474f20a-2656-4ffb-b3b8-49cb9ab4a4e7 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:55.873159 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5a25f5-b1b0-4ba6-b102-0b5e6b76d364 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:55.911263 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236d84fd-64ef-49c4-a9c3-01b1c7244d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:55.912359 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d84fd-64ef-49c4-a9c3-01b1c7244d30 None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:55.912690 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d84fd-64ef-49c4-a9c3-01b1c7244d30 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:55.912972 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d84fd-64ef-49c4-a9c3-01b1c7244d30 None admin] PATH_INFO: `/v3/projects/bd20857aebd945c0a3035c21bf5f767e/groups/a83536b1de544ba1a8312777656bdc2f/roles/965049e7ce6144aaad23c15f3a5e37c3` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:55.915024 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236d84fd-64ef-49c4-a9c3-01b1c7244d30 None admin] RBAC: Authorizing `identity:create_grant(project_id=bd20857aebd945c0a3035c21bf5f767e, group_id=a83536b1de544ba1a8312777656bdc2f, role_id=965049e7ce6144aaad23c15f3a5e37c3)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:55.916596 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236d84fd-64ef-49c4-a9c3-01b1c7244d30 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:55.932224 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 203/417] 10.222.0.42 () {58 vars in 1442 bytes} [Mon Jul 4 09:04:55 2022] PUT /identity/v3/projects/bd20857aebd945c0a3035c21bf5f767e/groups/a83536b1de544ba1a8312777656bdc2f/roles/965049e7ce6144aaad23c15f3a5e37c3 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:04:55.964189 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:56.064286 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a474f20a-2656-4ffb-b3b8-49cb9ab4a4e7 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:56.104915 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7acd72-33c5-4869-a080-3df6dd1ed37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:56.105637 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7acd72-33c5-4869-a080-3df6dd1ed37d None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:56.105915 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7acd72-33c5-4869-a080-3df6dd1ed37d None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:56.106185 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7acd72-33c5-4869-a080-3df6dd1ed37d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:56.119067 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7acd72-33c5-4869-a080-3df6dd1ed37d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:04:56.127218 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-ba7acd72-33c5-4869-a080-3df6dd1ed37d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:04:56.127218 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:04:56.127218 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:04:56.127218 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:04:56.127218 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:04:56.127218 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:04:56.127218 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:04:56.127218 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:04:56.127218 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:04:56.127218 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:04:56.127218 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:04:56.127218 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:04:56.127218 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:04:56.127218 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:04:56.127218 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:04:56.127218 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:04:56.128157 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:04:56.128157 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:04:56.128157 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:04:56.128157 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:04:56.128157 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:04:56.128157 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:04:56.128157 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:04:56.128157 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:04:56.128157 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:04:56.128157 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:04:56.128157 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:04:56.128157 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:04:56.128157 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:04:56.128157 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:04:56.128157 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:04:56.128157 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:04:56.128964 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:04:56.128964 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:04:56.128964 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:04:56.128964 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:04:56.128964 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:04:56.128964 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:04:56.128964 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:04:56.128964 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:04:56.128964 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:04:56.128964 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:04:56.128964 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:04:56.128964 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:04:56.131626 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 215/418] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jul 4 09:04:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:04:56.139901 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236d84fd-64ef-49c4-a9c3-01b1c7244d30 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:56.243931 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236d84fd-64ef-49c4-a9c3-01b1c7244d30 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:56.277589 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebcfd5e-1d5b-431b-9b4d-524cc956b112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:56.278264 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebcfd5e-1d5b-431b-9b4d-524cc956b112 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:56.278545 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebcfd5e-1d5b-431b-9b4d-524cc956b112 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:56.278817 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebcfd5e-1d5b-431b-9b4d-524cc956b112 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:56.279571 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebcfd5e-1d5b-431b-9b4d-524cc956b112 None admin] RBAC: Adding query filter params (name=member) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:04:56.279898 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebcfd5e-1d5b-431b-9b4d-524cc956b112 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:56.281340 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebcfd5e-1d5b-431b-9b4d-524cc956b112 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:56.294117 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 204/419] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Jul 4 09:04:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:56.295470 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7acd72-33c5-4869-a080-3df6dd1ed37d None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:56.404181 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:56.426572 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7acd72-33c5-4869-a080-3df6dd1ed37d None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:56.474960 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca48b5-decb-4fcc-b02d-017cb8bfe1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:56.475639 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca48b5-decb-4fcc-b02d-017cb8bfe1a3 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:56.475944 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca48b5-decb-4fcc-b02d-017cb8bfe1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:56.476223 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca48b5-decb-4fcc-b02d-017cb8bfe1a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:56.492489 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18940c18-39c2-49bc-a24e-5a2e2c9fc647 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:56.492793 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18940c18-39c2-49bc-a24e-5a2e2c9fc647 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:56.493036 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18940c18-39c2-49bc-a24e-5a2e2c9fc647 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:56.494422 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 205/420] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:04:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:04:56.499558 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3870bdf-c372-4da2-82ab-2956c84841f3 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:56.499906 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3870bdf-c372-4da2-82ab-2956c84841f3 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:56.500243 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3870bdf-c372-4da2-82ab-2956c84841f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:56.540899 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-a3870bdf-c372-4da2-82ab-2956c84841f3 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:04:56.542121 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a3870bdf-c372-4da2-82ab-2956c84841f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:04:56.554089 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ca48b5-decb-4fcc-b02d-017cb8bfe1a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:56.555594 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ca48b5-decb-4fcc-b02d-017cb8bfe1a3 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:56.565190 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:56.652173 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:56.661481 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 216/421] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jul 4 09:04:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:04:56.662769 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca48b5-decb-4fcc-b02d-017cb8bfe1a3 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:56.718672 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 206/422] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:04:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:04:56.760257 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3870bdf-c372-4da2-82ab-2956c84841f3 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:56.770338 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca48b5-decb-4fcc-b02d-017cb8bfe1a3 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:56.806435 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe70cd2-c044-423c-a7a9-35ac2c9e303e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:56.807351 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe70cd2-c044-423c-a7a9-35ac2c9e303e None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:56.807638 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe70cd2-c044-423c-a7a9-35ac2c9e303e None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:56.807939 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe70cd2-c044-423c-a7a9-35ac2c9e303e None admin] PATH_INFO: `/v3/projects/4dd04e5b7dd24f0e8050b45d6060f68c` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:56.809136 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe70cd2-c044-423c-a7a9-35ac2c9e303e None admin] RBAC: Authorizing `identity:get_project(project_id=4dd04e5b7dd24f0e8050b45d6060f68c)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:56.810764 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe70cd2-c044-423c-a7a9-35ac2c9e303e None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:56.817066 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 217/423] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jul 4 09:04:56 2022] GET /identity/v3/projects/4dd04e5b7dd24f0e8050b45d6060f68c => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:04:56.818499 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe70cd2-c044-423c-a7a9-35ac2c9e303e None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:56.887003 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:56.926206 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe70cd2-c044-423c-a7a9-35ac2c9e303e None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:56.961973 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bfb1c3-68c9-4d57-bede-439a8d2f3ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:56.963203 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bfb1c3-68c9-4d57-bede-439a8d2f3ba9 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:56.963796 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bfb1c3-68c9-4d57-bede-439a8d2f3ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:56.964393 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bfb1c3-68c9-4d57-bede-439a8d2f3ba9 None admin] PATH_INFO: `/v3/groups/bb530dfce3084a96b84f1e7008f90b1d` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:56.965878 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bfb1c3-68c9-4d57-bede-439a8d2f3ba9 None admin] RBAC: Authorizing `identity:get_group(group_id=bb530dfce3084a96b84f1e7008f90b1d)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:56.967696 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bfb1c3-68c9-4d57-bede-439a8d2f3ba9 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:56.974445 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 218/424] 10.222.0.42 () {56 vars in 1180 bytes} [Mon Jul 4 09:04:56 2022] GET /identity/v3/groups/bb530dfce3084a96b84f1e7008f90b1d => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:04:56.975935 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bfb1c3-68c9-4d57-bede-439a8d2f3ba9 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:56.991293 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3870bdf-c372-4da2-82ab-2956c84841f3 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:57.027730 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107acc98-671e-4493-8480-d4f5eb614586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:57.028571 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107acc98-671e-4493-8480-d4f5eb614586 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:57.029107 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107acc98-671e-4493-8480-d4f5eb614586 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:57.029469 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107acc98-671e-4493-8480-d4f5eb614586 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:57.048012 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107acc98-671e-4493-8480-d4f5eb614586 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:04:57.049479 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-107acc98-671e-4493-8480-d4f5eb614586 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 09:04:57.049479 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:04:57.049479 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:04:57.049479 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:04:57.049479 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:04:57.049479 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:04:57.049479 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:04:57.049479 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:04:57.049479 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:04:57.049479 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:04:57.049479 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:04:57.049479 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:04:57.049479 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:04:57.049479 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:04:57.049479 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:04:57.049479 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:04:57.050539 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:04:57.050539 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:04:57.050539 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:04:57.050539 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:04:57.050539 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:04:57.050539 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:04:57.050539 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:04:57.050539 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:04:57.050539 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:04:57.050539 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:04:57.050539 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:04:57.050539 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:04:57.050539 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:04:57.050539 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:04:57.050539 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:04:57.050539 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:04:57.051542 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:04:57.051542 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:04:57.051542 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:04:57.051542 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:04:57.051542 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:04:57.051542 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:04:57.051542 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:04:57.051542 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:04:57.051542 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:04:57.051542 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:04:57.051542 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 09:04:57.051542 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:04:57.053616 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 207/425] 10.222.0.42 () {56 vars in 1114 bytes} [Mon Jul 4 09:04:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:04:57.059494 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107acc98-671e-4493-8480-d4f5eb614586 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:57.072204 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:57.114103 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bfb1c3-68c9-4d57-bede-439a8d2f3ba9 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:57.140303 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:57.152480 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36001b7e-6359-4ffa-b2fd-a3b91fad367c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:57.153885 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36001b7e-6359-4ffa-b2fd-a3b91fad367c None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:57.154269 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36001b7e-6359-4ffa-b2fd-a3b91fad367c None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:57.154519 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36001b7e-6359-4ffa-b2fd-a3b91fad367c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:57.155420 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36001b7e-6359-4ffa-b2fd-a3b91fad367c None admin] RBAC: Adding query filter params (group.id=bb530dfce3084a96b84f1e7008f90b1d, role.id=81634e7812344f84afcb29b0dba2687c, scope.project.id=4dd04e5b7dd24f0e8050b45d6060f68c) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:04:57.155739 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36001b7e-6359-4ffa-b2fd-a3b91fad367c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:57.157378 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36001b7e-6359-4ffa-b2fd-a3b91fad367c None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:57.164135 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 219/426] 10.222.0.42 () {56 vars in 1376 bytes} [Mon Jul 4 09:04:56 2022] GET /identity/v3/role_assignments?group.id=bb530dfce3084a96b84f1e7008f90b1d&scope.project.id=4dd04e5b7dd24f0e8050b45d6060f68c&role.id=81634e7812344f84afcb29b0dba2687c => generated 611 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:04:57.246349 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107acc98-671e-4493-8480-d4f5eb614586 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:57.286609 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b831a8d1-228e-4c9c-aad1-413bfcae9f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:57.287490 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b831a8d1-228e-4c9c-aad1-413bfcae9f94 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:57.287912 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b831a8d1-228e-4c9c-aad1-413bfcae9f94 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:57.288319 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b831a8d1-228e-4c9c-aad1-413bfcae9f94 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:57.289255 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b831a8d1-228e-4c9c-aad1-413bfcae9f94 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:04:57.289698 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b831a8d1-228e-4c9c-aad1-413bfcae9f94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:57.291309 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b831a8d1-228e-4c9c-aad1-413bfcae9f94 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:57.301845 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 208/427] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jul 4 09:04:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:57.309435 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36001b7e-6359-4ffa-b2fd-a3b91fad367c None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:57.432981 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36001b7e-6359-4ffa-b2fd-a3b91fad367c None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:57.471148 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0210de27-fe38-46f7-87df-7f6b3d667e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:57.471814 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210de27-fe38-46f7-87df-7f6b3d667e78 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:57.472122 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210de27-fe38-46f7-87df-7f6b3d667e78 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:57.472398 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210de27-fe38-46f7-87df-7f6b3d667e78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:57.539010 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:57.555519 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0210de27-fe38-46f7-87df-7f6b3d667e78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:57.557056 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0210de27-fe38-46f7-87df-7f6b3d667e78 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:57.663719 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 220/428] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jul 4 09:04:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:04:57.669078 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b831a8d1-228e-4c9c-aad1-413bfcae9f94 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:57.710193 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a72b305-3724-4728-88a7-55f649218a4a None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:57.710496 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a72b305-3724-4728-88a7-55f649218a4a None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:57.710814 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a72b305-3724-4728-88a7-55f649218a4a None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:57.712656 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 221/429] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:04:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:04:57.718215 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc19c9-1563-4424-ad90-f49e2c795b8b None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:57.718514 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc19c9-1563-4424-ad90-f49e2c795b8b None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:57.718811 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc19c9-1563-4424-ad90-f49e2c795b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:57.737527 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-54bc19c9-1563-4424-ad90-f49e2c795b8b None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:04:57.738898 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-54bc19c9-1563-4424-ad90-f49e2c795b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:04:57.756232 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:57.788496 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b831a8d1-228e-4c9c-aad1-413bfcae9f94 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:57.827408 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0287cde5-fc5d-4cb2-a23d-01ea4446a343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:57.828243 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0287cde5-fc5d-4cb2-a23d-01ea4446a343 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:57.828519 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0287cde5-fc5d-4cb2-a23d-01ea4446a343 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:57.828791 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0287cde5-fc5d-4cb2-a23d-01ea4446a343 None admin] PATH_INFO: `/v3/projects/4dd04e5b7dd24f0e8050b45d6060f68c` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:57.830024 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0287cde5-fc5d-4cb2-a23d-01ea4446a343 None admin] RBAC: Authorizing `identity:get_project(project_id=4dd04e5b7dd24f0e8050b45d6060f68c)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:57.831600 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0287cde5-fc5d-4cb2-a23d-01ea4446a343 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:57.833741 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 209/430] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jul 4 09:04:57 2022] GET /identity/v3/projects/4dd04e5b7dd24f0e8050b45d6060f68c => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:57.839923 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0287cde5-fc5d-4cb2-a23d-01ea4446a343 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:57.849460 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 222/431] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:04:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:04:57.880421 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bc19c9-1563-4424-ad90-f49e2c795b8b None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:57.903901 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:57.973280 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0287cde5-fc5d-4cb2-a23d-01ea4446a343 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:58.007463 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bc19c9-1563-4424-ad90-f49e2c795b8b None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:58.026690 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028aadd3-d6df-4972-8148-eb2891c128d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:58.027550 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028aadd3-d6df-4972-8148-eb2891c128d7 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:58.027829 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028aadd3-d6df-4972-8148-eb2891c128d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:58.028125 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028aadd3-d6df-4972-8148-eb2891c128d7 None admin] PATH_INFO: `/v3/groups/bb530dfce3084a96b84f1e7008f90b1d` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:58.030059 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028aadd3-d6df-4972-8148-eb2891c128d7 None admin] RBAC: Authorizing `identity:get_group(group_id=bb530dfce3084a96b84f1e7008f90b1d)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:58.031560 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028aadd3-d6df-4972-8148-eb2891c128d7 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:58.035771 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 210/432] 10.222.0.42 () {56 vars in 1180 bytes} [Mon Jul 4 09:04:57 2022] GET /identity/v3/groups/bb530dfce3084a96b84f1e7008f90b1d => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:58.040963 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028aadd3-d6df-4972-8148-eb2891c128d7 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:58.045061 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:58.053863 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d1a10-1113-4b76-adbb-6fc595afda88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:58.054968 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d1a10-1113-4b76-adbb-6fc595afda88 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:58.055476 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d1a10-1113-4b76-adbb-6fc595afda88 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:58.055971 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d1a10-1113-4b76-adbb-6fc595afda88 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:58.067301 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235d1a10-1113-4b76-adbb-6fc595afda88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:04:58.075494 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-235d1a10-1113-4b76-adbb-6fc595afda88 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:04:58.075494 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:04:58.075494 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:04:58.075494 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:04:58.075494 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:04:58.075494 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:04:58.075494 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:04:58.075494 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:04:58.075494 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:04:58.075494 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:04:58.075494 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:04:58.075494 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:04:58.075494 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:04:58.075494 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:04:58.075494 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:04:58.075494 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:04:58.076446 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:04:58.076446 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:04:58.076446 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:04:58.076446 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:04:58.076446 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:04:58.076446 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:04:58.076446 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:04:58.076446 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:04:58.076446 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:04:58.076446 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:04:58.076446 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:04:58.076446 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:04:58.076446 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:04:58.076446 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:04:58.076446 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:04:58.076446 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:04:58.077271 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:04:58.077271 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:04:58.077271 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:04:58.077271 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:04:58.077271 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:04:58.077271 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:04:58.077271 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:04:58.077271 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:04:58.077271 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:04:58.077271 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:04:58.077271 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:04:58.077271 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:04:58.080034 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 223/433] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jul 4 09:04:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:04:58.085883 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d1a10-1113-4b76-adbb-6fc595afda88 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:58.150229 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028aadd3-d6df-4972-8148-eb2891c128d7 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:58.170239 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:58.190754 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dee95f-9f3a-4719-85f7-f832d3fe367c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:58.191320 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dee95f-9f3a-4719-85f7-f832d3fe367c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:58.191598 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dee95f-9f3a-4719-85f7-f832d3fe367c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:58.191887 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dee95f-9f3a-4719-85f7-f832d3fe367c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:58.192729 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dee95f-9f3a-4719-85f7-f832d3fe367c None admin] RBAC: Adding query filter params (group.id=bb530dfce3084a96b84f1e7008f90b1d, role.id=157d1a80161e43a3ad84446eeca98e0b, scope.project.id=4dd04e5b7dd24f0e8050b45d6060f68c) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:04:58.193041 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dee95f-9f3a-4719-85f7-f832d3fe367c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:58.194504 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dee95f-9f3a-4719-85f7-f832d3fe367c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:58.198500 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d1a10-1113-4b76-adbb-6fc595afda88 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:58.201687 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 211/434] 10.222.0.42 () {56 vars in 1376 bytes} [Mon Jul 4 09:04:58 2022] GET /identity/v3/role_assignments?group.id=bb530dfce3084a96b84f1e7008f90b1d&scope.project.id=4dd04e5b7dd24f0e8050b45d6060f68c&role.id=157d1a80161e43a3ad84446eeca98e0b => generated 611 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:04:58.237317 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cb1081-fa9d-40b8-8731-1d95b2b452f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:58.238387 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb1081-fa9d-40b8-8731-1d95b2b452f1 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:58.238927 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb1081-fa9d-40b8-8731-1d95b2b452f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:58.239437 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb1081-fa9d-40b8-8731-1d95b2b452f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:58.240455 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cb1081-fa9d-40b8-8731-1d95b2b452f1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:04:58.240980 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cb1081-fa9d-40b8-8731-1d95b2b452f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:58.242604 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cb1081-fa9d-40b8-8731-1d95b2b452f1 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:58.253484 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 224/435] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Jul 4 09:04:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:58.258844 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dee95f-9f3a-4719-85f7-f832d3fe367c None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:58.286795 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce8bd00-d9de-462c-b55e-dcc6776bab55 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:58.287450 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce8bd00-d9de-462c-b55e-dcc6776bab55 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:58.287951 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce8bd00-d9de-462c-b55e-dcc6776bab55 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:58.292228 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 225/436] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:04:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:04:58.296582 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60726950-fb2b-4601-a755-99653a08799c None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:58.297185 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60726950-fb2b-4601-a755-99653a08799c None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:58.297657 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60726950-fb2b-4601-a755-99653a08799c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:58.316617 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-60726950-fb2b-4601-a755-99653a08799c None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:04:58.318182 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-60726950-fb2b-4601-a755-99653a08799c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:04:58.353667 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:58.393739 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dee95f-9f3a-4719-85f7-f832d3fe367c None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:58.409474 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 226/437] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:04:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 09:04:58.428204 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60726950-fb2b-4601-a755-99653a08799c None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:58.433649 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71a70e7-b907-4334-b9e5-1f2e3d882c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:58.434314 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a70e7-b907-4334-b9e5-1f2e3d882c3a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:58.434592 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a70e7-b907-4334-b9e5-1f2e3d882c3a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:58.434861 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a70e7-b907-4334-b9e5-1f2e3d882c3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:58.505450 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:58.518801 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71a70e7-b907-4334-b9e5-1f2e3d882c3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:58.520332 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71a70e7-b907-4334-b9e5-1f2e3d882c3a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:58.547295 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60726950-fb2b-4601-a755-99653a08799c None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:58.592721 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9e3cc1-583e-4035-9925-57f79883fa3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:58.593531 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e3cc1-583e-4035-9925-57f79883fa3a None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:58.593807 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e3cc1-583e-4035-9925-57f79883fa3a None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:58.594076 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e3cc1-583e-4035-9925-57f79883fa3a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:58.600967 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:58.608348 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9e3cc1-583e-4035-9925-57f79883fa3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:04:58.616717 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-0e9e3cc1-583e-4035-9925-57f79883fa3a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 09:04:58.616717 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:04:58.616717 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:04:58.616717 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:04:58.616717 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:04:58.616717 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:04:58.616717 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:04:58.616717 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:04:58.616717 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:04:58.616717 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:04:58.616717 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:04:58.616717 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:04:58.616717 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:04:58.616717 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:04:58.616717 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:04:58.616717 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:04:58.617687 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:04:58.617687 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:04:58.617687 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:04:58.617687 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:04:58.617687 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:04:58.617687 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:04:58.617687 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:04:58.617687 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:04:58.617687 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:04:58.617687 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:04:58.617687 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:04:58.617687 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:04:58.617687 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:04:58.617687 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:04:58.617687 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:04:58.617687 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:04:58.618459 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:04:58.618459 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:04:58.618459 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:04:58.618459 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:04:58.618459 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:04:58.618459 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:04:58.618459 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:04:58.618459 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:04:58.618459 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:04:58.618459 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:04:58.618459 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 09:04:58.618459 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:04:58.618459 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 227/438] 10.222.0.42 () {56 vars in 1114 bytes} [Mon Jul 4 09:04:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:04:58.619552 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56fa90-f8a9-4a81-8f83-bea3d4a86bad None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:58.619841 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56fa90-f8a9-4a81-8f83-bea3d4a86bad None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:58.620144 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56fa90-f8a9-4a81-8f83-bea3d4a86bad None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:58.621533 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 228/439] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:04:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:04:58.623549 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c56fa90-f8a9-4a81-8f83-bea3d4a86bad None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:58.639788 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 212/440] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jul 4 09:04:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 04 09:04:58.641204 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ef1e49-9bfb-4edd-bdc3-7251cac852be None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:58.641495 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ef1e49-9bfb-4edd-bdc3-7251cac852be None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:58.641767 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ef1e49-9bfb-4edd-bdc3-7251cac852be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:58.657344 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-92ef1e49-9bfb-4edd-bdc3-7251cac852be None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:04:58.658540 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-92ef1e49-9bfb-4edd-bdc3-7251cac852be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:04:58.723642 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 213/441] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:04:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:04:58.728122 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ef1e49-9bfb-4edd-bdc3-7251cac852be None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:58.734188 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c56fa90-f8a9-4a81-8f83-bea3d4a86bad None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:58.761455 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:58.770024 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d0560-2d4e-4706-b197-93d3f56b5424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:58.770689 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d0560-2d4e-4706-b197-93d3f56b5424 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:58.770970 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d0560-2d4e-4706-b197-93d3f56b5424 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:58.771242 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d0560-2d4e-4706-b197-93d3f56b5424 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:58.772015 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75d0560-2d4e-4706-b197-93d3f56b5424 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:04:58.772321 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75d0560-2d4e-4706-b197-93d3f56b5424 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:58.773719 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75d0560-2d4e-4706-b197-93d3f56b5424 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:58.781650 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 229/442] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jul 4 09:04:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:04:58.782237 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d0560-2d4e-4706-b197-93d3f56b5424 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:58.834235 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:58.838140 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ef1e49-9bfb-4edd-bdc3-7251cac852be None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:58.871919 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a38b79-d12d-4598-a6da-a35ebaed5e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:58.872702 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a38b79-d12d-4598-a6da-a35ebaed5e2f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:58.872979 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a38b79-d12d-4598-a6da-a35ebaed5e2f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:58.873245 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a38b79-d12d-4598-a6da-a35ebaed5e2f None admin] PATH_INFO: `/v3/projects/f1e246896b7b4569b9cea667ca2e1386` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:58.874455 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a38b79-d12d-4598-a6da-a35ebaed5e2f None admin] RBAC: Authorizing `identity:get_project(project_id=f1e246896b7b4569b9cea667ca2e1386)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:58.875946 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a38b79-d12d-4598-a6da-a35ebaed5e2f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:58.877657 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 214/443] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jul 4 09:04:58 2022] GET /identity/v3/projects/f1e246896b7b4569b9cea667ca2e1386 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:58.882361 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a38b79-d12d-4598-a6da-a35ebaed5e2f None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:58.882437 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d0560-2d4e-4706-b197-93d3f56b5424 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:58.917549 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d164040-52b4-4397-9356-971f24631329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:58.918337 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d164040-52b4-4397-9356-971f24631329 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:58.918615 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d164040-52b4-4397-9356-971f24631329 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:58.918883 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d164040-52b4-4397-9356-971f24631329 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:58.928988 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d164040-52b4-4397-9356-971f24631329 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:04:58.936589 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-7d164040-52b4-4397-9356-971f24631329 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:04:58.936589 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:04:58.936589 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:04:58.936589 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:04:58.936589 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:04:58.936589 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:04:58.936589 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:04:58.936589 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:04:58.936589 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:04:58.936589 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:04:58.936589 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:04:58.936589 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:04:58.936589 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:04:58.936589 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:04:58.936589 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:04:58.936589 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:04:58.937483 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:04:58.937483 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:04:58.937483 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:04:58.937483 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:04:58.937483 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:04:58.937483 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:04:58.937483 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:04:58.937483 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:04:58.937483 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:04:58.937483 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:04:58.937483 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:04:58.937483 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:04:58.937483 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:04:58.937483 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:04:58.937483 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:04:58.937483 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:04:58.938291 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:04:58.938291 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:04:58.938291 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:04:58.938291 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:04:58.938291 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:04:58.938291 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:04:58.938291 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:04:58.938291 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:04:58.938291 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:04:58.938291 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:04:58.938291 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:04:58.938291 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:04:58.938291 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 230/444] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Jul 4 09:04:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:04:58.938961 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d164040-52b4-4397-9356-971f24631329 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:58.981483 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a38b79-d12d-4598-a6da-a35ebaed5e2f None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:58.987293 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:59.014546 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb57c841-62da-4e08-9ee2-d7f424077e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:59.015178 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb57c841-62da-4e08-9ee2-d7f424077e17 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:59.015461 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb57c841-62da-4e08-9ee2-d7f424077e17 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:59.015741 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb57c841-62da-4e08-9ee2-d7f424077e17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:59.034573 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d164040-52b4-4397-9356-971f24631329 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:59.050155 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:59.066496 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f138d4-56be-49f5-b2d5-34ed6db458af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:59.067342 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f138d4-56be-49f5-b2d5-34ed6db458af None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:59.067626 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f138d4-56be-49f5-b2d5-34ed6db458af None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:59.067916 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f138d4-56be-49f5-b2d5-34ed6db458af None admin] PATH_INFO: `/v3/groups/bb530dfce3084a96b84f1e7008f90b1d` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:59.069065 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f138d4-56be-49f5-b2d5-34ed6db458af None admin] RBAC: Authorizing `identity:get_group(group_id=bb530dfce3084a96b84f1e7008f90b1d)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:59.070515 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f138d4-56be-49f5-b2d5-34ed6db458af None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:59.072157 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 231/445] 10.222.0.42 () {56 vars in 1180 bytes} [Mon Jul 4 09:04:58 2022] GET /identity/v3/groups/bb530dfce3084a96b84f1e7008f90b1d => generated 226 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:59.072907 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f138d4-56be-49f5-b2d5-34ed6db458af None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:59.090265 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb57c841-62da-4e08-9ee2-d7f424077e17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:59.091751 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb57c841-62da-4e08-9ee2-d7f424077e17 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:59.170899 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f138d4-56be-49f5-b2d5-34ed6db458af None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:59.187056 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:59.190042 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 215/446] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jul 4 09:04:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:04:59.190881 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb57c841-62da-4e08-9ee2-d7f424077e17 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:59.208265 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b6805b-fc90-4cdc-9cb1-9ae696f96108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:59.208927 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b6805b-fc90-4cdc-9cb1-9ae696f96108 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:59.209205 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b6805b-fc90-4cdc-9cb1-9ae696f96108 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:59.209475 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b6805b-fc90-4cdc-9cb1-9ae696f96108 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:59.210222 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b6805b-fc90-4cdc-9cb1-9ae696f96108 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:04:59.210524 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b6805b-fc90-4cdc-9cb1-9ae696f96108 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:59.211894 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b6805b-fc90-4cdc-9cb1-9ae696f96108 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:59.220096 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 232/447] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jul 4 09:04:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:59.220857 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b6805b-fc90-4cdc-9cb1-9ae696f96108 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:59.260554 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:59.295755 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb57c841-62da-4e08-9ee2-d7f424077e17 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:59.317303 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b6805b-fc90-4cdc-9cb1-9ae696f96108 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:59.328581 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a734c8-5ec5-4b30-ab7f-2701f4a362d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:59.329237 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a734c8-5ec5-4b30-ab7f-2701f4a362d7 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:59.329526 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a734c8-5ec5-4b30-ab7f-2701f4a362d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:59.329803 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a734c8-5ec5-4b30-ab7f-2701f4a362d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:59.330632 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a734c8-5ec5-4b30-ab7f-2701f4a362d7 None admin] RBAC: Adding query filter params (group.id=bb530dfce3084a96b84f1e7008f90b1d, role.id=81634e7812344f84afcb29b0dba2687c, scope.project.id=f1e246896b7b4569b9cea667ca2e1386) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:04:59.330943 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a734c8-5ec5-4b30-ab7f-2701f4a362d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:59.332436 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a734c8-5ec5-4b30-ab7f-2701f4a362d7 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:59.338246 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 216/448] 10.222.0.42 () {56 vars in 1376 bytes} [Mon Jul 4 09:04:59 2022] GET /identity/v3/role_assignments?group.id=bb530dfce3084a96b84f1e7008f90b1d&scope.project.id=f1e246896b7b4569b9cea667ca2e1386&role.id=81634e7812344f84afcb29b0dba2687c => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:59.339018 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a734c8-5ec5-4b30-ab7f-2701f4a362d7 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:59.349494 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d409ffea-fc74-444c-8637-27955b45cad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:59.350575 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d409ffea-fc74-444c-8637-27955b45cad0 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:59.350955 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d409ffea-fc74-444c-8637-27955b45cad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:59.351311 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d409ffea-fc74-444c-8637-27955b45cad0 None admin] PATH_INFO: `/v3/projects/f1e246896b7b4569b9cea667ca2e1386` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:59.352704 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d409ffea-fc74-444c-8637-27955b45cad0 None admin] RBAC: Authorizing `identity:get_project(project_id=f1e246896b7b4569b9cea667ca2e1386)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:59.354428 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d409ffea-fc74-444c-8637-27955b45cad0 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:59.356481 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 233/449] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jul 4 09:04:59 2022] GET /identity/v3/projects/f1e246896b7b4569b9cea667ca2e1386 => generated 302 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:59.362575 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d409ffea-fc74-444c-8637-27955b45cad0 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:59.416730 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:59.464541 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a734c8-5ec5-4b30-ab7f-2701f4a362d7 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:59.470978 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d409ffea-fc74-444c-8637-27955b45cad0 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:59.496327 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:59.505115 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cacf50-b2a7-42b9-9317-b9184e313f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:59.505859 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cacf50-b2a7-42b9-9317-b9184e313f59 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:59.506158 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cacf50-b2a7-42b9-9317-b9184e313f59 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:59.506421 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cacf50-b2a7-42b9-9317-b9184e313f59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:59.510827 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b09f3f-41e3-422f-8750-bf2b3be138c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:59.511681 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b09f3f-41e3-422f-8750-bf2b3be138c9 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:59.512855 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b09f3f-41e3-422f-8750-bf2b3be138c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:59.512855 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b09f3f-41e3-422f-8750-bf2b3be138c9 None admin] PATH_INFO: `/v3/groups/bb530dfce3084a96b84f1e7008f90b1d` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:59.514340 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b09f3f-41e3-422f-8750-bf2b3be138c9 None admin] RBAC: Authorizing `identity:get_group(group_id=bb530dfce3084a96b84f1e7008f90b1d)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:59.515936 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b09f3f-41e3-422f-8750-bf2b3be138c9 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:59.517769 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 234/450] 10.222.0.42 () {56 vars in 1180 bytes} [Mon Jul 4 09:04:59 2022] GET /identity/v3/groups/bb530dfce3084a96b84f1e7008f90b1d => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:04:59.523306 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b09f3f-41e3-422f-8750-bf2b3be138c9 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:59.594112 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cacf50-b2a7-42b9-9317-b9184e313f59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:59.595651 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cacf50-b2a7-42b9-9317-b9184e313f59 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:59.644668 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b09f3f-41e3-422f-8750-bf2b3be138c9 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:59.669256 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:59.693767 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692b66f9-ce1b-4ebf-8409-9ada2e051455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:59.694444 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b66f9-ce1b-4ebf-8409-9ada2e051455 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:59.694774 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b66f9-ce1b-4ebf-8409-9ada2e051455 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:59.695348 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b66f9-ce1b-4ebf-8409-9ada2e051455 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:59.696444 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692b66f9-ce1b-4ebf-8409-9ada2e051455 None admin] RBAC: Adding query filter params (group.id=bb530dfce3084a96b84f1e7008f90b1d, role.id=157d1a80161e43a3ad84446eeca98e0b, scope.project.id=f1e246896b7b4569b9cea667ca2e1386) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:04:59.699615 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692b66f9-ce1b-4ebf-8409-9ada2e051455 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:59.699615 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692b66f9-ce1b-4ebf-8409-9ada2e051455 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:59.706088 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 235/451] 10.222.0.42 () {56 vars in 1376 bytes} [Mon Jul 4 09:04:59 2022] GET /identity/v3/role_assignments?group.id=bb530dfce3084a96b84f1e7008f90b1d&scope.project.id=f1e246896b7b4569b9cea667ca2e1386&role.id=157d1a80161e43a3ad84446eeca98e0b => generated 611 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:04:59.720199 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 217/452] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jul 4 09:04:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:04:59.726715 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692b66f9-ce1b-4ebf-8409-9ada2e051455 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:59.835348 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692b66f9-ce1b-4ebf-8409-9ada2e051455 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:04:59.872994 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f1238f-02f3-4958-9de9-ff1013184c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:04:59.873880 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f1238f-02f3-4958-9de9-ff1013184c5b None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:04:59.874184 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f1238f-02f3-4958-9de9-ff1013184c5b None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:04:59.874461 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f1238f-02f3-4958-9de9-ff1013184c5b None admin] PATH_INFO: `/v3/projects/bd20857aebd945c0a3035c21bf5f767e` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:04:59.875648 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f1238f-02f3-4958-9de9-ff1013184c5b None admin] RBAC: Authorizing `identity:get_project(project_id=bd20857aebd945c0a3035c21bf5f767e)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:04:59.877132 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f1238f-02f3-4958-9de9-ff1013184c5b None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:04:59.879023 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 236/453] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jul 4 09:04:59 2022] GET /identity/v3/projects/bd20857aebd945c0a3035c21bf5f767e => generated 344 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:04:59.884568 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cacf50-b2a7-42b9-9317-b9184e313f59 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:04:59.917180 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:04:59.989337 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cacf50-b2a7-42b9-9317-b9184e313f59 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:00.022493 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9579a792-92c1-4c5c-a42e-724ced58765c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:00.023338 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9579a792-92c1-4c5c-a42e-724ced58765c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:00.023615 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9579a792-92c1-4c5c-a42e-724ced58765c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:00.023889 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9579a792-92c1-4c5c-a42e-724ced58765c None admin] PATH_INFO: `/v3/groups/a83536b1de544ba1a8312777656bdc2f` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:00.025057 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9579a792-92c1-4c5c-a42e-724ced58765c None admin] RBAC: Authorizing `identity:get_group(group_id=a83536b1de544ba1a8312777656bdc2f)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:00.026521 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9579a792-92c1-4c5c-a42e-724ced58765c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:00.028166 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 218/454] 10.222.0.42 () {56 vars in 1180 bytes} [Mon Jul 4 09:04:59 2022] GET /identity/v3/groups/a83536b1de544ba1a8312777656bdc2f => generated 229 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:05:00.034071 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f1238f-02f3-4958-9de9-ff1013184c5b None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:00.081642 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:00.133491 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f1238f-02f3-4958-9de9-ff1013184c5b None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:00.167764 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fdd2d7-2178-44fa-a70c-9184fc611c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:00.168427 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fdd2d7-2178-44fa-a70c-9184fc611c79 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:00.168710 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fdd2d7-2178-44fa-a70c-9184fc611c79 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:00.169015 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fdd2d7-2178-44fa-a70c-9184fc611c79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:00.169822 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fdd2d7-2178-44fa-a70c-9184fc611c79 None admin] RBAC: Adding query filter params (group.id=a83536b1de544ba1a8312777656bdc2f, role.id=965049e7ce6144aaad23c15f3a5e37c3, scope.project.id=bd20857aebd945c0a3035c21bf5f767e) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:00.170127 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fdd2d7-2178-44fa-a70c-9184fc611c79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:00.171588 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fdd2d7-2178-44fa-a70c-9184fc611c79 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:00.177467 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 237/455] 10.222.0.42 () {56 vars in 1376 bytes} [Mon Jul 4 09:05:00 2022] GET /identity/v3/role_assignments?group.id=a83536b1de544ba1a8312777656bdc2f&scope.project.id=bd20857aebd945c0a3035c21bf5f767e&role.id=965049e7ce6144aaad23c15f3a5e37c3 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:02.504691 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73da154-11a7-420f-9892-666aeb37ddc8 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:02.505209 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73da154-11a7-420f-9892-666aeb37ddc8 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:02.505209 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73da154-11a7-420f-9892-666aeb37ddc8 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:02.506841 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 219/456] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:05:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:05:02.512298 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f2fa4-b34f-4cfd-864a-a81f6458f8a1 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:02.512745 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f2fa4-b34f-4cfd-864a-a81f6458f8a1 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:02.512937 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f2fa4-b34f-4cfd-864a-a81f6458f8a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:02.535904 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-e04f2fa4-b34f-4cfd-864a-a81f6458f8a1 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:05:02.537105 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-e04f2fa4-b34f-4cfd-864a-a81f6458f8a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:05:02.638041 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 238/457] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:05:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 09:05:02.673890 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73da154-11a7-420f-9892-666aeb37ddc8 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:02.805433 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:02.810886 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73da154-11a7-420f-9892-666aeb37ddc8 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:02.845752 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8579a0-5ad7-4dc8-8902-9c36d03163da None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:02.846051 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8579a0-5ad7-4dc8-8902-9c36d03163da None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:02.846290 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8579a0-5ad7-4dc8-8902-9c36d03163da None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:02.847928 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 239/458] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:05:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:05:02.852944 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c981ac5-d061-49e8-ad20-6c9583c7c420 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:02.853261 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c981ac5-d061-49e8-ad20-6c9583c7c420 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:02.853489 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c981ac5-d061-49e8-ad20-6c9583c7c420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:02.853898 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d7c930-1c9a-40f2-9062-9ccf973ee9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:02.854905 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d7c930-1c9a-40f2-9062-9ccf973ee9a3 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:02.855393 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d7c930-1c9a-40f2-9062-9ccf973ee9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:02.855850 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d7c930-1c9a-40f2-9062-9ccf973ee9a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:02.868271 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d7c930-1c9a-40f2-9062-9ccf973ee9a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:02.870595 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d7c930-1c9a-40f2-9062-9ccf973ee9a3 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:02.883743 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-0c981ac5-d061-49e8-ad20-6c9583c7c420 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:05:02.886234 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-0c981ac5-d061-49e8-ad20-6c9583c7c420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:05:02.903956 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-62d7c930-1c9a-40f2-9062-9ccf973ee9a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:02.903956 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:02.903956 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:02.903956 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:02.903956 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:02.903956 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:02.903956 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:02.903956 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:02.903956 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:02.903956 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:02.903956 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:02.903956 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:02.903956 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:05:02.903956 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:05:02.903956 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:05:02.904879 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:05:02.904879 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:02.904879 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:02.904879 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:02.904879 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:02.904879 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:02.904879 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:02.904879 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:02.904879 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:02.904879 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:02.904879 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:02.904879 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:02.904879 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:02.904879 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:02.904879 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:02.904879 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:02.904879 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:02.905749 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:05:02.905749 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:05:02.905749 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:02.905749 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:02.909400 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 220/459] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:05:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:02.913491 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d7c930-1c9a-40f2-9062-9ccf973ee9a3 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:02.949767 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:02.983616 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 240/460] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:05:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:05:03.008512 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c981ac5-d061-49e8-ad20-6c9583c7c420 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:03.131979 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d7c930-1c9a-40f2-9062-9ccf973ee9a3 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:03.166581 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c981ac5-d061-49e8-ad20-6c9583c7c420 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:03.177772 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d88c01-6f4e-4cf2-8af3-f70a1b24ea71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:03.178618 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d88c01-6f4e-4cf2-8af3-f70a1b24ea71 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:03.178747 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d88c01-6f4e-4cf2-8af3-f70a1b24ea71 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:03.178972 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d88c01-6f4e-4cf2-8af3-f70a1b24ea71 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:03.179699 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d88c01-6f4e-4cf2-8af3-f70a1b24ea71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:03.180064 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d88c01-6f4e-4cf2-8af3-f70a1b24ea71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:03.181447 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d88c01-6f4e-4cf2-8af3-f70a1b24ea71 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:03.194403 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 221/461] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jul 4 09:05:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:03.195789 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a5123-f23f-400a-8c80-7cae697c3a7d None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:03.196101 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a5123-f23f-400a-8c80-7cae697c3a7d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:03.196380 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a5123-f23f-400a-8c80-7cae697c3a7d None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:03.201694 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 222/462] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:05:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:05:03.202486 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0a5123-f23f-400a-8c80-7cae697c3a7d None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:03.205578 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217f8d7a-b3ac-4156-9c2c-1b51cbccf611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:03.206603 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f8d7a-b3ac-4156-9c2c-1b51cbccf611 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:03.207183 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f8d7a-b3ac-4156-9c2c-1b51cbccf611 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:03.207660 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f8d7a-b3ac-4156-9c2c-1b51cbccf611 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:03.218655 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217f8d7a-b3ac-4156-9c2c-1b51cbccf611 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:03.220406 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217f8d7a-b3ac-4156-9c2c-1b51cbccf611 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:03.228212 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:03.238847 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-217f8d7a-b3ac-4156-9c2c-1b51cbccf611 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:03.238847 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:03.238847 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:03.238847 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:03.238847 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:03.238847 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:03.238847 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:03.238847 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:03.238847 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:03.238847 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:03.238847 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:03.238847 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:03.238847 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:05:03.238847 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:05:03.238847 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:05:03.239702 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:05:03.239702 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:03.239702 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:03.239702 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:03.239702 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:03.239702 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:03.239702 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:03.239702 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:03.239702 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:03.239702 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:03.239702 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:03.239702 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:03.239702 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:03.239702 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:03.239702 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:03.239702 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:03.239702 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:03.240572 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:05:03.240572 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:05:03.240572 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:03.240572 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:03.242776 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 241/463] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:05:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:05:03.244219 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58749625-b116-4e28-9da5-81a935ddc3e0 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:03.244698 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58749625-b116-4e28-9da5-81a935ddc3e0 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:03.245163 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58749625-b116-4e28-9da5-81a935ddc3e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:03.262208 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-58749625-b116-4e28-9da5-81a935ddc3e0 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:05:03.264139 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-58749625-b116-4e28-9da5-81a935ddc3e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:05:03.286656 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:03.309237 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0a5123-f23f-400a-8c80-7cae697c3a7d None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:03.346124 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76af1bef-2d22-4bbb-901b-a07d61f0d95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:03.346792 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 242/464] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:05:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:05:03.347636 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58749625-b116-4e28-9da5-81a935ddc3e0 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:03.348017 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af1bef-2d22-4bbb-901b-a07d61f0d95e None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:03.348535 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af1bef-2d22-4bbb-901b-a07d61f0d95e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:03.349000 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af1bef-2d22-4bbb-901b-a07d61f0d95e None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:03.350027 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76af1bef-2d22-4bbb-901b-a07d61f0d95e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:03.351565 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76af1bef-2d22-4bbb-901b-a07d61f0d95e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:03.372971 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 223/465] 10.222.0.42 () {60 vars in 1132 bytes} [Mon Jul 4 09:05:03 2022] POST /identity/v3/users => generated 246 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:05:03.382350 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6efe193-3b6b-4941-bc9f-997f6fee1cd4 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:03.382592 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6efe193-3b6b-4941-bc9f-997f6fee1cd4 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:03.382827 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6efe193-3b6b-4941-bc9f-997f6fee1cd4 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:03.384971 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 224/466] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:05:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:05:03.386182 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6efe193-3b6b-4941-bc9f-997f6fee1cd4 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:03.473436 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:03.484187 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58749625-b116-4e28-9da5-81a935ddc3e0 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:03.518862 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6efe193-3b6b-4941-bc9f-997f6fee1cd4 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:03.535685 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df99c73a-8d19-4188-9350-3ba174d6bb6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:03.537432 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df99c73a-8d19-4188-9350-3ba174d6bb6b None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:03.537941 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df99c73a-8d19-4188-9350-3ba174d6bb6b None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:03.538583 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df99c73a-8d19-4188-9350-3ba174d6bb6b None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:03.539918 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df99c73a-8d19-4188-9350-3ba174d6bb6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:03.540409 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df99c73a-8d19-4188-9350-3ba174d6bb6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:03.542049 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df99c73a-8d19-4188-9350-3ba174d6bb6b None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:03.557693 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 243/467] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jul 4 09:05:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:03.558975 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a403da1-7374-48fa-a827-bf6448507988 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:03.559266 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a403da1-7374-48fa-a827-bf6448507988 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:03.559546 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a403da1-7374-48fa-a827-bf6448507988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:03.565775 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c7a119-4fad-4794-9e5a-e7859d7a4d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:03.565949 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7a119-4fad-4794-9e5a-e7859d7a4d44 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:03.566357 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7a119-4fad-4794-9e5a-e7859d7a4d44 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:03.566474 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7a119-4fad-4794-9e5a-e7859d7a4d44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:03.579947 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c7a119-4fad-4794-9e5a-e7859d7a4d44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:03.580397 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-3a403da1-7374-48fa-a827-bf6448507988 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:05:03.581796 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-3a403da1-7374-48fa-a827-bf6448507988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:05:03.582151 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c7a119-4fad-4794-9e5a-e7859d7a4d44 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:03.593232 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:03.602671 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-98c7a119-4fad-4794-9e5a-e7859d7a4d44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:03.602671 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:03.602671 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:03.602671 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:03.602671 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:03.602671 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:03.602671 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:03.602671 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:03.602671 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:03.602671 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:03.602671 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:03.602671 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:03.602671 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:05:03.602671 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:05:03.602671 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:05:03.603567 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:05:03.603567 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:03.603567 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:03.603567 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:03.603567 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:03.603567 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:03.603567 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:03.603567 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:03.603567 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:03.603567 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:03.603567 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:03.603567 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:03.603567 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:03.603567 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:03.603567 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:03.603567 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:03.603567 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:03.604457 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:05:03.604457 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:05:03.604457 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:03.604457 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:03.605198 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 225/468] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:05:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:03.605359 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c7a119-4fad-4794-9e5a-e7859d7a4d44 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:03.668929 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 244/469] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:05:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:05:03.670042 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a403da1-7374-48fa-a827-bf6448507988 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:03.753174 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c7a119-4fad-4794-9e5a-e7859d7a4d44 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:03.771039 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:03.789926 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a00088c-a427-4dd8-ba1d-77fc5ece9a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:03.790847 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a00088c-a427-4dd8-ba1d-77fc5ece9a8f None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:03.791262 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a00088c-a427-4dd8-ba1d-77fc5ece9a8f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:03.791679 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a00088c-a427-4dd8-ba1d-77fc5ece9a8f None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:03.792548 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a00088c-a427-4dd8-ba1d-77fc5ece9a8f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:03.793471 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a403da1-7374-48fa-a827-bf6448507988 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:03.794304 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a00088c-a427-4dd8-ba1d-77fc5ece9a8f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:03.817591 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 226/470] 10.222.0.42 () {60 vars in 1132 bytes} [Mon Jul 4 09:05:03 2022] POST /identity/v3/users => generated 248 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:05:03.825327 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a00088c-a427-4dd8-ba1d-77fc5ece9a8f None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:03.834364 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb0bd77-258f-4034-b700-d534a1571c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:03.835153 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb0bd77-258f-4034-b700-d534a1571c7e None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:03.835506 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb0bd77-258f-4034-b700-d534a1571c7e None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:03.835850 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb0bd77-258f-4034-b700-d534a1571c7e None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:03.836736 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb0bd77-258f-4034-b700-d534a1571c7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:03.837109 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb0bd77-258f-4034-b700-d534a1571c7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:03.838853 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb0bd77-258f-4034-b700-d534a1571c7e None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:03.853202 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 245/471] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jul 4 09:05:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:03.858773 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb0bd77-258f-4034-b700-d534a1571c7e None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:03.873324 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:03.955775 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a00088c-a427-4dd8-ba1d-77fc5ece9a8f None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:03.993578 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b9b7ae-e87c-40fd-a24c-0903e172c1a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:03.994390 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9b7ae-e87c-40fd-a24c-0903e172c1a9 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:03.994675 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9b7ae-e87c-40fd-a24c-0903e172c1a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:03.994947 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9b7ae-e87c-40fd-a24c-0903e172c1a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:04.008257 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b9b7ae-e87c-40fd-a24c-0903e172c1a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:04.009929 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b9b7ae-e87c-40fd-a24c-0903e172c1a9 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:04.030333 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-73b9b7ae-e87c-40fd-a24c-0903e172c1a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:04.030333 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:04.030333 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:04.030333 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:04.030333 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:04.030333 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:04.030333 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:04.030333 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:04.030333 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:04.030333 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:04.030333 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:04.030333 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:04.030333 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:05:04.030333 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:05:04.030333 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:05:04.031307 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:05:04.031307 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:04.031307 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:04.031307 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:04.031307 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:04.031307 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:04.031307 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:04.031307 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:04.031307 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:04.031307 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:04.031307 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:04.031307 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:04.031307 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:04.031307 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:04.031307 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:04.031307 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:04.031307 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:04.032186 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:05:04.032186 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:05:04.032186 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:04.032186 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:04.035899 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 227/472] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:05:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:04.035899 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283306f4-2685-474d-8a8d-7618f5e20aba None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:04.035899 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283306f4-2685-474d-8a8d-7618f5e20aba None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:04.035899 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283306f4-2685-474d-8a8d-7618f5e20aba None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:04.036508 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 228/473] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:05:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:05:04.041873 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283306f4-2685-474d-8a8d-7618f5e20aba None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:04.080103 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:04.091073 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb0bd77-258f-4034-b700-d534a1571c7e None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:04.140657 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95afba08-73f7-4d82-a671-f6b4f160d8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:04.140657 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95afba08-73f7-4d82-a671-f6b4f160d8f8 None admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:04.140942 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95afba08-73f7-4d82-a671-f6b4f160d8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:04.141727 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95afba08-73f7-4d82-a671-f6b4f160d8f8 None admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:04.142317 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95afba08-73f7-4d82-a671-f6b4f160d8f8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:04.144198 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95afba08-73f7-4d82-a671-f6b4f160d8f8 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:04.169964 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 246/474] 10.222.0.42 () {60 vars in 1132 bytes} [Mon Jul 4 09:05:03 2022] POST /identity/v3/users => generated 248 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:05:04.176010 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2aeb6-58f4-4896-b13b-b1afae904974 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:04.176771 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2aeb6-58f4-4896-b13b-b1afae904974 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:04.176771 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2aeb6-58f4-4896-b13b-b1afae904974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:04.184190 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283306f4-2685-474d-8a8d-7618f5e20aba None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:04.217190 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-21b2aeb6-58f4-4896-b13b-b1afae904974 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:05:04.218406 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-21b2aeb6-58f4-4896-b13b-b1afae904974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:05:04.250178 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e865b7f-40de-4028-86a0-2bda7dbce036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:04.250896 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e865b7f-40de-4028-86a0-2bda7dbce036 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:04.251177 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e865b7f-40de-4028-86a0-2bda7dbce036 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:04.251483 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e865b7f-40de-4028-86a0-2bda7dbce036 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:04.252241 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e865b7f-40de-4028-86a0-2bda7dbce036 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:04.252543 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e865b7f-40de-4028-86a0-2bda7dbce036 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:04.253958 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e865b7f-40de-4028-86a0-2bda7dbce036 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:04.277632 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 229/475] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jul 4 09:05:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:04.288942 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e865b7f-40de-4028-86a0-2bda7dbce036 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:04.317022 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:04.339939 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 247/476] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:05:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:05:04.364658 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2aeb6-58f4-4896-b13b-b1afae904974 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:04.411668 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:04.427905 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e865b7f-40de-4028-86a0-2bda7dbce036 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:04.462831 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8abaa96-5eb3-4a53-a1b2-6b268465c303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:04.463848 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8abaa96-5eb3-4a53-a1b2-6b268465c303 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:04.464353 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8abaa96-5eb3-4a53-a1b2-6b268465c303 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:04.464839 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8abaa96-5eb3-4a53-a1b2-6b268465c303 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:04.465747 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8abaa96-5eb3-4a53-a1b2-6b268465c303 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:04.467484 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8abaa96-5eb3-4a53-a1b2-6b268465c303 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:04.483427 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2aeb6-58f4-4896-b13b-b1afae904974 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:04.489615 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 230/477] 10.222.0.42 () {60 vars in 1132 bytes} [Mon Jul 4 09:05:04 2022] POST /identity/v3/users => generated 249 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:05:04.525713 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b074f792-234d-4d75-8ff0-953ac3bf1bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:04.526552 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074f792-234d-4d75-8ff0-953ac3bf1bc8 None admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:04.526877 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074f792-234d-4d75-8ff0-953ac3bf1bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:04.527188 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074f792-234d-4d75-8ff0-953ac3bf1bc8 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:04.528075 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b074f792-234d-4d75-8ff0-953ac3bf1bc8 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:04.529675 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b074f792-234d-4d75-8ff0-953ac3bf1bc8 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:04.538841 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.sql.core [None req-b074f792-234d-4d75-8ff0-953ac3bf1bc8 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 04 09:05:04.538841 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 04 09:05:04.538841 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [parameters: {'id': 'e07311c5eb614d2193fc85219ffe7641', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 04 09:05:04.538841 dv-cinder-844563-4-smb devstack@keystone.service[80182]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80182) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 04 09:05:04.558295 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-b074f792-234d-4d75-8ff0-953ac3bf1bc8 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 04 09:05:04.558295 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:04.558295 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 04 09:05:04.558295 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 04 09:05:04.558295 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 04 09:05:04.558295 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 04 09:05:04.558295 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 04 09:05:04.558295 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application result = self._query(query) Jul 04 09:05:04.558295 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 04 09:05:04.558295 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application conn.query(q) Jul 04 09:05:04.558295 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 04 09:05:04.558295 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 04 09:05:04.558295 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 04 09:05:04.558295 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application result.read() Jul 04 09:05:04.558295 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 04 09:05:04.559232 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 04 09:05:04.559232 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 04 09:05:04.559232 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 04 09:05:04.559232 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 04 09:05:04.559232 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 04 09:05:04.559232 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 04 09:05:04.559232 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 04 09:05:04.559232 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 04 09:05:04.559232 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:04.559232 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 04 09:05:04.559232 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:04.559232 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:04.559232 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 04 09:05:04.559232 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 04 09:05:04.559232 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 04 09:05:04.559232 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return ref.to_dict() Jul 04 09:05:04.559232 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 04 09:05:04.559232 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application next(self.gen) Jul 04 09:05:04.560218 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 04 09:05:04.560218 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application yield resource Jul 04 09:05:04.560218 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 04 09:05:04.560218 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application next(self.gen) Jul 04 09:05:04.560218 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 04 09:05:04.560218 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application self.session.rollback() Jul 04 09:05:04.560218 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 04 09:05:04.560218 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application self.force_reraise() Jul 04 09:05:04.560218 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 04 09:05:04.560218 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise self.value Jul 04 09:05:04.560218 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 04 09:05:04.560218 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 04 09:05:04.560218 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 04 09:05:04.560218 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application session.commit() Jul 04 09:05:04.560218 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 04 09:05:04.560218 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 04 09:05:04.560218 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 04 09:05:04.561149 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._prepare_impl() Jul 04 09:05:04.561149 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 04 09:05:04.561149 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application self.session.flush() Jul 04 09:05:04.561149 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 04 09:05:04.561149 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._flush(objects) Jul 04 09:05:04.561149 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 04 09:05:04.561149 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 04 09:05:04.561149 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 04 09:05:04.561149 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application compat.raise_( Jul 04 09:05:04.561149 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 04 09:05:04.561149 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception Jul 04 09:05:04.561149 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 04 09:05:04.561149 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application flush_context.execute() Jul 04 09:05:04.561149 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 04 09:05:04.561149 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rec.execute(self) Jul 04 09:05:04.561149 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 04 09:05:04.561149 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 04 09:05:04.562040 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 04 09:05:04.562040 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 04 09:05:04.562040 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 04 09:05:04.562040 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 04 09:05:04.562040 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 04 09:05:04.562040 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 04 09:05:04.562040 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 04 09:05:04.562040 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 04 09:05:04.562040 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 04 09:05:04.562040 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 04 09:05:04.562040 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 04 09:05:04.562040 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 04 09:05:04.562040 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 04 09:05:04.562040 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 04 09:05:04.562040 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 04 09:05:04.562040 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception Jul 04 09:05:04.562869 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 04 09:05:04.562869 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 04 09:05:04.562869 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 04 09:05:04.562869 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 04 09:05:04.562869 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 04 09:05:04.562869 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application result = self._query(query) Jul 04 09:05:04.562869 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 04 09:05:04.562869 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application conn.query(q) Jul 04 09:05:04.562869 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 04 09:05:04.562869 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 04 09:05:04.562869 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 04 09:05:04.562869 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application result.read() Jul 04 09:05:04.562869 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 04 09:05:04.562869 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 04 09:05:04.562869 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 04 09:05:04.562869 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 04 09:05:04.563660 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 04 09:05:04.563660 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 04 09:05:04.563660 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 04 09:05:04.563660 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 04 09:05:04.563660 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 04 09:05:04.563660 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 04 09:05:04.563660 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [parameters: {'id': 'e07311c5eb614d2193fc85219ffe7641', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 04 09:05:04.563660 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 04 09:05:04.563660 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:04.563660 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:05:04.563660 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:04.563660 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:04.563660 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:04.563660 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:04.563660 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:04.563660 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:04.566206 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:04.566206 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:04.566206 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:04.566206 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:04.566206 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:04.566206 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:04.566206 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 04 09:05:04.566206 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 04 09:05:04.566206 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:04.566206 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:04.566206 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 04 09:05:04.566206 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 04 09:05:04.566206 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 04 09:05:04.566206 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 04 09:05:04.566206 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 04 09:05:04.566206 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:04.567385 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 248/478] 10.222.0.42 () {60 vars in 1131 bytes} [Mon Jul 4 09:05:04 2022] POST /identity/v3/roles => generated 144 bytes in 196 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:04.569096 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8abaa96-5eb3-4a53-a1b2-6b268465c303 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:04.699294 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8abaa96-5eb3-4a53-a1b2-6b268465c303 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:04.737114 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3663f34c-2875-4fb2-bfd5-387f70975f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:04.737913 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3663f34c-2875-4fb2-bfd5-387f70975f03 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:04.738196 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3663f34c-2875-4fb2-bfd5-387f70975f03 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:04.738467 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3663f34c-2875-4fb2-bfd5-387f70975f03 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:04.750753 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3663f34c-2875-4fb2-bfd5-387f70975f03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:05:04.758957 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-3663f34c-2875-4fb2-bfd5-387f70975f03 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 09:05:04.758957 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:04.758957 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:04.758957 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:04.758957 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:04.758957 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:04.758957 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:04.758957 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:04.758957 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:04.758957 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:04.758957 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:04.758957 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:04.758957 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:05:04.758957 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:05:04.758957 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:05:04.758957 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:05:04.759849 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:05:04.759849 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:05:04.759849 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:05:04.759849 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:05:04.759849 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:04.759849 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:04.759849 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:04.759849 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:04.759849 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:04.759849 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:04.759849 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:04.759849 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:04.759849 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:04.759849 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:04.759849 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:04.759849 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:04.760679 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:04.760679 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:04.760679 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:04.760679 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:04.760679 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:05:04.760679 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:05:04.760679 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:05:04.760679 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:05:04.760679 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:05:04.760679 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:05:04.760679 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 09:05:04.760679 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:04.760679 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 231/479] 10.222.0.42 () {56 vars in 1114 bytes} [Mon Jul 4 09:05:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:04.766760 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b074f792-234d-4d75-8ff0-953ac3bf1bc8 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:04.831157 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:04.881748 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b074f792-234d-4d75-8ff0-953ac3bf1bc8 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:04.917983 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd35de69-7783-4376-ae37-094d1d4ac5bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:04.918717 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd35de69-7783-4376-ae37-094d1d4ac5bd None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:04.919029 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd35de69-7783-4376-ae37-094d1d4ac5bd None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:04.919329 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd35de69-7783-4376-ae37-094d1d4ac5bd None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:04.920168 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd35de69-7783-4376-ae37-094d1d4ac5bd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:04.920500 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd35de69-7783-4376-ae37-094d1d4ac5bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:04.921925 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd35de69-7783-4376-ae37-094d1d4ac5bd None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:04.931081 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 249/480] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jul 4 09:05:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:05.746655 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b813e9-201e-429e-a05d-e6613b1f6096 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:05.747634 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b813e9-201e-429e-a05d-e6613b1f6096 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:05.748159 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b813e9-201e-429e-a05d-e6613b1f6096 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:05.750065 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 232/481] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:05:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:05:05.755108 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb0d66-a21d-4313-8ad9-440983f087fd None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:05.755554 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb0d66-a21d-4313-8ad9-440983f087fd None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:05.755664 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb0d66-a21d-4313-8ad9-440983f087fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:05.777586 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-2ecb0d66-a21d-4313-8ad9-440983f087fd None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:05:05.779135 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-2ecb0d66-a21d-4313-8ad9-440983f087fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:05:05.846675 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 250/482] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:05:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:05:05.881150 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b813e9-201e-429e-a05d-e6613b1f6096 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:05.890788 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:06.005705 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b813e9-201e-429e-a05d-e6613b1f6096 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:06.047470 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3753213-0f3e-4bef-8d6b-64a2635fd040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:06.048289 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3753213-0f3e-4bef-8d6b-64a2635fd040 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:06.048573 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3753213-0f3e-4bef-8d6b-64a2635fd040 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:06.048844 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3753213-0f3e-4bef-8d6b-64a2635fd040 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:06.061905 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3753213-0f3e-4bef-8d6b-64a2635fd040 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:05:06.069682 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-f3753213-0f3e-4bef-8d6b-64a2635fd040 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:05:06.069682 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:06.069682 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:06.069682 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:06.069682 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:06.069682 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:06.069682 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:06.069682 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:06.069682 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:06.069682 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:06.069682 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:06.069682 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:06.069682 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:05:06.069682 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:05:06.069682 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:05:06.069682 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:05:06.070648 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:05:06.070648 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:05:06.070648 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:05:06.070648 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:05:06.070648 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:06.070648 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:06.070648 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:06.070648 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:06.070648 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:06.070648 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:06.070648 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:06.070648 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:06.070648 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:06.070648 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:06.070648 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:06.070648 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:06.071530 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:06.071530 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:06.071530 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:06.071530 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:06.071530 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:05:06.071530 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:05:06.071530 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:05:06.071530 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:05:06.071530 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:05:06.071530 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:05:06.071530 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:05:06.071530 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:06.071530 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 233/483] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Jul 4 09:05:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:06.080166 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb0d66-a21d-4313-8ad9-440983f087fd None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:06.151729 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:06.217085 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb0d66-a21d-4313-8ad9-440983f087fd None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:06.247125 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a973572a-81f1-429c-86aa-afbf504e3d1c None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:06.248034 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a973572a-81f1-429c-86aa-afbf504e3d1c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:06.249106 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a973572a-81f1-429c-86aa-afbf504e3d1c None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:06.255980 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 234/484] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:05:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:05:06.261925 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddda51f-4c51-4a16-9f13-1d265630cc11 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:06.262501 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddda51f-4c51-4a16-9f13-1d265630cc11 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:06.262868 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddda51f-4c51-4a16-9f13-1d265630cc11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:06.267794 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b29fbc8-aed3-43e6-954c-fa52264ba98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:06.267794 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29fbc8-aed3-43e6-954c-fa52264ba98a None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:06.267794 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29fbc8-aed3-43e6-954c-fa52264ba98a None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:06.267794 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29fbc8-aed3-43e6-954c-fa52264ba98a None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:06.270499 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b29fbc8-aed3-43e6-954c-fa52264ba98a None admin] RBAC: Adding query filter params (name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:06.270824 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b29fbc8-aed3-43e6-954c-fa52264ba98a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:06.273544 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b29fbc8-aed3-43e6-954c-fa52264ba98a None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:06.283469 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 251/485] 10.222.0.42 () {56 vars in 1103 bytes} [Mon Jul 4 09:05:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:06.288602 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b29fbc8-aed3-43e6-954c-fa52264ba98a None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:06.308546 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-5ddda51f-4c51-4a16-9f13-1d265630cc11 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:05:06.308546 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-5ddda51f-4c51-4a16-9f13-1d265630cc11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:05:06.398814 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:06.412875 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 235/486] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:05:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 09:05:06.437446 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddda51f-4c51-4a16-9f13-1d265630cc11 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:06.474740 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b29fbc8-aed3-43e6-954c-fa52264ba98a None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:06.485736 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:06.533624 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd77b20e-584d-4116-a015-3797e5ed7b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:06.534330 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd77b20e-584d-4116-a015-3797e5ed7b3e None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:06.534607 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd77b20e-584d-4116-a015-3797e5ed7b3e None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:06.534877 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd77b20e-584d-4116-a015-3797e5ed7b3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:06.553590 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd77b20e-584d-4116-a015-3797e5ed7b3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:06.555055 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd77b20e-584d-4116-a015-3797e5ed7b3e None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:06.589379 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-cd77b20e-584d-4116-a015-3797e5ed7b3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:06.589379 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:06.589379 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:06.589379 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:06.589379 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:06.589379 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:06.589379 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:06.589379 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:06.589379 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:06.589379 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:06.589379 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:06.589379 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:06.589379 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:05:06.589379 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:05:06.589379 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:05:06.590717 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:05:06.590717 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:06.590717 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:06.590717 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:06.590717 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:06.590717 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:06.590717 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:06.590717 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:06.590717 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:06.590717 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:06.590717 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:06.590717 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:06.590717 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:06.590717 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:06.590717 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:06.590717 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:06.590717 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:06.591560 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:05:06.591560 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:05:06.591560 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:06.591560 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:06.600151 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 252/487] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:05:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:06.603228 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd77b20e-584d-4116-a015-3797e5ed7b3e None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:06.615253 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddda51f-4c51-4a16-9f13-1d265630cc11 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:06.713291 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc5ecd-31b0-4d28-9727-c6d8d7927007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:06.714263 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc5ecd-31b0-4d28-9727-c6d8d7927007 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:06.714655 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc5ecd-31b0-4d28-9727-c6d8d7927007 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:06.715020 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc5ecd-31b0-4d28-9727-c6d8d7927007 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:06.728979 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd77b20e-584d-4116-a015-3797e5ed7b3e None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:06.750699 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcc5ecd-31b0-4d28-9727-c6d8d7927007 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:05:06.759066 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-7bcc5ecd-31b0-4d28-9727-c6d8d7927007 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:05:06.759066 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:06.759066 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:06.759066 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:06.759066 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:06.759066 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:06.759066 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:06.759066 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:06.759066 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:06.759066 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:06.759066 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:06.759066 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:06.759066 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:05:06.759066 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:05:06.759066 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:05:06.759066 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:05:06.759974 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:05:06.759974 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:05:06.759974 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:05:06.759974 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:05:06.759974 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:06.759974 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:06.759974 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:06.759974 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:06.759974 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:06.759974 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:06.759974 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:06.759974 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:06.759974 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:06.759974 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:06.759974 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:06.759974 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:06.761046 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:06.761046 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:06.761046 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:06.761046 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:06.761046 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:05:06.761046 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:05:06.761046 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:05:06.761046 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:05:06.761046 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:05:06.761046 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:05:06.761046 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:05:06.761046 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:06.761046 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 236/488] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Jul 4 09:05:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:05:06.767252 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc5ecd-31b0-4d28-9727-c6d8d7927007 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:06.776105 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c7b364-48ad-4e95-95b1-ec6f7c1558ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:06.778202 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c7b364-48ad-4e95-95b1-ec6f7c1558ed None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:06.778665 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c7b364-48ad-4e95-95b1-ec6f7c1558ed None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:06.779120 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c7b364-48ad-4e95-95b1-ec6f7c1558ed None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:06.780112 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c7b364-48ad-4e95-95b1-ec6f7c1558ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:06.780612 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c7b364-48ad-4e95-95b1-ec6f7c1558ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:06.782218 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c7b364-48ad-4e95-95b1-ec6f7c1558ed None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:06.796083 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 253/489] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jul 4 09:05:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:06.801086 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c7b364-48ad-4e95-95b1-ec6f7c1558ed None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:06.825421 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:06.848094 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:06.913779 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc5ecd-31b0-4d28-9727-c6d8d7927007 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:06.941526 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c7b364-48ad-4e95-95b1-ec6f7c1558ed None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:06.952871 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ec390-a3d7-465e-8f8e-d3d8a6e43a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:06.953695 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ec390-a3d7-465e-8f8e-d3d8a6e43a05 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:06.954079 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ec390-a3d7-465e-8f8e-d3d8a6e43a05 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:06.954452 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ec390-a3d7-465e-8f8e-d3d8a6e43a05 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:06.955329 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122ec390-a3d7-465e-8f8e-d3d8a6e43a05 None admin] RBAC: Adding query filter params (name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:06.955821 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122ec390-a3d7-465e-8f8e-d3d8a6e43a05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:06.957371 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122ec390-a3d7-465e-8f8e-d3d8a6e43a05 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:06.971134 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 237/490] 10.222.0.42 () {56 vars in 1103 bytes} [Mon Jul 4 09:05:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:06.971134 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d570f5-4bb1-4283-bcb8-fde85bdfab6d None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:06.971134 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d570f5-4bb1-4283-bcb8-fde85bdfab6d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:06.971134 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d570f5-4bb1-4283-bcb8-fde85bdfab6d None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:06.971134 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 238/491] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:05:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:05:06.972394 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d570f5-4bb1-4283-bcb8-fde85bdfab6d None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:06.989536 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc734e10-785b-4886-b92a-bb9b06a2550b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:06.991092 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc734e10-785b-4886-b92a-bb9b06a2550b None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:06.991908 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc734e10-785b-4886-b92a-bb9b06a2550b None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:06.992417 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc734e10-785b-4886-b92a-bb9b06a2550b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:07.002963 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc734e10-785b-4886-b92a-bb9b06a2550b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:07.005675 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc734e10-785b-4886-b92a-bb9b06a2550b None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:07.028766 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-bc734e10-785b-4886-b92a-bb9b06a2550b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 04 09:05:07.028766 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:07.028766 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:07.028766 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:07.028766 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:07.028766 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:07.028766 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:07.028766 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:07.028766 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:07.028766 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:07.028766 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:07.028766 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:07.028766 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:05:07.028766 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:05:07.028766 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:05:07.028766 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:05:07.029880 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:07.029880 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:07.029880 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:05:07.029880 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:05:07.029880 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:05:07.029880 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:05:07.029880 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:07.029880 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:07.029880 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:07.029880 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:07.029880 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:07.029880 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:07.029880 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:07.029880 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:07.029880 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:07.029880 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:07.029880 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:07.029880 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:07.030783 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:07.030783 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:07.030783 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:05:07.030783 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:05:07.030783 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:05:07.030783 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:05:07.030783 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:05:07.030783 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:05:07.030783 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 04 09:05:07.030783 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:07.033571 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 254/492] 10.222.0.42 () {56 vars in 1093 bytes} [Mon Jul 4 09:05:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:07.035349 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a63964-6cb6-4ca2-8477-9ad3eb74a5bc None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:07.036225 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a63964-6cb6-4ca2-8477-9ad3eb74a5bc None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:07.036677 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a63964-6cb6-4ca2-8477-9ad3eb74a5bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:07.058935 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-a6a63964-6cb6-4ca2-8477-9ad3eb74a5bc None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:05:07.060838 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-a6a63964-6cb6-4ca2-8477-9ad3eb74a5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:05:07.084950 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d570f5-4bb1-4283-bcb8-fde85bdfab6d None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:07.100041 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:07.130036 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b7cd2-585c-4f53-99b0-bcf602624b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:07.131853 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b7cd2-585c-4f53-99b0-bcf602624b44 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:07.132450 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b7cd2-585c-4f53-99b0-bcf602624b44 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:07.132992 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b7cd2-585c-4f53-99b0-bcf602624b44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:07.148696 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900b7cd2-585c-4f53-99b0-bcf602624b44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:07.150769 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900b7cd2-585c-4f53-99b0-bcf602624b44 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:07.152036 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 255/493] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:05:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:05:07.153207 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a63964-6cb6-4ca2-8477-9ad3eb74a5bc None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:07.165948 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:07.174999 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-900b7cd2-585c-4f53-99b0-bcf602624b44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:07.174999 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:07.174999 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:07.174999 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:07.174999 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:07.174999 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:07.174999 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:07.174999 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:07.174999 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:07.174999 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:07.174999 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:07.174999 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:07.174999 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:05:07.174999 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:05:07.174999 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:05:07.175932 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:05:07.175932 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:07.175932 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:07.175932 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:07.175932 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:07.175932 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:07.175932 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:07.175932 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:07.175932 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:07.175932 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:07.175932 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:07.175932 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:07.175932 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:07.175932 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:07.175932 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:07.175932 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:07.175932 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:07.176793 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:05:07.176793 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:05:07.176793 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:07.176793 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:07.177016 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 239/494] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:05:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:07.184899 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b7cd2-585c-4f53-99b0-bcf602624b44 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:07.282157 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a63964-6cb6-4ca2-8477-9ad3eb74a5bc None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:07.320743 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b7cd2-585c-4f53-99b0-bcf602624b44 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:07.323810 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1621341a-e4dc-4455-87f0-5761cc9c50f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:07.324742 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621341a-e4dc-4455-87f0-5761cc9c50f8 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:07.325227 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621341a-e4dc-4455-87f0-5761cc9c50f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:07.325701 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621341a-e4dc-4455-87f0-5761cc9c50f8 None admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:07.326832 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1621341a-e4dc-4455-87f0-5761cc9c50f8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:07.327367 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1621341a-e4dc-4455-87f0-5761cc9c50f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:07.329564 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1621341a-e4dc-4455-87f0-5761cc9c50f8 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:07.355990 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b84f4f2-c1c3-4b49-a8da-3cb505f96fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:07.356720 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84f4f2-c1c3-4b49-a8da-3cb505f96fd6 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:07.357003 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84f4f2-c1c3-4b49-a8da-3cb505f96fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:07.357335 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84f4f2-c1c3-4b49-a8da-3cb505f96fd6 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:07.358129 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b84f4f2-c1c3-4b49-a8da-3cb505f96fd6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:07.358441 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b84f4f2-c1c3-4b49-a8da-3cb505f96fd6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:07.360263 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b84f4f2-c1c3-4b49-a8da-3cb505f96fd6 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:07.375982 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 240/495] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jul 4 09:05:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:07.375982 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b84f4f2-c1c3-4b49-a8da-3cb505f96fd6 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:07.390119 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 256/496] 10.222.0.42 () {56 vars in 1133 bytes} [Mon Jul 4 09:05:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:07.391226 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1621341a-e4dc-4455-87f0-5761cc9c50f8 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:07.414376 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:07.470854 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:07.492391 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b84f4f2-c1c3-4b49-a8da-3cb505f96fd6 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:07.513427 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1621341a-e4dc-4455-87f0-5761cc9c50f8 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:07.527663 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59ba6bc-30b2-47e2-b287-00d76cb3ddbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:07.528490 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ba6bc-30b2-47e2-b287-00d76cb3ddbb None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:07.528761 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ba6bc-30b2-47e2-b287-00d76cb3ddbb None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:07.529029 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ba6bc-30b2-47e2-b287-00d76cb3ddbb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:07.539063 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59ba6bc-30b2-47e2-b287-00d76cb3ddbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:05:07.546744 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-c59ba6bc-30b2-47e2-b287-00d76cb3ddbb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:05:07.546744 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:07.546744 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:07.546744 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:07.546744 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:07.546744 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:07.546744 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:07.546744 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:07.546744 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:07.546744 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:07.546744 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:07.546744 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:07.546744 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:05:07.546744 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:05:07.546744 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:05:07.546744 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:05:07.547645 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:05:07.547645 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:05:07.547645 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:05:07.547645 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:05:07.547645 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:07.547645 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:07.547645 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:07.547645 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:07.547645 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:07.547645 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:07.547645 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:07.547645 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:07.547645 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:07.547645 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:07.547645 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:07.547645 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:07.548487 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:07.548487 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:07.548487 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:07.548487 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:07.548487 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:05:07.548487 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:05:07.548487 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:05:07.548487 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:05:07.548487 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:05:07.548487 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:05:07.548487 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:05:07.548487 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:07.548487 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 241/497] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Jul 4 09:05:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:07.549156 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59ba6bc-30b2-47e2-b287-00d76cb3ddbb None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:07.555753 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e13f2ef-3b29-41f6-90d7-c5fa40c9e258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:07.556586 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13f2ef-3b29-41f6-90d7-c5fa40c9e258 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:07.556872 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13f2ef-3b29-41f6-90d7-c5fa40c9e258 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:07.557145 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13f2ef-3b29-41f6-90d7-c5fa40c9e258 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:07.565138 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e13f2ef-3b29-41f6-90d7-c5fa40c9e258 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:07.566623 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e13f2ef-3b29-41f6-90d7-c5fa40c9e258 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:07.582800 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-6e13f2ef-3b29-41f6-90d7-c5fa40c9e258 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 04 09:05:07.582800 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:07.582800 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:07.582800 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:07.582800 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:07.582800 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:07.582800 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:07.582800 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:07.582800 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:07.582800 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:07.582800 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:07.582800 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:07.582800 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:05:07.582800 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:05:07.582800 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:05:07.582800 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:05:07.584067 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:07.584067 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:07.584067 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:05:07.584067 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:05:07.584067 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:05:07.584067 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:05:07.584067 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:07.584067 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:07.584067 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:07.584067 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:07.584067 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:07.584067 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:07.584067 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:07.584067 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:07.584067 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:07.584067 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:07.584067 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:07.584067 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:07.590700 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:07.590700 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:07.590700 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:05:07.590700 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:05:07.590700 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:05:07.590700 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:05:07.590700 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:05:07.590700 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:05:07.590700 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 04 09:05:07.590700 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:07.590700 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 257/498] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jul 4 09:05:07 2022] GET /identity/v3/users/glance => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:07.590700 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3e34c-3166-42bb-b3d7-4bf225666517 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:07.590700 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3e34c-3166-42bb-b3d7-4bf225666517 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:07.592275 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3e34c-3166-42bb-b3d7-4bf225666517 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:07.592275 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 258/499] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:05:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:05:07.592275 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3e34c-3166-42bb-b3d7-4bf225666517 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:07.644471 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:07.659923 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59ba6bc-30b2-47e2-b287-00d76cb3ddbb None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:07.692287 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3e34c-3166-42bb-b3d7-4bf225666517 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:07.693737 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62495d08-c1c9-4629-b82f-7245f8b27382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:07.694405 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62495d08-c1c9-4629-b82f-7245f8b27382 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:07.694682 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62495d08-c1c9-4629-b82f-7245f8b27382 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:07.694949 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62495d08-c1c9-4629-b82f-7245f8b27382 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:07.720142 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:07.729016 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83fe37f-83cd-4226-9693-d3baa2d7240b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:07.729679 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83fe37f-83cd-4226-9693-d3baa2d7240b None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:07.729961 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83fe37f-83cd-4226-9693-d3baa2d7240b None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:07.730237 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83fe37f-83cd-4226-9693-d3baa2d7240b None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:07.730987 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83fe37f-83cd-4226-9693-d3baa2d7240b None admin] RBAC: Adding query filter params (name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:07.731293 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83fe37f-83cd-4226-9693-d3baa2d7240b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:07.732739 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83fe37f-83cd-4226-9693-d3baa2d7240b None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:07.740998 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 259/500] 10.222.0.42 () {56 vars in 1103 bytes} [Mon Jul 4 09:05:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:07.742164 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce5e9b1-42cc-48dd-bb81-118d1d0249e9 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:07.742448 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce5e9b1-42cc-48dd-bb81-118d1d0249e9 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:07.742721 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce5e9b1-42cc-48dd-bb81-118d1d0249e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:07.760693 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-dce5e9b1-42cc-48dd-bb81-118d1d0249e9 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:05:07.761880 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-dce5e9b1-42cc-48dd-bb81-118d1d0249e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:05:07.762001 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62495d08-c1c9-4629-b82f-7245f8b27382 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:07.763386 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62495d08-c1c9-4629-b82f-7245f8b27382 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:07.825333 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 260/501] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:05:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:05:07.826292 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce5e9b1-42cc-48dd-bb81-118d1d0249e9 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:07.847326 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:07.864139 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 242/502] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jul 4 09:05:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:05:07.869889 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac64741-f7ca-4dd1-a455-97cda3a5f98d None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:07.870183 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac64741-f7ca-4dd1-a455-97cda3a5f98d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:07.870459 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac64741-f7ca-4dd1-a455-97cda3a5f98d None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:07.871755 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 243/503] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:05:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:05:07.872471 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac64741-f7ca-4dd1-a455-97cda3a5f98d None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:07.933613 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce5e9b1-42cc-48dd-bb81-118d1d0249e9 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:07.953115 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:07.966668 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba093ba-9691-40ef-a043-7ee7defa6fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:07.967391 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba093ba-9691-40ef-a043-7ee7defa6fa5 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:07.967679 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba093ba-9691-40ef-a043-7ee7defa6fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:07.967992 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba093ba-9691-40ef-a043-7ee7defa6fa5 None admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:07.968851 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba093ba-9691-40ef-a043-7ee7defa6fa5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:07.969142 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba093ba-9691-40ef-a043-7ee7defa6fa5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:07.970639 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba093ba-9691-40ef-a043-7ee7defa6fa5 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:07.977417 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac64741-f7ca-4dd1-a455-97cda3a5f98d None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:07.988319 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 261/504] 10.222.0.42 () {56 vars in 1137 bytes} [Mon Jul 4 09:05:07 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:07.989370 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba093ba-9691-40ef-a043-7ee7defa6fa5 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:08.012080 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2aa6a6-5a76-44ad-8a8f-cd2abeb4588d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:08.012873 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2aa6a6-5a76-44ad-8a8f-cd2abeb4588d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:08.013159 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2aa6a6-5a76-44ad-8a8f-cd2abeb4588d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:08.013432 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2aa6a6-5a76-44ad-8a8f-cd2abeb4588d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:08.023222 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2aa6a6-5a76-44ad-8a8f-cd2abeb4588d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:08.024713 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2aa6a6-5a76-44ad-8a8f-cd2abeb4588d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:08.042006 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-ee2aa6a6-5a76-44ad-8a8f-cd2abeb4588d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:08.042006 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:08.042006 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:08.042006 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:08.042006 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:08.042006 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:08.042006 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:08.042006 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:08.042006 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:08.042006 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:08.042006 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:08.042006 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:08.042006 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:05:08.042006 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:05:08.042006 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:05:08.042892 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:05:08.042892 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:08.042892 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:08.042892 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:08.042892 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:08.042892 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:08.042892 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:08.042892 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:08.042892 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:08.042892 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:08.042892 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:08.042892 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:08.042892 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:08.042892 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:08.042892 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:08.042892 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:08.042892 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:08.043740 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:05:08.043740 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:05:08.043740 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:08.043740 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:08.044204 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 244/505] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:05:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:08.045131 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2aa6a6-5a76-44ad-8a8f-cd2abeb4588d None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:08.085820 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:08.089703 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba093ba-9691-40ef-a043-7ee7defa6fa5 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:08.123952 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d28f17-d661-490e-8839-267c50862170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:08.124697 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d28f17-d661-490e-8839-267c50862170 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:08.125204 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d28f17-d661-490e-8839-267c50862170 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:08.125318 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d28f17-d661-490e-8839-267c50862170 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:08.135198 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d28f17-d661-490e-8839-267c50862170 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:05:08.142983 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-a4d28f17-d661-490e-8839-267c50862170 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:05:08.142983 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:08.142983 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:08.142983 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:08.142983 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:08.142983 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:08.142983 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:08.142983 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:08.142983 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:08.142983 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:08.142983 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:08.142983 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:08.142983 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:05:08.142983 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:05:08.142983 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:05:08.142983 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:05:08.144064 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:05:08.144064 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:05:08.144064 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:05:08.144064 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:05:08.144064 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:08.144064 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:08.144064 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:08.144064 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:08.144064 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:08.144064 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:08.144064 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:08.144064 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:08.144064 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:08.144064 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:08.144064 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:08.144064 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:08.145057 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:08.145057 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:08.145057 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:08.145057 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:08.145057 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:05:08.145057 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:05:08.145057 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:05:08.145057 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:05:08.145057 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:05:08.145057 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:05:08.145057 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:05:08.145057 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:08.145057 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 262/506] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Jul 4 09:05:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:08.148702 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2aa6a6-5a76-44ad-8a8f-cd2abeb4588d None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:08.150239 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9803246f-fe70-4181-a67d-a8e86f277e29 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:08.150535 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9803246f-fe70-4181-a67d-a8e86f277e29 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:08.150801 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9803246f-fe70-4181-a67d-a8e86f277e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:08.166969 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-9803246f-fe70-4181-a67d-a8e86f277e29 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:05:08.168191 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-9803246f-fe70-4181-a67d-a8e86f277e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:05:08.183516 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e85abf9-5432-4c11-b125-88bac7b02bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:08.184337 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85abf9-5432-4c11-b125-88bac7b02bc4 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:08.184649 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85abf9-5432-4c11-b125-88bac7b02bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:08.184943 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85abf9-5432-4c11-b125-88bac7b02bc4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:08.195470 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e85abf9-5432-4c11-b125-88bac7b02bc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:08.197123 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e85abf9-5432-4c11-b125-88bac7b02bc4 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:08.198941 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:08.215748 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-4e85abf9-5432-4c11-b125-88bac7b02bc4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:08.215748 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:08.215748 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:08.215748 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:08.215748 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:08.215748 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:08.215748 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:08.215748 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:08.215748 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:08.215748 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:08.215748 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:08.215748 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:08.215748 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:05:08.215748 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:05:08.215748 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:05:08.216812 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:05:08.216812 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:08.216812 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:08.216812 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:08.216812 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:08.216812 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:08.216812 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:08.216812 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:08.216812 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:08.216812 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:08.216812 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:08.216812 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:08.216812 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:08.216812 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:08.216812 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:08.216812 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:08.216812 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:08.217838 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:05:08.217838 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:05:08.217838 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:08.217838 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:08.217838 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 245/507] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:05:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:08.218231 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e85abf9-5432-4c11-b125-88bac7b02bc4 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:08.239311 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 263/508] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:05:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:05:08.240183 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9803246f-fe70-4181-a67d-a8e86f277e29 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:08.321456 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:08.332353 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e85abf9-5432-4c11-b125-88bac7b02bc4 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:08.338386 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9803246f-fe70-4181-a67d-a8e86f277e29 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:08.366802 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d43c53-6604-4aa1-8052-7eee5e4b6f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:08.367449 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d43c53-6604-4aa1-8052-7eee5e4b6f29 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:08.367730 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d43c53-6604-4aa1-8052-7eee5e4b6f29 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:08.368035 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d43c53-6604-4aa1-8052-7eee5e4b6f29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:08.371769 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e183bd-f7c7-4c16-9d00-ba85a4ffa5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:08.372451 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e183bd-f7c7-4c16-9d00-ba85a4ffa5fc None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:08.372732 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e183bd-f7c7-4c16-9d00-ba85a4ffa5fc None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:08.373006 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e183bd-f7c7-4c16-9d00-ba85a4ffa5fc None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:08.373775 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e183bd-f7c7-4c16-9d00-ba85a4ffa5fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:08.374129 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e183bd-f7c7-4c16-9d00-ba85a4ffa5fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:08.375474 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e183bd-f7c7-4c16-9d00-ba85a4ffa5fc None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:08.386416 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 264/509] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jul 4 09:05:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:08.387411 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e183bd-f7c7-4c16-9d00-ba85a4ffa5fc None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:08.414763 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:08.441533 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d43c53-6604-4aa1-8052-7eee5e4b6f29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:08.443129 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d43c53-6604-4aa1-8052-7eee5e4b6f29 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:08.485982 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e183bd-f7c7-4c16-9d00-ba85a4ffa5fc None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:08.520054 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ad0345-6c22-4bb7-a331-00fa4bdf5f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:08.520718 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad0345-6c22-4bb7-a331-00fa4bdf5f41 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:08.521003 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad0345-6c22-4bb7-a331-00fa4bdf5f41 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:08.521281 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad0345-6c22-4bb7-a331-00fa4bdf5f41 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:08.522034 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ad0345-6c22-4bb7-a331-00fa4bdf5f41 None admin] RBAC: Adding query filter params (name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:08.522350 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ad0345-6c22-4bb7-a331-00fa4bdf5f41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:08.523724 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ad0345-6c22-4bb7-a331-00fa4bdf5f41 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:08.531917 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 265/510] 10.222.0.42 () {56 vars in 1103 bytes} [Mon Jul 4 09:05:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:08.532665 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ad0345-6c22-4bb7-a331-00fa4bdf5f41 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:08.532784 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:08.543223 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 246/511] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jul 4 09:05:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:05:08.544068 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d43c53-6604-4aa1-8052-7eee5e4b6f29 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:08.630522 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:08.640496 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d43c53-6604-4aa1-8052-7eee5e4b6f29 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:08.641397 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ad0345-6c22-4bb7-a331-00fa4bdf5f41 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:08.674257 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b85b32-e7e7-4913-94c9-6eec94eeb0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:08.674632 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa226709-cb7c-4b4f-aa23-6b66bfd00ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:08.675041 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b85b32-e7e7-4913-94c9-6eec94eeb0ef None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:08.675290 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa226709-cb7c-4b4f-aa23-6b66bfd00ce4 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:08.675382 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b85b32-e7e7-4913-94c9-6eec94eeb0ef None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:08.675570 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa226709-cb7c-4b4f-aa23-6b66bfd00ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:08.675679 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b85b32-e7e7-4913-94c9-6eec94eeb0ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:08.675839 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa226709-cb7c-4b4f-aa23-6b66bfd00ce4 None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:08.676578 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa226709-cb7c-4b4f-aa23-6b66bfd00ce4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:08.676880 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa226709-cb7c-4b4f-aa23-6b66bfd00ce4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:08.678290 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa226709-cb7c-4b4f-aa23-6b66bfd00ce4 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:08.685486 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b85b32-e7e7-4913-94c9-6eec94eeb0ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:08.686973 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b85b32-e7e7-4913-94c9-6eec94eeb0ef None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:08.689917 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 266/512] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jul 4 09:05:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:08.690702 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa226709-cb7c-4b4f-aa23-6b66bfd00ce4 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:08.706158 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-b3b85b32-e7e7-4913-94c9-6eec94eeb0ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:08.706158 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:08.706158 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:08.706158 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:08.706158 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:08.706158 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:08.706158 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:08.706158 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:08.706158 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:08.706158 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:08.706158 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:08.706158 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:08.706158 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:05:08.706158 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:05:08.706158 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:05:08.707259 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:05:08.707259 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:08.707259 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:08.707259 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:08.707259 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:08.707259 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:08.707259 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:08.707259 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:08.707259 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:08.707259 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:08.707259 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:08.707259 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:08.707259 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:08.707259 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:08.707259 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:08.707259 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:08.707259 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:08.708626 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:05:08.708626 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:05:08.708626 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:08.708626 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:08.708626 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 247/513] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:05:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:08.708626 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b85b32-e7e7-4913-94c9-6eec94eeb0ef None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:08.753548 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:08.795959 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa226709-cb7c-4b4f-aa23-6b66bfd00ce4 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:08.813101 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b85b32-e7e7-4913-94c9-6eec94eeb0ef None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:08.830674 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d8afb3-2b10-43a2-8205-eff7e897cd87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:08.831570 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d8afb3-2b10-43a2-8205-eff7e897cd87 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:08.831855 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d8afb3-2b10-43a2-8205-eff7e897cd87 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:08.832163 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d8afb3-2b10-43a2-8205-eff7e897cd87 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:08.839332 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d8afb3-2b10-43a2-8205-eff7e897cd87 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:08.840846 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d8afb3-2b10-43a2-8205-eff7e897cd87 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:08.847391 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780513ef-ec33-4745-be12-7701932b7cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:08.848201 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780513ef-ec33-4745-be12-7701932b7cbf None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:08.848479 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780513ef-ec33-4745-be12-7701932b7cbf None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:08.848744 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780513ef-ec33-4745-be12-7701932b7cbf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:08.856074 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-c2d8afb3-2b10-43a2-8205-eff7e897cd87 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 04 09:05:08.856074 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:08.856074 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:08.856074 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:08.856074 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:08.856074 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:08.856074 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:08.856074 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:08.856074 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:08.856074 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:08.856074 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:08.856074 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:08.856074 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:05:08.856074 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:05:08.856074 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:05:08.856074 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:05:08.857031 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:08.857031 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:08.857031 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:05:08.857031 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:05:08.857031 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:05:08.857031 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:05:08.857031 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:08.857031 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:08.857031 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:08.857031 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:08.857031 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:08.857031 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:08.857031 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:08.857031 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:08.857031 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:08.857031 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:08.857031 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:08.857031 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:08.858029 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:08.858029 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:08.858029 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:05:08.858029 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:05:08.858029 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:05:08.858029 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:05:08.858029 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:05:08.858029 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:05:08.858029 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 04 09:05:08.858029 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:08.858029 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 267/514] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jul 4 09:05:08 2022] GET /identity/v3/users/cinder => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:08.858597 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d8afb3-2b10-43a2-8205-eff7e897cd87 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:08.861989 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780513ef-ec33-4745-be12-7701932b7cbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:08.863486 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780513ef-ec33-4745-be12-7701932b7cbf None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:08.871618 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:08.882013 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-780513ef-ec33-4745-be12-7701932b7cbf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:08.882013 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:08.882013 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:08.882013 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:08.882013 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:08.882013 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:08.882013 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:08.882013 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:08.882013 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:08.882013 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:08.882013 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:08.882013 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:08.882013 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:05:08.882013 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:05:08.882013 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:05:08.883015 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:05:08.883015 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:08.883015 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:08.883015 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:08.883015 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:08.883015 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:08.883015 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:08.883015 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:08.883015 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:08.883015 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:08.883015 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:08.883015 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:08.883015 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:08.883015 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:08.883015 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:08.883015 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:08.883015 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:08.884122 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:05:08.884122 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:05:08.884122 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:08.884122 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:08.885681 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 248/515] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:05:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:08.886589 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780513ef-ec33-4745-be12-7701932b7cbf None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:08.964758 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d8afb3-2b10-43a2-8205-eff7e897cd87 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:08.982971 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:08.990580 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780513ef-ec33-4745-be12-7701932b7cbf None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:09.001352 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dd2342-50b1-4690-991f-4de24b108d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:09.002144 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd2342-50b1-4690-991f-4de24b108d59 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:09.002425 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd2342-50b1-4690-991f-4de24b108d59 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:09.002700 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd2342-50b1-4690-991f-4de24b108d59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:09.012918 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dd2342-50b1-4690-991f-4de24b108d59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:09.014441 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dd2342-50b1-4690-991f-4de24b108d59 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:09.025220 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bd4b5e-f7d5-457e-8b1f-3c1b246e0549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:09.025998 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bd4b5e-f7d5-457e-8b1f-3c1b246e0549 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:09.026278 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bd4b5e-f7d5-457e-8b1f-3c1b246e0549 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:09.026536 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bd4b5e-f7d5-457e-8b1f-3c1b246e0549 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:09.031554 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-58dd2342-50b1-4690-991f-4de24b108d59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:09.031554 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:09.031554 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:09.031554 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:09.031554 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:09.031554 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:09.031554 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:09.031554 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:09.031554 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:09.031554 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:09.031554 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:09.031554 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:09.031554 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:05:09.031554 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:05:09.031554 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:05:09.032444 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:05:09.032444 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:09.032444 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:09.032444 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:09.032444 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:09.032444 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:09.032444 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:09.032444 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:09.032444 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:09.032444 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:09.032444 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:09.032444 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:09.032444 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:09.032444 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:09.032444 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:09.032444 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:09.032444 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:09.033295 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:05:09.033295 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:05:09.033295 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:09.033295 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:09.033295 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 268/516] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:05:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:09.034065 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dd2342-50b1-4690-991f-4de24b108d59 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:09.034772 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bd4b5e-f7d5-457e-8b1f-3c1b246e0549 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:09.036272 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bd4b5e-f7d5-457e-8b1f-3c1b246e0549 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:09.051532 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-86bd4b5e-f7d5-457e-8b1f-3c1b246e0549 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:05:09.051532 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:09.051532 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:09.051532 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:09.051532 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:09.051532 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:09.051532 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:09.051532 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:09.051532 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:09.051532 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:09.051532 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:09.051532 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:09.051532 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:05:09.051532 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:05:09.051532 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:05:09.052613 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:05:09.052613 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:09.052613 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:09.052613 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:09.052613 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:09.052613 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:09.052613 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:09.052613 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:09.052613 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:09.052613 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:09.052613 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:09.052613 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:09.052613 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:09.052613 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:09.052613 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:09.052613 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:09.052613 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:09.053496 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:05:09.053496 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:05:09.053496 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:05:09.053496 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:05:09.053496 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:05:09.053496 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:05:09.053496 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:05:09.053496 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:09.053496 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 249/517] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jul 4 09:05:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:09.053496 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bd4b5e-f7d5-457e-8b1f-3c1b246e0549 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:09.099085 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:09.137916 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dd2342-50b1-4690-991f-4de24b108d59 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:09.158496 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bd4b5e-f7d5-457e-8b1f-3c1b246e0549 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:09.170913 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0302e3-646d-422a-bd01-e22c34d875da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:09.171566 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0302e3-646d-422a-bd01-e22c34d875da None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:09.171846 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0302e3-646d-422a-bd01-e22c34d875da None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:09.172152 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0302e3-646d-422a-bd01-e22c34d875da None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:09.172869 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0302e3-646d-422a-bd01-e22c34d875da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:09.173167 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0302e3-646d-422a-bd01-e22c34d875da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:09.174560 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0302e3-646d-422a-bd01-e22c34d875da None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:09.185468 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 269/518] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jul 4 09:05:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:09.186314 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0302e3-646d-422a-bd01-e22c34d875da None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:09.195831 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67368deb-93c0-468c-9df2-571a6f9a01a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:09.196540 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67368deb-93c0-468c-9df2-571a6f9a01a2 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:09.196823 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67368deb-93c0-468c-9df2-571a6f9a01a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:09.197098 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67368deb-93c0-468c-9df2-571a6f9a01a2 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:09.197940 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67368deb-93c0-468c-9df2-571a6f9a01a2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:09.198247 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67368deb-93c0-468c-9df2-571a6f9a01a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:09.199693 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67368deb-93c0-468c-9df2-571a6f9a01a2 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:09.235583 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 250/519] 10.222.0.42 () {56 vars in 1137 bytes} [Mon Jul 4 09:05:09 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:09.236532 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67368deb-93c0-468c-9df2-571a6f9a01a2 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:09.251568 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:09.282425 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0302e3-646d-422a-bd01-e22c34d875da None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:09.303630 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:09.315842 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f8231-9cb0-47d6-b0ab-f21c081809ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:09.316519 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f8231-9cb0-47d6-b0ab-f21c081809ce None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:09.316800 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f8231-9cb0-47d6-b0ab-f21c081809ce None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:09.317072 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f8231-9cb0-47d6-b0ab-f21c081809ce None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:09.317786 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7f8231-9cb0-47d6-b0ab-f21c081809ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:09.318086 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7f8231-9cb0-47d6-b0ab-f21c081809ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:09.319463 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7f8231-9cb0-47d6-b0ab-f21c081809ce None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:09.330980 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 270/520] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jul 4 09:05:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:09.331749 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f8231-9cb0-47d6-b0ab-f21c081809ce None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:09.338348 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67368deb-93c0-468c-9df2-571a6f9a01a2 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:09.372886 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b87f39-7196-41a9-8c6b-c7cb5bd56588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:09.373627 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b87f39-7196-41a9-8c6b-c7cb5bd56588 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:09.373907 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b87f39-7196-41a9-8c6b-c7cb5bd56588 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:09.374179 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b87f39-7196-41a9-8c6b-c7cb5bd56588 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:09.374888 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b87f39-7196-41a9-8c6b-c7cb5bd56588 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:09.375193 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b87f39-7196-41a9-8c6b-c7cb5bd56588 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:09.376656 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b87f39-7196-41a9-8c6b-c7cb5bd56588 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:09.387501 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 251/521] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jul 4 09:05:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:09.388346 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b87f39-7196-41a9-8c6b-c7cb5bd56588 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:09.430817 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f8231-9cb0-47d6-b0ab-f21c081809ce None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:09.457069 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:09.464633 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daccbfc1-65af-4b1b-be9e-b85cb3ba91da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:09.465294 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daccbfc1-65af-4b1b-be9e-b85cb3ba91da None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:09.465580 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daccbfc1-65af-4b1b-be9e-b85cb3ba91da None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:09.465858 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daccbfc1-65af-4b1b-be9e-b85cb3ba91da None admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:09.466662 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daccbfc1-65af-4b1b-be9e-b85cb3ba91da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:09.466970 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daccbfc1-65af-4b1b-be9e-b85cb3ba91da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:09.468551 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daccbfc1-65af-4b1b-be9e-b85cb3ba91da None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:09.485826 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b87f39-7196-41a9-8c6b-c7cb5bd56588 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:09.487437 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 271/522] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Jul 4 09:05:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:09.488102 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daccbfc1-65af-4b1b-be9e-b85cb3ba91da None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:09.525634 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78679000-3145-4b9b-b581-fbeac534a0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:09.526296 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78679000-3145-4b9b-b581-fbeac534a0a5 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:09.526574 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78679000-3145-4b9b-b581-fbeac534a0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:09.526825 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78679000-3145-4b9b-b581-fbeac534a0a5 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:09.527545 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78679000-3145-4b9b-b581-fbeac534a0a5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:09.529046 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78679000-3145-4b9b-b581-fbeac534a0a5 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:09.530425 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:09.557094 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 252/523] 10.222.0.42 () {60 vars in 1132 bytes} [Mon Jul 4 09:05:09 2022] POST /identity/v3/users => generated 247 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:05:09.557094 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78679000-3145-4b9b-b581-fbeac534a0a5 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:09.593456 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daccbfc1-65af-4b1b-be9e-b85cb3ba91da None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:09.638290 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fd07d3-6869-41df-9092-304a5ba04624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:09.639089 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd07d3-6869-41df-9092-304a5ba04624 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:09.639279 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd07d3-6869-41df-9092-304a5ba04624 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:09.639540 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd07d3-6869-41df-9092-304a5ba04624 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:09.688769 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78679000-3145-4b9b-b581-fbeac534a0a5 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:09.716160 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fd07d3-6869-41df-9092-304a5ba04624 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:09.717677 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fd07d3-6869-41df-9092-304a5ba04624 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:09.718713 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:09.730194 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e9cdd0-7cba-4ca5-a30c-6bf3778ab21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:09.731034 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e9cdd0-7cba-4ca5-a30c-6bf3778ab21d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:09.731346 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e9cdd0-7cba-4ca5-a30c-6bf3778ab21d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:09.731651 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e9cdd0-7cba-4ca5-a30c-6bf3778ab21d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:09.740757 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e9cdd0-7cba-4ca5-a30c-6bf3778ab21d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:09.742252 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e9cdd0-7cba-4ca5-a30c-6bf3778ab21d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:09.761703 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-14e9cdd0-7cba-4ca5-a30c-6bf3778ab21d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 04 09:05:09.761703 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:09.761703 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:09.761703 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:09.761703 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:09.761703 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:09.761703 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:09.761703 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:09.761703 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:09.761703 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:09.761703 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:09.761703 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:09.761703 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:05:09.761703 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:05:09.761703 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:05:09.761703 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:05:09.762755 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:09.762755 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:09.762755 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:05:09.762755 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:05:09.762755 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:05:09.762755 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:05:09.762755 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:09.762755 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:09.762755 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:09.762755 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:09.762755 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:09.762755 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:09.762755 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:09.762755 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:09.762755 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:09.762755 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:09.762755 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:09.762755 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:09.763649 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:09.763649 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:09.763649 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:05:09.763649 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:05:09.763649 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:05:09.763649 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:05:09.763649 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:05:09.763649 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:05:09.763649 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 04 09:05:09.763649 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:09.763649 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 253/524] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Jul 4 09:05:09 2022] GET /identity/v3/users/neutron => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:09.764499 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:09.764579 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e9cdd0-7cba-4ca5-a30c-6bf3778ab21d None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:09.827369 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 272/525] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jul 4 09:05:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:05:09.828504 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fd07d3-6869-41df-9092-304a5ba04624 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:09.888592 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e9cdd0-7cba-4ca5-a30c-6bf3778ab21d None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:09.926938 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a4fb4c-a916-411d-8e36-d3515a11845f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:09.927919 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a4fb4c-a916-411d-8e36-d3515a11845f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:09.928199 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a4fb4c-a916-411d-8e36-d3515a11845f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:09.928464 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a4fb4c-a916-411d-8e36-d3515a11845f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:09.937525 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a4fb4c-a916-411d-8e36-d3515a11845f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:09.939037 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a4fb4c-a916-411d-8e36-d3515a11845f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:09.940222 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fd07d3-6869-41df-9092-304a5ba04624 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:09.954473 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-46a4fb4c-a916-411d-8e36-d3515a11845f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:05:09.954473 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:09.954473 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:09.954473 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:09.954473 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:09.954473 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:09.954473 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:09.954473 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:09.954473 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:09.954473 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:09.954473 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:09.954473 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:09.954473 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:05:09.954473 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:05:09.954473 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:05:09.955355 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:05:09.955355 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:09.955355 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:09.955355 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:09.955355 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:09.955355 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:09.955355 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:09.955355 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:09.955355 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:09.955355 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:09.955355 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:09.955355 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:09.955355 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:09.955355 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:09.955355 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:09.955355 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:09.955355 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:09.956331 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:05:09.956331 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:05:09.956331 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:05:09.956331 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:05:09.956331 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:05:09.956331 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:05:09.956331 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:05:09.956331 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:09.956331 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 254/526] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jul 4 09:05:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:09.956792 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a4fb4c-a916-411d-8e36-d3515a11845f None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:09.988240 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36329d5e-ee27-48fb-b9ee-b04fd8d1d27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:09.988893 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36329d5e-ee27-48fb-b9ee-b04fd8d1d27f None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:09.989230 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36329d5e-ee27-48fb-b9ee-b04fd8d1d27f None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:09.989428 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36329d5e-ee27-48fb-b9ee-b04fd8d1d27f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:09.990254 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36329d5e-ee27-48fb-b9ee-b04fd8d1d27f None admin] RBAC: Adding query filter params (role.id=6cc6801f39634594b9183000ff34fbf2, scope.project.id=d015d4f3d9d4464983ff561e8e08523c, user.id=af3b6e252a8c434a99432bcece6493b3) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:09.990560 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36329d5e-ee27-48fb-b9ee-b04fd8d1d27f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:09.992034 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36329d5e-ee27-48fb-b9ee-b04fd8d1d27f None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:09.997696 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 273/527] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Jul 4 09:05:09 2022] GET /identity/v3/role_assignments?user.id=af3b6e252a8c434a99432bcece6493b3&scope.project.id=d015d4f3d9d4464983ff561e8e08523c&role.id=6cc6801f39634594b9183000ff34fbf2 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:09.998581 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36329d5e-ee27-48fb-b9ee-b04fd8d1d27f None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:10.007486 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:10.021557 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:10.088887 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a4fb4c-a916-411d-8e36-d3515a11845f None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:10.128509 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae43b54b-221e-4ecd-8343-0bcdc650948a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:10.129193 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae43b54b-221e-4ecd-8343-0bcdc650948a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:10.129487 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae43b54b-221e-4ecd-8343-0bcdc650948a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:10.130051 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae43b54b-221e-4ecd-8343-0bcdc650948a None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:10.130600 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae43b54b-221e-4ecd-8343-0bcdc650948a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:10.130918 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae43b54b-221e-4ecd-8343-0bcdc650948a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:10.132436 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae43b54b-221e-4ecd-8343-0bcdc650948a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:10.140969 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36329d5e-ee27-48fb-b9ee-b04fd8d1d27f None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:10.154956 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 255/528] 10.222.0.42 () {56 vars in 1139 bytes} [Mon Jul 4 09:05:09 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:10.155843 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae43b54b-221e-4ecd-8343-0bcdc650948a None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:10.183715 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519530d8-6fe7-47b5-aedd-230bd6d9b464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:10.184594 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519530d8-6fe7-47b5-aedd-230bd6d9b464 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:10.184882 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519530d8-6fe7-47b5-aedd-230bd6d9b464 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:10.185162 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519530d8-6fe7-47b5-aedd-230bd6d9b464 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:10.198477 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519530d8-6fe7-47b5-aedd-230bd6d9b464 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:10.200403 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519530d8-6fe7-47b5-aedd-230bd6d9b464 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:10.222500 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-519530d8-6fe7-47b5-aedd-230bd6d9b464 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:10.222500 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:10.222500 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:10.222500 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:10.222500 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:10.222500 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:10.222500 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:10.222500 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:10.222500 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:10.222500 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:10.222500 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:10.222500 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:10.222500 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:05:10.222500 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:05:10.222500 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:05:10.223450 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:05:10.223450 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:10.223450 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:10.223450 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:10.223450 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:10.223450 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:10.223450 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:10.223450 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:10.223450 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:10.223450 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:10.223450 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:10.223450 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:10.223450 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:10.223450 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:10.223450 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:10.223450 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:10.223450 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:10.224371 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:05:10.224371 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:05:10.224371 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:10.224371 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:10.225221 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 274/529] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:05:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:10.226035 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519530d8-6fe7-47b5-aedd-230bd6d9b464 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:10.274153 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae43b54b-221e-4ecd-8343-0bcdc650948a None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:10.282250 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:10.310380 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:10.312521 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea22fa4-68bd-4922-824f-a89f5fb789cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:10.313376 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea22fa4-68bd-4922-824f-a89f5fb789cb None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:10.313680 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea22fa4-68bd-4922-824f-a89f5fb789cb None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:10.313958 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea22fa4-68bd-4922-824f-a89f5fb789cb None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:10.314765 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea22fa4-68bd-4922-824f-a89f5fb789cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:10.315074 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea22fa4-68bd-4922-824f-a89f5fb789cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:10.316601 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea22fa4-68bd-4922-824f-a89f5fb789cb None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:10.340323 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 256/530] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Jul 4 09:05:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:10.341357 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea22fa4-68bd-4922-824f-a89f5fb789cb None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:10.363045 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519530d8-6fe7-47b5-aedd-230bd6d9b464 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:10.406937 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be18ea3-ef6b-433c-b5ed-8ab6d7204b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:10.408358 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be18ea3-ef6b-433c-b5ed-8ab6d7204b81 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:10.408982 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be18ea3-ef6b-433c-b5ed-8ab6d7204b81 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:10.409559 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be18ea3-ef6b-433c-b5ed-8ab6d7204b81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:10.449314 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea22fa4-68bd-4922-824f-a89f5fb789cb None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:10.490069 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d32afa4-ca05-460f-a9de-f2e1caa4f97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:10.490741 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d32afa4-ca05-460f-a9de-f2e1caa4f97f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:10.491025 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d32afa4-ca05-460f-a9de-f2e1caa4f97f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:10.491537 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d32afa4-ca05-460f-a9de-f2e1caa4f97f None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:10.492053 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d32afa4-ca05-460f-a9de-f2e1caa4f97f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:10.492363 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d32afa4-ca05-460f-a9de-f2e1caa4f97f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:10.493769 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d32afa4-ca05-460f-a9de-f2e1caa4f97f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:10.504091 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be18ea3-ef6b-433c-b5ed-8ab6d7204b81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:10.506297 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be18ea3-ef6b-433c-b5ed-8ab6d7204b81 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:10.511370 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 257/531] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jul 4 09:05:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:10.512341 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d32afa4-ca05-460f-a9de-f2e1caa4f97f None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:10.540646 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:10.585955 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:10.634941 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 275/532] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jul 4 09:05:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:05:10.635986 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be18ea3-ef6b-433c-b5ed-8ab6d7204b81 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:10.636715 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d32afa4-ca05-460f-a9de-f2e1caa4f97f None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:10.688095 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec27bf9-08a9-41ca-910d-1b38a38fb547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:10.688765 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec27bf9-08a9-41ca-910d-1b38a38fb547 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:10.689048 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec27bf9-08a9-41ca-910d-1b38a38fb547 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:10.689914 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec27bf9-08a9-41ca-910d-1b38a38fb547 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:10.690906 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec27bf9-08a9-41ca-910d-1b38a38fb547 None admin] RBAC: Adding query filter params (role.id=6cc6801f39634594b9183000ff34fbf2, scope.project.id=d015d4f3d9d4464983ff561e8e08523c, user.id=92e3804048824cde829e6273ce7c19b1) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:10.691363 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec27bf9-08a9-41ca-910d-1b38a38fb547 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:10.693599 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec27bf9-08a9-41ca-910d-1b38a38fb547 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:10.702599 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 258/533] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Jul 4 09:05:10 2022] GET /identity/v3/role_assignments?user.id=92e3804048824cde829e6273ce7c19b1&scope.project.id=d015d4f3d9d4464983ff561e8e08523c&role.id=6cc6801f39634594b9183000ff34fbf2 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:10.703793 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec27bf9-08a9-41ca-910d-1b38a38fb547 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:10.799122 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be18ea3-ef6b-433c-b5ed-8ab6d7204b81 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:10.815348 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:10.827252 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec27bf9-08a9-41ca-910d-1b38a38fb547 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:10.867773 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575cae0b-7138-4c45-a7fe-d9d6496f6273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:10.868608 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575cae0b-7138-4c45-a7fe-d9d6496f6273 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:10.869432 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575cae0b-7138-4c45-a7fe-d9d6496f6273 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:10.869715 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575cae0b-7138-4c45-a7fe-d9d6496f6273 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:10.883209 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575cae0b-7138-4c45-a7fe-d9d6496f6273 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:10.884512 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575cae0b-7138-4c45-a7fe-d9d6496f6273 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:10.903229 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-575cae0b-7138-4c45-a7fe-d9d6496f6273 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:10.903229 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:10.903229 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:10.903229 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:10.903229 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:10.903229 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:10.903229 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:10.903229 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:10.903229 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:10.903229 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:10.903229 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:10.903229 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:10.903229 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:05:10.903229 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:05:10.903229 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:05:10.904901 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:05:10.904901 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:10.904901 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:10.904901 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:10.904901 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:10.904901 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:10.904901 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:10.904901 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:10.904901 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:10.904901 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:10.904901 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:10.904901 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:10.904901 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:10.904901 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:10.904901 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:10.904901 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:10.904901 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:10.906096 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:05:10.906096 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:05:10.906096 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:10.906096 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:10.906096 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 259/534] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:05:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:10.910082 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575cae0b-7138-4c45-a7fe-d9d6496f6273 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:10.911605 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6813e8d8-179e-4e79-b3bd-bcbcb1ab311c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:10.912455 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6813e8d8-179e-4e79-b3bd-bcbcb1ab311c None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:10.912740 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6813e8d8-179e-4e79-b3bd-bcbcb1ab311c None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:10.913009 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6813e8d8-179e-4e79-b3bd-bcbcb1ab311c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:10.929916 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6813e8d8-179e-4e79-b3bd-bcbcb1ab311c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:10.931388 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6813e8d8-179e-4e79-b3bd-bcbcb1ab311c None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:10.962999 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-6813e8d8-179e-4e79-b3bd-bcbcb1ab311c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:05:10.962999 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:10.962999 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:10.962999 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:10.962999 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:10.962999 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:10.962999 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:10.962999 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:10.962999 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:10.962999 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:10.962999 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:10.962999 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:10.962999 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:05:10.962999 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:05:10.962999 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:05:10.965818 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:05:10.965818 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:10.965818 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:10.965818 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:10.965818 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:10.965818 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:10.965818 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:10.965818 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:10.965818 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:10.965818 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:10.965818 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:10.965818 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:10.965818 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:10.965818 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:10.965818 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:10.965818 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:10.965818 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:10.968254 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:05:10.968254 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:05:10.968254 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:05:10.968254 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:05:10.968254 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:05:10.968254 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:05:10.968254 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:05:10.968254 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:10.968254 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 276/535] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jul 4 09:05:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:10.972765 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6813e8d8-179e-4e79-b3bd-bcbcb1ab311c None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:11.013036 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:11.057508 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575cae0b-7138-4c45-a7fe-d9d6496f6273 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:11.093850 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe63021-0e53-49e7-90cf-1f59dfa702b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:11.094518 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe63021-0e53-49e7-90cf-1f59dfa702b8 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:11.094796 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe63021-0e53-49e7-90cf-1f59dfa702b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:11.095178 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe63021-0e53-49e7-90cf-1f59dfa702b8 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:11.096306 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe63021-0e53-49e7-90cf-1f59dfa702b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:11.096523 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe63021-0e53-49e7-90cf-1f59dfa702b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:11.097953 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe63021-0e53-49e7-90cf-1f59dfa702b8 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:11.115855 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 260/536] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jul 4 09:05:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:11.121312 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe63021-0e53-49e7-90cf-1f59dfa702b8 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:11.125770 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:11.149580 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6813e8d8-179e-4e79-b3bd-bcbcb1ab311c None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:11.197779 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a07768-9181-4d1d-92cd-138ce35613d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:11.198730 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a07768-9181-4d1d-92cd-138ce35613d1 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:11.199149 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a07768-9181-4d1d-92cd-138ce35613d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:11.199560 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a07768-9181-4d1d-92cd-138ce35613d1 None admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:11.200527 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a07768-9181-4d1d-92cd-138ce35613d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:11.203647 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a07768-9181-4d1d-92cd-138ce35613d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:11.205296 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a07768-9181-4d1d-92cd-138ce35613d1 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:11.233289 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 277/537] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Jul 4 09:05:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:11.238337 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a07768-9181-4d1d-92cd-138ce35613d1 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:11.296708 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe63021-0e53-49e7-90cf-1f59dfa702b8 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:11.332945 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8cbcff-fed7-4f44-9073-1cc4f82a3d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:11.333798 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8cbcff-fed7-4f44-9073-1cc4f82a3d86 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:11.334105 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8cbcff-fed7-4f44-9073-1cc4f82a3d86 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:11.334404 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8cbcff-fed7-4f44-9073-1cc4f82a3d86 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:11.341862 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8cbcff-fed7-4f44-9073-1cc4f82a3d86 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:11.343562 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8cbcff-fed7-4f44-9073-1cc4f82a3d86 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:11.357845 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-bf8cbcff-fed7-4f44-9073-1cc4f82a3d86 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:05:11.357845 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:11.357845 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:11.357845 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:11.357845 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:11.357845 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:11.357845 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:11.357845 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:11.357845 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:11.357845 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:11.357845 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:11.357845 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:11.357845 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:05:11.357845 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:05:11.357845 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:05:11.358697 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:05:11.358697 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:11.358697 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:11.358697 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:11.358697 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:11.358697 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:11.358697 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:11.358697 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:11.358697 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:11.358697 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:11.358697 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:11.358697 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:11.358697 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:11.358697 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:11.358697 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:11.358697 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:11.358697 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:11.359619 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:05:11.359619 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:05:11.359619 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:05:11.359619 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:05:11.359619 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:05:11.359619 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:05:11.359619 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:05:11.359619 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:11.363972 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 261/538] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jul 4 09:05:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:05:11.365827 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8cbcff-fed7-4f44-9073-1cc4f82a3d86 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:11.381329 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:11.432926 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:11.474140 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8cbcff-fed7-4f44-9073-1cc4f82a3d86 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:11.481773 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a07768-9181-4d1d-92cd-138ce35613d1 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:11.510855 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a6a04-4207-465f-8b91-5b845bddf86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:11.511435 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a6a04-4207-465f-8b91-5b845bddf86e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:11.511727 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a6a04-4207-465f-8b91-5b845bddf86e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:11.512043 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a6a04-4207-465f-8b91-5b845bddf86e None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:11.512847 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9a6a04-4207-465f-8b91-5b845bddf86e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:11.513160 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9a6a04-4207-465f-8b91-5b845bddf86e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:11.514725 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9a6a04-4207-465f-8b91-5b845bddf86e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:11.532152 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 262/539] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Jul 4 09:05:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:05:11.534492 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a6a04-4207-465f-8b91-5b845bddf86e None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:11.576639 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbd80cb-c740-4b72-be49-4145f6207551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:11.577323 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd80cb-c740-4b72-be49-4145f6207551 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:11.577610 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd80cb-c740-4b72-be49-4145f6207551 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:11.577892 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd80cb-c740-4b72-be49-4145f6207551 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:11.578737 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbd80cb-c740-4b72-be49-4145f6207551 None admin] RBAC: Adding query filter params (role.id=6cc6801f39634594b9183000ff34fbf2, scope.project.id=d015d4f3d9d4464983ff561e8e08523c, user.id=08f86373d65440da97c853fff3c1d0d9) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:11.579052 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbd80cb-c740-4b72-be49-4145f6207551 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:11.580534 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbd80cb-c740-4b72-be49-4145f6207551 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:11.596337 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 278/540] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Jul 4 09:05:11 2022] GET /identity/v3/role_assignments?user.id=08f86373d65440da97c853fff3c1d0d9&scope.project.id=d015d4f3d9d4464983ff561e8e08523c&role.id=6cc6801f39634594b9183000ff34fbf2 => generated 259 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:11.681920 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a6a04-4207-465f-8b91-5b845bddf86e None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:11.744336 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:11.771220 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b9a095-8f24-4a77-b9f9-aa75d4c8b0b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:11.771813 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9a095-8f24-4a77-b9f9-aa75d4c8b0b2 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:11.772119 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9a095-8f24-4a77-b9f9-aa75d4c8b0b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:11.772396 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9a095-8f24-4a77-b9f9-aa75d4c8b0b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:11.773245 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b9a095-8f24-4a77-b9f9-aa75d4c8b0b2 None admin] RBAC: Adding query filter params (role.id=6cc6801f39634594b9183000ff34fbf2, scope.project.id=d015d4f3d9d4464983ff561e8e08523c, user.id=4db0575f076240559f64e9548b56ffeb) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:11.773560 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b9a095-8f24-4a77-b9f9-aa75d4c8b0b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:11.775219 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b9a095-8f24-4a77-b9f9-aa75d4c8b0b2 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:11.788405 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 263/541] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Jul 4 09:05:11 2022] GET /identity/v3/role_assignments?user.id=4db0575f076240559f64e9548b56ffeb&scope.project.id=d015d4f3d9d4464983ff561e8e08523c&role.id=6cc6801f39634594b9183000ff34fbf2 => generated 259 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:11.823198 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c9544-f177-4d9f-a3e1-f78a27fe6ffe None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:11.823504 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c9544-f177-4d9f-a3e1-f78a27fe6ffe None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:11.823761 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c9544-f177-4d9f-a3e1-f78a27fe6ffe None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:11.825291 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 279/542] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:05:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:05:11.831018 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c20c2a-5bf3-427b-9049-597d0b2c68d0 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:11.831599 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c20c2a-5bf3-427b-9049-597d0b2c68d0 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:11.832105 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c20c2a-5bf3-427b-9049-597d0b2c68d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:11.850432 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-13c20c2a-5bf3-427b-9049-597d0b2c68d0 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:05:11.852039 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-13c20c2a-5bf3-427b-9049-597d0b2c68d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:05:11.957592 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 264/543] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:05:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:05:11.985468 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24c9544-f177-4d9f-a3e1-f78a27fe6ffe None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:12.139780 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24c9544-f177-4d9f-a3e1-f78a27fe6ffe None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:12.176060 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6cec24-5010-42fc-a8d1-11ae9fe43656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:12.176965 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6cec24-5010-42fc-a8d1-11ae9fe43656 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:12.177277 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6cec24-5010-42fc-a8d1-11ae9fe43656 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:12.177589 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6cec24-5010-42fc-a8d1-11ae9fe43656 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:12.188439 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6cec24-5010-42fc-a8d1-11ae9fe43656 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:05:12.196718 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-4e6cec24-5010-42fc-a8d1-11ae9fe43656 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:05:12.196718 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:12.196718 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:12.196718 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:12.196718 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:12.196718 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:12.196718 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:12.196718 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:12.196718 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:12.196718 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:12.196718 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:12.196718 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:12.196718 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:05:12.196718 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:05:12.196718 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:05:12.196718 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:05:12.197587 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:05:12.197587 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:05:12.197587 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:05:12.197587 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:05:12.197587 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:12.197587 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:12.197587 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:12.197587 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:12.197587 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:12.197587 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:12.197587 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:12.197587 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:12.197587 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:12.197587 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:12.197587 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:12.197587 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:12.198385 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:12.198385 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:12.198385 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:12.198385 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:12.198385 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:05:12.198385 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:05:12.198385 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:05:12.198385 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:05:12.198385 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:05:12.198385 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:05:12.198385 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:05:12.198385 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:12.198993 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 280/544] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Jul 4 09:05:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:12.204898 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c20c2a-5bf3-427b-9049-597d0b2c68d0 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:12.321307 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c20c2a-5bf3-427b-9049-597d0b2c68d0 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:12.344148 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:12.373656 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e515929-0415-4101-80c9-538b5049a547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:12.374684 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e515929-0415-4101-80c9-538b5049a547 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:12.375156 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e515929-0415-4101-80c9-538b5049a547 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:12.375616 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e515929-0415-4101-80c9-538b5049a547 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:12.376581 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e515929-0415-4101-80c9-538b5049a547 None admin] RBAC: Adding query filter params (name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:12.377103 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e515929-0415-4101-80c9-538b5049a547 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:12.378677 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e515929-0415-4101-80c9-538b5049a547 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:12.378804 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc39d90-68c6-44dd-a083-2988e50e727f None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:12.379057 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc39d90-68c6-44dd-a083-2988e50e727f None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:12.379345 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc39d90-68c6-44dd-a083-2988e50e727f None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:12.381123 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 281/545] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:05:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:05:12.386410 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0661c69d-f7db-4e99-9ff0-150e551f3cd2 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:12.386932 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0661c69d-f7db-4e99-9ff0-150e551f3cd2 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:12.387412 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0661c69d-f7db-4e99-9ff0-150e551f3cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:12.393060 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:12.394165 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 265/546] 10.222.0.42 () {56 vars in 1103 bytes} [Mon Jul 4 09:05:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:12.399882 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e515929-0415-4101-80c9-538b5049a547 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:12.407707 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-0661c69d-f7db-4e99-9ff0-150e551f3cd2 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:05:12.409206 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-0661c69d-f7db-4e99-9ff0-150e551f3cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:05:12.506353 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 282/547] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:05:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 09:05:12.536977 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e515929-0415-4101-80c9-538b5049a547 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:12.549677 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0661c69d-f7db-4e99-9ff0-150e551f3cd2 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:12.573713 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76eb7c1-1f50-44f4-9f66-0d7bf7f4c0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:12.574564 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76eb7c1-1f50-44f4-9f66-0d7bf7f4c0ab None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:12.574896 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76eb7c1-1f50-44f4-9f66-0d7bf7f4c0ab None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:12.575175 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76eb7c1-1f50-44f4-9f66-0d7bf7f4c0ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:12.587578 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76eb7c1-1f50-44f4-9f66-0d7bf7f4c0ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:12.589644 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76eb7c1-1f50-44f4-9f66-0d7bf7f4c0ab None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:12.608596 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-e76eb7c1-1f50-44f4-9f66-0d7bf7f4c0ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:12.608596 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:12.608596 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:12.608596 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:12.608596 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:12.608596 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:12.608596 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:12.608596 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:12.608596 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:12.608596 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:12.608596 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:12.608596 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:12.608596 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:05:12.608596 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:05:12.608596 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:05:12.609506 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:05:12.609506 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:12.609506 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:12.609506 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:12.609506 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:12.609506 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:12.609506 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:12.609506 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:12.609506 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:12.609506 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:12.609506 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:12.609506 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:12.609506 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:12.609506 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:12.609506 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:12.609506 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:12.609506 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:12.610665 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:05:12.610665 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:05:12.610665 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:12.610665 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:12.610893 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 266/548] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:05:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:05:12.618780 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76eb7c1-1f50-44f4-9f66-0d7bf7f4c0ab None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:12.661427 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:12.732864 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76eb7c1-1f50-44f4-9f66-0d7bf7f4c0ab None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:12.771080 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149e3013-69e5-409f-b419-a77cde58621f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:12.771884 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e3013-69e5-409f-b419-a77cde58621f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:12.772239 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e3013-69e5-409f-b419-a77cde58621f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:12.772580 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e3013-69e5-409f-b419-a77cde58621f None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:12.773500 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149e3013-69e5-409f-b419-a77cde58621f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:12.773937 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149e3013-69e5-409f-b419-a77cde58621f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:12.775561 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149e3013-69e5-409f-b419-a77cde58621f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:12.788754 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 267/549] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jul 4 09:05:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:05:12.798332 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149e3013-69e5-409f-b419-a77cde58621f None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:12.814659 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0661c69d-f7db-4e99-9ff0-150e551f3cd2 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:12.892945 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:12.908655 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:12.913144 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b9cfaf-e558-4449-81db-b1157aac5d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:12.913905 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b9cfaf-e558-4449-81db-b1157aac5d5d None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:12.914233 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b9cfaf-e558-4449-81db-b1157aac5d5d None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:12.914451 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b9cfaf-e558-4449-81db-b1157aac5d5d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:12.920349 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149e3013-69e5-409f-b419-a77cde58621f None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:12.944480 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b9cfaf-e558-4449-81db-b1157aac5d5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:05:12.952567 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-f7b9cfaf-e558-4449-81db-b1157aac5d5d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:05:12.952567 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:12.952567 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:12.952567 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:12.952567 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:12.952567 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:12.952567 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:12.952567 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:12.952567 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:12.952567 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:12.952567 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:12.952567 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:12.952567 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:05:12.952567 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:05:12.952567 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:05:12.952567 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:05:12.954200 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:05:12.954200 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:05:12.954200 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:05:12.954200 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:05:12.954200 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:12.954200 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:12.954200 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:12.954200 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:12.954200 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:12.954200 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:12.954200 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:12.954200 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:12.954200 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:12.954200 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:12.954200 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:12.954200 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:12.955477 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:12.955477 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:12.955477 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:12.955477 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:12.955477 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:05:12.955477 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:05:12.955477 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:05:12.955477 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:05:12.955477 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:05:12.955477 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:05:12.955477 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:05:12.955477 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:12.955477 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 283/550] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Jul 4 09:05:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 405 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:05:12.963102 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b9cfaf-e558-4449-81db-b1157aac5d5d None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:12.964132 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d15af57-4c2c-43b0-8a85-36949fa346e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:12.965513 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d15af57-4c2c-43b0-8a85-36949fa346e0 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:12.966006 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d15af57-4c2c-43b0-8a85-36949fa346e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:12.966470 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d15af57-4c2c-43b0-8a85-36949fa346e0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:12.975427 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d15af57-4c2c-43b0-8a85-36949fa346e0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:12.977296 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d15af57-4c2c-43b0-8a85-36949fa346e0 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:12.992739 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-0d15af57-4c2c-43b0-8a85-36949fa346e0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 04 09:05:12.992739 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:12.992739 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:12.992739 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:12.992739 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:12.992739 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:12.992739 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:12.992739 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:12.992739 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:12.992739 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:12.992739 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:12.992739 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:12.992739 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:05:12.992739 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:05:12.992739 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:05:12.992739 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:05:12.993887 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:12.993887 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:12.993887 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:05:12.993887 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:05:12.993887 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:05:12.993887 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:05:12.993887 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:12.993887 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:12.993887 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:12.993887 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:12.993887 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:12.993887 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:12.993887 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:12.993887 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:12.993887 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:12.993887 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:12.993887 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:12.993887 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:12.995040 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:12.995040 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:12.995040 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:05:12.995040 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:05:12.995040 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:05:12.995040 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:05:12.995040 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:05:12.995040 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:05:12.995040 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 04 09:05:12.995040 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:12.997696 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 268/551] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Jul 4 09:05:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:13.004789 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d15af57-4c2c-43b0-8a85-36949fa346e0 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:13.122053 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b9cfaf-e558-4449-81db-b1157aac5d5d None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:13.177983 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d15af57-4c2c-43b0-8a85-36949fa346e0 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:13.211529 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039f8d7e-6d9f-4b08-80fe-ce88cb6ab12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:13.212380 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f8d7e-6d9f-4b08-80fe-ce88cb6ab12a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:13.212564 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0ca0be-6c33-4419-a444-5ebf4a928124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:13.212687 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f8d7e-6d9f-4b08-80fe-ce88cb6ab12a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:13.212915 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f8d7e-6d9f-4b08-80fe-ce88cb6ab12a None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:13.213664 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ca0be-6c33-4419-a444-5ebf4a928124 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:13.213778 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039f8d7e-6d9f-4b08-80fe-ce88cb6ab12a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:13.214037 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039f8d7e-6d9f-4b08-80fe-ce88cb6ab12a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:13.214340 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ca0be-6c33-4419-a444-5ebf4a928124 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:13.214773 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ca0be-6c33-4419-a444-5ebf4a928124 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:13.215481 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039f8d7e-6d9f-4b08-80fe-ce88cb6ab12a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:13.215816 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0ca0be-6c33-4419-a444-5ebf4a928124 None admin] RBAC: Adding query filter params (name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:13.216275 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0ca0be-6c33-4419-a444-5ebf4a928124 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:13.217844 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0ca0be-6c33-4419-a444-5ebf4a928124 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:13.233246 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 269/552] 10.222.0.42 () {56 vars in 1135 bytes} [Mon Jul 4 09:05:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:13.239034 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039f8d7e-6d9f-4b08-80fe-ce88cb6ab12a None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:13.245978 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 284/553] 10.222.0.42 () {56 vars in 1103 bytes} [Mon Jul 4 09:05:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:13.251671 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0ca0be-6c33-4419-a444-5ebf4a928124 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:13.252607 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:13.340071 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039f8d7e-6d9f-4b08-80fe-ce88cb6ab12a None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:13.341215 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:13.375336 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27f015d-c63a-430b-996a-290d660f6590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:13.376151 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27f015d-c63a-430b-996a-290d660f6590 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:13.376431 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27f015d-c63a-430b-996a-290d660f6590 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:13.376703 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27f015d-c63a-430b-996a-290d660f6590 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:13.395716 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0ca0be-6c33-4419-a444-5ebf4a928124 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:13.440423 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375be6a5-a4da-406c-8fd1-c7c930a0952b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:13.441524 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375be6a5-a4da-406c-8fd1-c7c930a0952b None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:13.441882 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375be6a5-a4da-406c-8fd1-c7c930a0952b None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:13.442233 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375be6a5-a4da-406c-8fd1-c7c930a0952b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:13.455354 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27f015d-c63a-430b-996a-290d660f6590 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:13.455911 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375be6a5-a4da-406c-8fd1-c7c930a0952b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:13.457277 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27f015d-c63a-430b-996a-290d660f6590 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:13.457447 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375be6a5-a4da-406c-8fd1-c7c930a0952b None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:13.470010 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:13.478772 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-375be6a5-a4da-406c-8fd1-c7c930a0952b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:13.478772 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:13.478772 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:13.478772 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:13.478772 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:13.478772 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:13.478772 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:13.478772 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:13.478772 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:13.478772 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:13.478772 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:13.478772 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:13.478772 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:05:13.478772 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:05:13.478772 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:05:13.479635 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:05:13.479635 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:13.479635 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:13.479635 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:13.479635 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:13.479635 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:13.479635 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:13.479635 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:13.479635 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:13.479635 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:13.479635 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:13.479635 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:13.479635 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:13.479635 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:13.479635 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:13.479635 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:13.479635 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:13.480534 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:05:13.480534 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:05:13.480534 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:13.480534 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:13.483937 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 285/554] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:05:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:13.485731 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d650500a-9363-45ae-9869-c94ca029548b None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:13.486017 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d650500a-9363-45ae-9869-c94ca029548b None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:13.486316 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d650500a-9363-45ae-9869-c94ca029548b None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:13.487724 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 286/555] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:05:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:05:13.488309 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d650500a-9363-45ae-9869-c94ca029548b None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:13.599797 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 270/556] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jul 4 09:05:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 04 09:05:13.601682 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46589e8-85d6-4260-80fd-d75d5ef22331 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:13.601978 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46589e8-85d6-4260-80fd-d75d5ef22331 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:13.602257 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46589e8-85d6-4260-80fd-d75d5ef22331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:13.625064 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-f46589e8-85d6-4260-80fd-d75d5ef22331 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:05:13.628030 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f46589e8-85d6-4260-80fd-d75d5ef22331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:05:13.629445 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d650500a-9363-45ae-9869-c94ca029548b None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:13.639452 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:13.676261 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d986d-509b-4a8b-a547-95a9e9c690c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:13.677065 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d986d-509b-4a8b-a547-95a9e9c690c4 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:13.677420 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d986d-509b-4a8b-a547-95a9e9c690c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:13.677764 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d986d-509b-4a8b-a547-95a9e9c690c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:13.678815 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820d986d-509b-4a8b-a547-95a9e9c690c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:13.679188 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820d986d-509b-4a8b-a547-95a9e9c690c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:13.681628 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820d986d-509b-4a8b-a547-95a9e9c690c4 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:13.704023 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 287/557] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jul 4 09:05:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:13.705226 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d986d-509b-4a8b-a547-95a9e9c690c4 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:13.722800 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 271/558] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:05:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:05:13.723847 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46589e8-85d6-4260-80fd-d75d5ef22331 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:13.780115 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:13.835670 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d986d-509b-4a8b-a547-95a9e9c690c4 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:13.842292 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46589e8-85d6-4260-80fd-d75d5ef22331 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:13.876939 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633ea0e2-b1cf-4905-b478-1e28da57db0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:13.878111 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1495b44a-53c0-445c-9d38-b1b150c04fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:13.878241 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ea0e2-b1cf-4905-b478-1e28da57db0a None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:13.878651 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ea0e2-b1cf-4905-b478-1e28da57db0a None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:13.879049 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ea0e2-b1cf-4905-b478-1e28da57db0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:13.879739 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1495b44a-53c0-445c-9d38-b1b150c04fe5 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:13.880259 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1495b44a-53c0-445c-9d38-b1b150c04fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:13.880487 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1495b44a-53c0-445c-9d38-b1b150c04fe5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:13.890823 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1495b44a-53c0-445c-9d38-b1b150c04fe5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:13.892569 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1495b44a-53c0-445c-9d38-b1b150c04fe5 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:13.893449 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633ea0e2-b1cf-4905-b478-1e28da57db0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:13.895202 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633ea0e2-b1cf-4905-b478-1e28da57db0a None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:13.908541 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-1495b44a-53c0-445c-9d38-b1b150c04fe5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 04 09:05:13.908541 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:13.908541 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:13.908541 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:13.908541 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:13.908541 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:13.908541 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:13.908541 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:13.908541 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:13.908541 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:13.908541 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:13.908541 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:13.908541 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:05:13.908541 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:05:13.908541 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:05:13.908541 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:05:13.909536 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:13.909536 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:13.909536 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:05:13.909536 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:05:13.909536 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:05:13.909536 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:05:13.909536 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:13.909536 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:13.909536 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:13.909536 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:13.909536 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:13.909536 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:13.909536 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:13.909536 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:13.909536 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:13.909536 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:13.909536 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:13.909536 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:13.910451 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:13.910451 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:13.910451 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:05:13.910451 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:05:13.910451 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:05:13.910451 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:05:13.910451 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:05:13.910451 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:05:13.910451 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 04 09:05:13.910451 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:13.914867 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 272/559] 10.222.0.42 () {56 vars in 1093 bytes} [Mon Jul 4 09:05:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:13.915776 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1495b44a-53c0-445c-9d38-b1b150c04fe5 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:13.919607 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-633ea0e2-b1cf-4905-b478-1e28da57db0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:13.919607 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:13.919607 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:13.919607 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:13.919607 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:13.919607 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:13.919607 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:13.919607 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:13.919607 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:13.919607 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:13.919607 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:13.919607 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:13.919607 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:05:13.919607 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:05:13.919607 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:05:13.920826 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:05:13.920826 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:13.920826 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:13.920826 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:13.920826 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:13.920826 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:13.920826 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:13.920826 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:13.920826 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:13.920826 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:13.920826 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:13.920826 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:13.920826 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:13.920826 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:13.920826 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:13.920826 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:13.920826 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:13.921697 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:05:13.921697 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:05:13.921697 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:13.921697 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:13.928028 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 288/560] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:05:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:13.929228 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633ea0e2-b1cf-4905-b478-1e28da57db0a None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:13.951936 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:14.017678 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:14.021686 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1495b44a-53c0-445c-9d38-b1b150c04fe5 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:14.047314 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633ea0e2-b1cf-4905-b478-1e28da57db0a None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:14.057582 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc869723-a412-486e-a9b8-2317654f10dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:14.058381 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc869723-a412-486e-a9b8-2317654f10dd None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:14.058808 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc869723-a412-486e-a9b8-2317654f10dd None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:14.058940 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc869723-a412-486e-a9b8-2317654f10dd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:14.071816 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc869723-a412-486e-a9b8-2317654f10dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:05:14.079834 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-cc869723-a412-486e-a9b8-2317654f10dd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:05:14.079834 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:14.079834 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:14.079834 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:14.079834 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:14.079834 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:14.079834 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:14.079834 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:14.079834 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:14.079834 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:14.079834 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:14.079834 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:14.079834 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:05:14.079834 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:05:14.079834 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:05:14.079834 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:05:14.080779 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:05:14.080779 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:05:14.080779 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:05:14.080779 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:05:14.080779 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:14.080779 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:14.080779 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:14.080779 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:14.080779 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:14.080779 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:14.080779 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:14.080779 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:14.080779 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:14.080779 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:14.080779 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:14.080779 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:14.081597 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:14.081597 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:14.081597 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:14.081597 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:14.081597 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:05:14.081597 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:05:14.081597 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:05:14.081597 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:05:14.081597 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:05:14.081597 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:05:14.081597 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:05:14.081597 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:14.081597 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 273/561] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Jul 4 09:05:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:14.082425 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc869723-a412-486e-a9b8-2317654f10dd None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:14.090158 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9239e4cb-8804-45ed-b77a-76df986327c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:14.090857 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9239e4cb-8804-45ed-b77a-76df986327c4 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:14.091138 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9239e4cb-8804-45ed-b77a-76df986327c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:14.091424 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9239e4cb-8804-45ed-b77a-76df986327c4 None admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:14.092367 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9239e4cb-8804-45ed-b77a-76df986327c4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:14.092699 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9239e4cb-8804-45ed-b77a-76df986327c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:14.094130 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9239e4cb-8804-45ed-b77a-76df986327c4 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:14.114497 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 289/562] 10.222.0.42 () {56 vars in 1133 bytes} [Mon Jul 4 09:05:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:14.116183 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a0b974-fb82-4003-91fb-30c9fb5e0e33 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:14.116472 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a0b974-fb82-4003-91fb-30c9fb5e0e33 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:14.116746 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a0b974-fb82-4003-91fb-30c9fb5e0e33 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:14.118198 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 290/563] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:05:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:05:14.120987 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a0b974-fb82-4003-91fb-30c9fb5e0e33 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:14.201910 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc869723-a412-486e-a9b8-2317654f10dd None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:14.209866 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:14.234845 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a0b974-fb82-4003-91fb-30c9fb5e0e33 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:14.237941 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5205ece-68fd-4274-9c4d-78b48bff9144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:14.238606 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5205ece-68fd-4274-9c4d-78b48bff9144 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:14.238889 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5205ece-68fd-4274-9c4d-78b48bff9144 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:14.239163 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5205ece-68fd-4274-9c4d-78b48bff9144 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:14.239940 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5205ece-68fd-4274-9c4d-78b48bff9144 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:14.240302 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5205ece-68fd-4274-9c4d-78b48bff9144 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:14.241762 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5205ece-68fd-4274-9c4d-78b48bff9144 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:14.255427 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 274/564] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jul 4 09:05:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:14.256274 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5205ece-68fd-4274-9c4d-78b48bff9144 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:14.272492 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73a4b1d-bed2-44c0-bd6d-176eaa3ad8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:14.273151 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a4b1d-bed2-44c0-bd6d-176eaa3ad8ea None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:14.273490 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a4b1d-bed2-44c0-bd6d-176eaa3ad8ea None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:14.273769 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a4b1d-bed2-44c0-bd6d-176eaa3ad8ea None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:14.274636 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73a4b1d-bed2-44c0-bd6d-176eaa3ad8ea None admin] RBAC: Adding query filter params (name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:14.274982 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73a4b1d-bed2-44c0-bd6d-176eaa3ad8ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:14.276349 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:14.276470 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73a4b1d-bed2-44c0-bd6d-176eaa3ad8ea None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:14.285263 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 291/565] 10.222.0.42 () {56 vars in 1103 bytes} [Mon Jul 4 09:05:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:14.286492 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506cfe15-c0fe-4a6b-9aa7-4775fa2b8e4a None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:14.286782 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506cfe15-c0fe-4a6b-9aa7-4775fa2b8e4a None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:14.287062 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506cfe15-c0fe-4a6b-9aa7-4775fa2b8e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:14.304620 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-506cfe15-c0fe-4a6b-9aa7-4775fa2b8e4a None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:05:14.305862 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-506cfe15-c0fe-4a6b-9aa7-4775fa2b8e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:05:14.365208 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5205ece-68fd-4274-9c4d-78b48bff9144 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:14.380729 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 292/566] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:05:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:05:14.382158 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4614e8f-658e-44a6-bf74-a520b339f105 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:14.382449 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4614e8f-658e-44a6-bf74-a520b339f105 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:14.382725 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4614e8f-658e-44a6-bf74-a520b339f105 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:14.387930 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 293/567] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:05:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:05:14.387930 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4614e8f-658e-44a6-bf74-a520b339f105 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:14.408468 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24daf264-d642-41f0-ae63-24c2ad86e911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:14.409266 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24daf264-d642-41f0-ae63-24c2ad86e911 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:14.409550 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24daf264-d642-41f0-ae63-24c2ad86e911 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:14.409823 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24daf264-d642-41f0-ae63-24c2ad86e911 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:14.420518 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24daf264-d642-41f0-ae63-24c2ad86e911 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:14.422092 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24daf264-d642-41f0-ae63-24c2ad86e911 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:14.441108 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-24daf264-d642-41f0-ae63-24c2ad86e911 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:14.441108 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:14.441108 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:14.441108 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:14.441108 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:14.441108 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:14.441108 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:14.441108 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:14.441108 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:14.441108 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:14.441108 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:14.441108 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:14.441108 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:05:14.441108 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:05:14.441108 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:05:14.442208 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:05:14.442208 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:14.442208 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:14.442208 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:14.442208 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:14.442208 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:14.442208 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:14.442208 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:14.442208 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:14.442208 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:14.442208 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:14.442208 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:14.442208 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:14.442208 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:14.442208 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:14.442208 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:14.442208 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:14.443412 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:05:14.443412 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:05:14.443412 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:14.443412 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:14.443412 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 275/568] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:05:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:14.443750 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24daf264-d642-41f0-ae63-24c2ad86e911 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:14.463768 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:14.498662 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4614e8f-658e-44a6-bf74-a520b339f105 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:14.517224 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:14.533270 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96322219-f12a-44e0-9bb5-f35489c591c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:14.533988 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96322219-f12a-44e0-9bb5-f35489c591c3 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:14.534271 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96322219-f12a-44e0-9bb5-f35489c591c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:14.534548 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96322219-f12a-44e0-9bb5-f35489c591c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:14.541444 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96322219-f12a-44e0-9bb5-f35489c591c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:14.542926 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96322219-f12a-44e0-9bb5-f35489c591c3 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:14.548701 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24daf264-d642-41f0-ae63-24c2ad86e911 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:14.557390 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-96322219-f12a-44e0-9bb5-f35489c591c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:05:14.557390 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:14.557390 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:14.557390 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:14.557390 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:14.557390 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:14.557390 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:14.557390 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:14.557390 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:14.557390 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:14.557390 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:14.557390 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:14.557390 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:05:14.557390 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:05:14.557390 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:05:14.558321 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:05:14.558321 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:14.558321 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:14.558321 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:14.558321 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:14.558321 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:14.558321 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:14.558321 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:14.558321 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:14.558321 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:14.558321 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:14.558321 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:14.558321 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:14.558321 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:14.558321 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:14.558321 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:14.558321 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:14.559224 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:05:14.559224 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:05:14.559224 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:05:14.559224 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:05:14.559224 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:05:14.559224 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:05:14.559224 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:05:14.559224 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:14.559224 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 294/569] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jul 4 09:05:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:14.559940 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af5c04-5bc5-41be-af67-6265ebd241b5 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:14.560191 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af5c04-5bc5-41be-af67-6265ebd241b5 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:14.560463 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af5c04-5bc5-41be-af67-6265ebd241b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:14.577559 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-f7af5c04-5bc5-41be-af67-6265ebd241b5 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:05:14.578749 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-f7af5c04-5bc5-41be-af67-6265ebd241b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:05:14.587225 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d43c24-20c8-40fa-ac49-12317d0754b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:14.588145 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d43c24-20c8-40fa-ac49-12317d0754b4 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:14.588457 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d43c24-20c8-40fa-ac49-12317d0754b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:14.588763 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d43c24-20c8-40fa-ac49-12317d0754b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:14.599782 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d43c24-20c8-40fa-ac49-12317d0754b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:14.601431 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d43c24-20c8-40fa-ac49-12317d0754b4 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:14.620274 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-b9d43c24-20c8-40fa-ac49-12317d0754b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:14.620274 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:14.620274 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:14.620274 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:14.620274 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:14.620274 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:14.620274 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:14.620274 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:14.620274 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:14.620274 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:14.620274 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:14.620274 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:14.620274 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:05:14.620274 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:05:14.620274 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:05:14.621379 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:05:14.621379 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:14.621379 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:14.621379 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:14.621379 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:14.621379 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:14.621379 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:14.621379 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:14.621379 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:14.621379 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:14.621379 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:14.621379 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:14.621379 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:14.621379 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:14.621379 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:14.621379 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:14.621379 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:14.622304 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:05:14.622304 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:05:14.622304 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:14.622304 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:14.622304 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 276/570] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:05:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:14.622589 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d43c24-20c8-40fa-ac49-12317d0754b4 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:14.653305 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 295/571] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:05:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:05:14.654181 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7af5c04-5bc5-41be-af67-6265ebd241b5 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:14.711892 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:14.730425 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d43c24-20c8-40fa-ac49-12317d0754b4 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:14.754624 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:14.756068 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7af5c04-5bc5-41be-af67-6265ebd241b5 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:14.766735 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1023a6-9ddb-47e9-ad2a-4f7b24bf1cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:14.767524 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1023a6-9ddb-47e9-ad2a-4f7b24bf1cd9 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:14.767804 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1023a6-9ddb-47e9-ad2a-4f7b24bf1cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:14.768099 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1023a6-9ddb-47e9-ad2a-4f7b24bf1cd9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:14.778069 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1023a6-9ddb-47e9-ad2a-4f7b24bf1cd9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:05:14.785753 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-cf1023a6-9ddb-47e9-ad2a-4f7b24bf1cd9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:05:14.785753 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:14.785753 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:14.785753 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:14.785753 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:14.785753 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:14.785753 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:14.785753 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:14.785753 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:14.785753 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:14.785753 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:14.785753 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:14.785753 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:05:14.785753 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:05:14.785753 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:05:14.785753 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:05:14.786699 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:05:14.786699 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:05:14.786699 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:05:14.786699 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:05:14.786699 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:14.786699 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:14.786699 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:14.786699 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:14.786699 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:14.786699 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:14.786699 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:14.786699 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:14.786699 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:14.786699 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:14.786699 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:14.786699 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:14.787626 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:14.787626 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:14.787626 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:14.787626 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:14.787626 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:05:14.787626 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:05:14.787626 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:05:14.787626 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:05:14.787626 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:05:14.787626 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:05:14.787626 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:05:14.787626 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:14.787626 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 277/572] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Jul 4 09:05:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:14.787626 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1023a6-9ddb-47e9-ad2a-4f7b24bf1cd9 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:14.794006 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f45597-6695-4c17-8c3f-b9cb70081e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:14.794673 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f45597-6695-4c17-8c3f-b9cb70081e7a None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:14.794954 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f45597-6695-4c17-8c3f-b9cb70081e7a None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:14.795283 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f45597-6695-4c17-8c3f-b9cb70081e7a None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:14.796040 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f45597-6695-4c17-8c3f-b9cb70081e7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:14.796345 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f45597-6695-4c17-8c3f-b9cb70081e7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:14.797732 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f45597-6695-4c17-8c3f-b9cb70081e7a None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:14.809211 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 296/573] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jul 4 09:05:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:14.809984 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f45597-6695-4c17-8c3f-b9cb70081e7a None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:14.894063 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1023a6-9ddb-47e9-ad2a-4f7b24bf1cd9 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:14.906492 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f45597-6695-4c17-8c3f-b9cb70081e7a None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:14.923518 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:14.928895 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a12427a-894e-4476-a40b-6236751b8b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:14.929554 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a12427a-894e-4476-a40b-6236751b8b37 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:14.929840 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a12427a-894e-4476-a40b-6236751b8b37 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:14.930112 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a12427a-894e-4476-a40b-6236751b8b37 None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:14.930905 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a12427a-894e-4476-a40b-6236751b8b37 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:14.931215 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a12427a-894e-4476-a40b-6236751b8b37 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:14.932714 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a12427a-894e-4476-a40b-6236751b8b37 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:14.941112 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7facc45f-cecf-4683-b67f-74a61feb6ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:14.941776 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7facc45f-cecf-4683-b67f-74a61feb6ed6 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:14.942067 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7facc45f-cecf-4683-b67f-74a61feb6ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:14.942341 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7facc45f-cecf-4683-b67f-74a61feb6ed6 None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:14.943061 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7facc45f-cecf-4683-b67f-74a61feb6ed6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:14.943364 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7facc45f-cecf-4683-b67f-74a61feb6ed6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:14.944712 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 278/574] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Jul 4 09:05:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:14.944811 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7facc45f-cecf-4683-b67f-74a61feb6ed6 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:14.945507 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a12427a-894e-4476-a40b-6236751b8b37 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:14.961734 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 297/575] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jul 4 09:05:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:14.962515 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7facc45f-cecf-4683-b67f-74a61feb6ed6 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:14.988437 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:15.045930 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a12427a-894e-4476-a40b-6236751b8b37 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:15.061291 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7facc45f-cecf-4683-b67f-74a61feb6ed6 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:15.080222 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8066d1d-e660-46ed-9b57-4dd0f525db9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:15.081012 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8066d1d-e660-46ed-9b57-4dd0f525db9d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:15.081296 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8066d1d-e660-46ed-9b57-4dd0f525db9d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:15.081569 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8066d1d-e660-46ed-9b57-4dd0f525db9d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:15.091786 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8066d1d-e660-46ed-9b57-4dd0f525db9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:05:15.094022 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dcb628-04b9-44dd-9348-6de862916be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:15.094703 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dcb628-04b9-44dd-9348-6de862916be8 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:15.094988 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dcb628-04b9-44dd-9348-6de862916be8 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:15.095263 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dcb628-04b9-44dd-9348-6de862916be8 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:15.096041 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dcb628-04b9-44dd-9348-6de862916be8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:15.096348 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dcb628-04b9-44dd-9348-6de862916be8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:15.097737 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dcb628-04b9-44dd-9348-6de862916be8 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:15.099503 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-f8066d1d-e660-46ed-9b57-4dd0f525db9d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:05:15.099503 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:15.099503 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:15.099503 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:15.099503 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:15.099503 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:15.099503 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:15.099503 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:15.099503 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:15.099503 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:15.099503 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:15.099503 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:15.099503 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:05:15.099503 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:05:15.099503 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:05:15.099503 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:05:15.100595 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:05:15.100595 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:05:15.100595 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:05:15.100595 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:05:15.100595 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:15.100595 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:15.100595 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:15.100595 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:15.100595 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:15.100595 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:15.100595 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:15.100595 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:15.100595 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:15.100595 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:15.100595 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:15.100595 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:15.101623 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:15.101623 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:15.101623 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:15.101623 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:15.101623 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:05:15.101623 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:05:15.101623 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:05:15.101623 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:05:15.101623 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:05:15.101623 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:05:15.101623 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:05:15.101623 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:15.101623 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 279/576] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Jul 4 09:05:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:15.101623 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8066d1d-e660-46ed-9b57-4dd0f525db9d None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:15.108885 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 298/577] 10.222.0.42 () {56 vars in 1103 bytes} [Mon Jul 4 09:05:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:15.109692 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dcb628-04b9-44dd-9348-6de862916be8 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:15.149987 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:15.204078 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8066d1d-e660-46ed-9b57-4dd0f525db9d None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:15.205592 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:15.207817 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dcb628-04b9-44dd-9348-6de862916be8 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:15.240971 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6094214e-9602-46d5-9c5b-c399e7c74f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:15.241757 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094214e-9602-46d5-9c5b-c399e7c74f16 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:15.242046 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094214e-9602-46d5-9c5b-c399e7c74f16 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:15.242326 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094214e-9602-46d5-9c5b-c399e7c74f16 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:15.244541 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa16d3b-6bbd-4505-88ee-0f7f7dd6b413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:15.245189 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa16d3b-6bbd-4505-88ee-0f7f7dd6b413 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:15.245487 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa16d3b-6bbd-4505-88ee-0f7f7dd6b413 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:15.245757 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa16d3b-6bbd-4505-88ee-0f7f7dd6b413 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:15.246568 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa16d3b-6bbd-4505-88ee-0f7f7dd6b413 None admin] RBAC: Adding query filter params (role.id=6cc6801f39634594b9183000ff34fbf2, scope.project.id=d015d4f3d9d4464983ff561e8e08523c, user.id=59d8698c45fb46259765eb3c8de2297f) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:15.246870 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa16d3b-6bbd-4505-88ee-0f7f7dd6b413 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:15.248420 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa16d3b-6bbd-4505-88ee-0f7f7dd6b413 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:15.249449 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6094214e-9602-46d5-9c5b-c399e7c74f16 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:15.250911 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6094214e-9602-46d5-9c5b-c399e7c74f16 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:15.253757 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 299/578] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Jul 4 09:05:15 2022] GET /identity/v3/role_assignments?user.id=59d8698c45fb46259765eb3c8de2297f&scope.project.id=d015d4f3d9d4464983ff561e8e08523c&role.id=6cc6801f39634594b9183000ff34fbf2 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:15.254538 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa16d3b-6bbd-4505-88ee-0f7f7dd6b413 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:15.265645 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-6094214e-9602-46d5-9c5b-c399e7c74f16 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:05:15.265645 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:15.265645 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:15.265645 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:15.265645 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:15.265645 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:15.265645 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:15.265645 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:15.265645 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:15.265645 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:15.265645 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:15.265645 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:15.265645 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:05:15.265645 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:05:15.265645 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:05:15.266619 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:05:15.266619 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:15.266619 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:15.266619 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:15.266619 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:15.266619 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:15.266619 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:15.266619 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:15.266619 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:15.266619 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:15.266619 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:15.266619 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:15.266619 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:15.266619 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:15.266619 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:15.266619 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:15.266619 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:15.267500 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:05:15.267500 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:05:15.267500 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:05:15.267500 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:05:15.267500 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:05:15.267500 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:05:15.267500 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:05:15.267500 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:15.267500 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 280/579] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jul 4 09:05:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:15.268213 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6094214e-9602-46d5-9c5b-c399e7c74f16 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:15.374051 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa16d3b-6bbd-4505-88ee-0f7f7dd6b413 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:15.377742 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:15.382272 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6094214e-9602-46d5-9c5b-c399e7c74f16 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:15.416788 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d41790-b919-414f-adb4-3a8fc80a1998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:15.417592 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d41790-b919-414f-adb4-3a8fc80a1998 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:15.417869 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d41790-b919-414f-adb4-3a8fc80a1998 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:15.418138 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d41790-b919-414f-adb4-3a8fc80a1998 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:15.425961 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d41790-b919-414f-adb4-3a8fc80a1998 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:15.427059 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f80879e-e2ab-41f5-8cd9-aafca2f93219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:15.427403 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d41790-b919-414f-adb4-3a8fc80a1998 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:15.427784 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80879e-e2ab-41f5-8cd9-aafca2f93219 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:15.428060 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80879e-e2ab-41f5-8cd9-aafca2f93219 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:15.428333 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80879e-e2ab-41f5-8cd9-aafca2f93219 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:15.429090 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f80879e-e2ab-41f5-8cd9-aafca2f93219 None admin] RBAC: Adding query filter params (name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:15.429394 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f80879e-e2ab-41f5-8cd9-aafca2f93219 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:15.430805 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f80879e-e2ab-41f5-8cd9-aafca2f93219 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:15.443965 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 281/580] 10.222.0.42 () {56 vars in 1103 bytes} [Mon Jul 4 09:05:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:15.443965 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f80879e-e2ab-41f5-8cd9-aafca2f93219 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:15.444199 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-e1d41790-b919-414f-adb4-3a8fc80a1998 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 04 09:05:15.444199 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:15.444199 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:15.444199 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:15.444199 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:15.444199 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:15.444199 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:15.444199 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:15.444199 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:15.444199 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:15.444199 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:15.444199 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:15.444199 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:05:15.444199 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:05:15.444199 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:05:15.444199 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:05:15.445076 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:15.445076 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:15.445076 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:05:15.445076 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:05:15.445076 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:05:15.445076 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:05:15.445076 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:15.445076 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:15.445076 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:15.445076 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:15.445076 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:15.445076 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:15.445076 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:15.445076 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:15.445076 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:15.445076 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:15.445076 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:15.445076 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:15.446016 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:15.446016 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:15.446016 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:05:15.446016 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:05:15.446016 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:05:15.446016 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:05:15.446016 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:05:15.446016 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:05:15.446016 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 04 09:05:15.446016 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:15.446016 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 300/581] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jul 4 09:05:15 2022] GET /identity/v3/users/glance => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:15.446016 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d41790-b919-414f-adb4-3a8fc80a1998 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:15.475262 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:15.550648 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d41790-b919-414f-adb4-3a8fc80a1998 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:15.553804 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f80879e-e2ab-41f5-8cd9-aafca2f93219 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:15.587041 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2214b957-4700-4d12-a745-5aa3be88a591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:15.587709 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2214b957-4700-4d12-a745-5aa3be88a591 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:15.588027 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2214b957-4700-4d12-a745-5aa3be88a591 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:15.588316 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2214b957-4700-4d12-a745-5aa3be88a591 None admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:15.589109 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2214b957-4700-4d12-a745-5aa3be88a591 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:15.589434 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2214b957-4700-4d12-a745-5aa3be88a591 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:15.590627 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9148cf-6347-41c7-bcf5-f103a189b919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:15.590909 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2214b957-4700-4d12-a745-5aa3be88a591 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:15.591421 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9148cf-6347-41c7-bcf5-f103a189b919 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:15.591754 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9148cf-6347-41c7-bcf5-f103a189b919 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:15.592087 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9148cf-6347-41c7-bcf5-f103a189b919 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:15.603863 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9148cf-6347-41c7-bcf5-f103a189b919 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:15.610183 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 301/582] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Jul 4 09:05:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:15.610319 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9148cf-6347-41c7-bcf5-f103a189b919 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:15.610408 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2214b957-4700-4d12-a745-5aa3be88a591 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:15.627195 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-2c9148cf-6347-41c7-bcf5-f103a189b919 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:15.627195 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:15.627195 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:15.627195 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:15.627195 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:15.627195 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:15.627195 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:15.627195 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:15.627195 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:15.627195 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:15.627195 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:15.627195 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:15.627195 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:05:15.627195 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:05:15.627195 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:05:15.628092 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:05:15.628092 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:15.628092 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:15.628092 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:15.628092 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:15.628092 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:15.628092 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:15.628092 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:15.628092 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:15.628092 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:15.628092 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:15.628092 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:15.628092 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:15.628092 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:15.628092 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:15.628092 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:15.628092 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:15.628964 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:05:15.628964 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:05:15.628964 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:15.628964 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:15.633547 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 282/583] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:05:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:15.634056 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9148cf-6347-41c7-bcf5-f103a189b919 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:15.634497 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:15.711146 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2214b957-4700-4d12-a745-5aa3be88a591 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:15.720947 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:15.746655 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd189f38-b2b1-480f-a115-cc14e81a2db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:15.747454 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd189f38-b2b1-480f-a115-cc14e81a2db7 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:15.747732 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd189f38-b2b1-480f-a115-cc14e81a2db7 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:15.748031 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd189f38-b2b1-480f-a115-cc14e81a2db7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:15.748300 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9148cf-6347-41c7-bcf5-f103a189b919 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:15.759714 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd189f38-b2b1-480f-a115-cc14e81a2db7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:15.761894 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd189f38-b2b1-480f-a115-cc14e81a2db7 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:15.784610 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-cd189f38-b2b1-480f-a115-cc14e81a2db7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:15.784610 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:15.784610 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:15.784610 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:15.784610 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:15.784610 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:15.784610 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:15.784610 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:15.784610 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:15.784610 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:15.784610 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:15.784610 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:15.784610 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:05:15.784610 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:05:15.784610 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:05:15.785529 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:05:15.785529 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:15.785529 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:15.785529 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:15.785529 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:15.785529 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:15.785529 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:15.785529 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:15.785529 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:15.785529 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:15.785529 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:15.785529 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:15.785529 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:15.785529 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:15.785529 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:15.785529 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:15.785529 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:15.786402 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:05:15.786402 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:05:15.786402 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:15.786402 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:15.786402 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 302/584] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:05:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:15.786683 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd189f38-b2b1-480f-a115-cc14e81a2db7 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:15.793431 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481037c8-0944-44e0-a1da-1e2d15d7a842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:15.794135 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481037c8-0944-44e0-a1da-1e2d15d7a842 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:15.794414 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481037c8-0944-44e0-a1da-1e2d15d7a842 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:15.794657 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481037c8-0944-44e0-a1da-1e2d15d7a842 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:15.795561 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481037c8-0944-44e0-a1da-1e2d15d7a842 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:15.795879 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481037c8-0944-44e0-a1da-1e2d15d7a842 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:15.797345 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481037c8-0944-44e0-a1da-1e2d15d7a842 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:15.818935 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 283/585] 10.222.0.42 () {56 vars in 1137 bytes} [Mon Jul 4 09:05:15 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:15.818935 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481037c8-0944-44e0-a1da-1e2d15d7a842 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:15.872977 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:15.902367 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd189f38-b2b1-480f-a115-cc14e81a2db7 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:15.927810 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481037c8-0944-44e0-a1da-1e2d15d7a842 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:15.936826 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b5f21b-b035-4bdd-a018-a1ec00760a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:15.937718 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b5f21b-b035-4bdd-a018-a1ec00760a23 None admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:15.937999 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b5f21b-b035-4bdd-a018-a1ec00760a23 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:15.938272 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b5f21b-b035-4bdd-a018-a1ec00760a23 None admin] PATH_INFO: `/v3/projects/d015d4f3d9d4464983ff561e8e08523c/users/af3b6e252a8c434a99432bcece6493b3/roles/6cc6801f39634594b9183000ff34fbf2` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:15.952858 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b5f21b-b035-4bdd-a018-a1ec00760a23 None admin] RBAC: Authorizing `identity:create_grant(project_id=d015d4f3d9d4464983ff561e8e08523c, user_id=af3b6e252a8c434a99432bcece6493b3, role_id=6cc6801f39634594b9183000ff34fbf2)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:15.954408 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b5f21b-b035-4bdd-a018-a1ec00760a23 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:15.965216 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b590ee54-b554-4847-ba88-70b761e1155c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:15.965959 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b590ee54-b554-4847-ba88-70b761e1155c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:15.966247 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b590ee54-b554-4847-ba88-70b761e1155c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:15.966521 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b590ee54-b554-4847-ba88-70b761e1155c None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:15.967295 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b590ee54-b554-4847-ba88-70b761e1155c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:15.967618 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b590ee54-b554-4847-ba88-70b761e1155c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:15.968111 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 303/586] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Jul 4 09:05:15 2022] PUT /identity/v3/projects/d015d4f3d9d4464983ff561e8e08523c/users/af3b6e252a8c434a99432bcece6493b3/roles/6cc6801f39634594b9183000ff34fbf2 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:05:15.969024 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b590ee54-b554-4847-ba88-70b761e1155c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:15.970598 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:15.972940 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b5f21b-b035-4bdd-a018-a1ec00760a23 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:15.987232 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 284/587] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jul 4 09:05:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:15.987232 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b590ee54-b554-4847-ba88-70b761e1155c None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:16.095385 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b590ee54-b554-4847-ba88-70b761e1155c None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:16.102333 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b5f21b-b035-4bdd-a018-a1ec00760a23 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:16.131799 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e49d353-f8de-4db0-8688-71f22fc6248f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:16.132616 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49d353-f8de-4db0-8688-71f22fc6248f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:16.132910 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49d353-f8de-4db0-8688-71f22fc6248f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:16.133195 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49d353-f8de-4db0-8688-71f22fc6248f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:16.134013 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:16.145071 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe895483-92a6-4040-a0db-b48a1a2e9413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:16.146091 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe895483-92a6-4040-a0db-b48a1a2e9413 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:16.146609 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe895483-92a6-4040-a0db-b48a1a2e9413 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:16.146715 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e49d353-f8de-4db0-8688-71f22fc6248f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:16.147191 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe895483-92a6-4040-a0db-b48a1a2e9413 None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:16.148134 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e49d353-f8de-4db0-8688-71f22fc6248f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:16.148481 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe895483-92a6-4040-a0db-b48a1a2e9413 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:16.148935 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe895483-92a6-4040-a0db-b48a1a2e9413 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:16.150640 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe895483-92a6-4040-a0db-b48a1a2e9413 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:16.163411 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 304/588] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jul 4 09:05:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:16.164499 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe895483-92a6-4040-a0db-b48a1a2e9413 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:16.166018 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-1e49d353-f8de-4db0-8688-71f22fc6248f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:16.166018 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:16.166018 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:16.166018 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:16.166018 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:16.166018 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:16.166018 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:16.166018 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:16.166018 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:16.166018 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:16.166018 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:16.166018 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:16.166018 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:05:16.166018 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:05:16.166018 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:05:16.167084 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:05:16.167084 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:16.167084 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:16.167084 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:16.167084 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:16.167084 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:16.167084 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:16.167084 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:16.167084 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:16.167084 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:16.167084 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:16.167084 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:16.167084 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:16.167084 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:16.167084 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:16.167084 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:16.167084 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:16.168143 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:05:16.168143 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:05:16.168143 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:16.168143 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:16.173949 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 285/589] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:05:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:16.173949 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e49d353-f8de-4db0-8688-71f22fc6248f None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:16.236517 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:16.278783 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe895483-92a6-4040-a0db-b48a1a2e9413 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:16.312788 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e49d353-f8de-4db0-8688-71f22fc6248f None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:16.319155 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b041ab52-5277-4699-90da-fa786750053c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:16.319992 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b041ab52-5277-4699-90da-fa786750053c None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:16.320279 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b041ab52-5277-4699-90da-fa786750053c None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:16.320556 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b041ab52-5277-4699-90da-fa786750053c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:16.330399 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b041ab52-5277-4699-90da-fa786750053c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:16.332240 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b041ab52-5277-4699-90da-fa786750053c None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:16.352336 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-b041ab52-5277-4699-90da-fa786750053c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 04 09:05:16.352336 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:16.352336 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:16.352336 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:16.352336 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:16.352336 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:16.352336 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:16.352336 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:16.352336 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:16.352336 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:16.352336 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:16.352336 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:16.352336 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:05:16.352336 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:05:16.352336 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:05:16.352336 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:05:16.353547 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:16.353547 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:16.353547 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:05:16.353547 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:05:16.353547 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:05:16.353547 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:05:16.353547 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:16.353547 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:16.353547 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:16.353547 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:16.353547 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:16.353547 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:16.353547 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:16.353547 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:16.353547 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:16.353547 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:16.353547 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:16.353547 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:16.354762 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:16.354762 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:16.354762 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:05:16.354762 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:05:16.354762 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:05:16.354762 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:05:16.354762 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:05:16.354762 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:05:16.354762 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 04 09:05:16.354762 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:16.354762 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 305/590] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jul 4 09:05:16 2022] GET /identity/v3/users/cinder => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:16.354762 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b041ab52-5277-4699-90da-fa786750053c None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:16.356665 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821fec03-170d-42d3-b86a-bc095279e395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:16.357761 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821fec03-170d-42d3-b86a-bc095279e395 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:16.358198 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821fec03-170d-42d3-b86a-bc095279e395 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:16.358949 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821fec03-170d-42d3-b86a-bc095279e395 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:16.369793 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821fec03-170d-42d3-b86a-bc095279e395 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:16.372228 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821fec03-170d-42d3-b86a-bc095279e395 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:16.391144 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-821fec03-170d-42d3-b86a-bc095279e395 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 04 09:05:16.391144 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:16.391144 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:16.391144 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:16.391144 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:16.391144 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:16.391144 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:16.391144 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:16.391144 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:16.391144 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:16.391144 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:16.391144 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:16.391144 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:05:16.391144 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:05:16.391144 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:05:16.391144 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:05:16.392386 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:16.392386 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:16.392386 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:05:16.392386 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:05:16.392386 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:05:16.392386 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:05:16.392386 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:16.392386 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:16.392386 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:16.392386 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:16.392386 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:16.392386 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:16.392386 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:16.392386 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:16.392386 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:16.392386 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:16.392386 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:16.392386 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:16.393404 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:16.393404 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:16.393404 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:05:16.393404 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:05:16.393404 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:05:16.393404 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:05:16.393404 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:05:16.393404 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:05:16.393404 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 04 09:05:16.393404 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:16.393404 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 286/591] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Jul 4 09:05:16 2022] GET /identity/v3/users/neutron => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:16.393986 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821fec03-170d-42d3-b86a-bc095279e395 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:16.416294 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:16.487241 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b041ab52-5277-4699-90da-fa786750053c None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:16.499771 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821fec03-170d-42d3-b86a-bc095279e395 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:16.509490 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:16.528541 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2c2ae7-daca-4a59-ba55-46abebb2a531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:16.529611 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c2ae7-daca-4a59-ba55-46abebb2a531 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:16.530039 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c2ae7-daca-4a59-ba55-46abebb2a531 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:16.530738 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c2ae7-daca-4a59-ba55-46abebb2a531 None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:16.531905 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2c2ae7-daca-4a59-ba55-46abebb2a531 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:16.532492 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2c2ae7-daca-4a59-ba55-46abebb2a531 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:16.534589 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2c2ae7-daca-4a59-ba55-46abebb2a531 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:16.541587 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209e85c3-62d0-4383-9ef8-f2362245bcef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:16.542259 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e85c3-62d0-4383-9ef8-f2362245bcef None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:16.542542 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e85c3-62d0-4383-9ef8-f2362245bcef None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:16.542817 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e85c3-62d0-4383-9ef8-f2362245bcef None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:16.544281 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209e85c3-62d0-4383-9ef8-f2362245bcef None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:16.544594 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209e85c3-62d0-4383-9ef8-f2362245bcef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:16.546173 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209e85c3-62d0-4383-9ef8-f2362245bcef None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:16.556988 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 306/592] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jul 4 09:05:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:16.557815 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2c2ae7-daca-4a59-ba55-46abebb2a531 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:16.574943 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 287/593] 10.222.0.42 () {56 vars in 1137 bytes} [Mon Jul 4 09:05:16 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:16.574943 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209e85c3-62d0-4383-9ef8-f2362245bcef None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:16.667959 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2c2ae7-daca-4a59-ba55-46abebb2a531 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:16.678832 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:16.695337 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209e85c3-62d0-4383-9ef8-f2362245bcef None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:16.714267 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052ca9a4-f395-4784-a864-d80ff9d5444d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:16.715069 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ca9a4-f395-4784-a864-d80ff9d5444d None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:16.715471 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ca9a4-f395-4784-a864-d80ff9d5444d None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:16.716013 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ca9a4-f395-4784-a864-d80ff9d5444d None admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:16.717412 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052ca9a4-f395-4784-a864-d80ff9d5444d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:16.717792 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052ca9a4-f395-4784-a864-d80ff9d5444d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:16.719322 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052ca9a4-f395-4784-a864-d80ff9d5444d None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:16.735583 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf66ff2-4c28-43b3-8eaf-41bc2e266ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:16.736692 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf66ff2-4c28-43b3-8eaf-41bc2e266ff3 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:16.737141 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf66ff2-4c28-43b3-8eaf-41bc2e266ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:16.737661 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf66ff2-4c28-43b3-8eaf-41bc2e266ff3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:16.742175 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 307/594] 10.222.0.42 () {56 vars in 1139 bytes} [Mon Jul 4 09:05:16 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:16.743135 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052ca9a4-f395-4784-a864-d80ff9d5444d None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:16.745877 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf66ff2-4c28-43b3-8eaf-41bc2e266ff3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:16.747772 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf66ff2-4c28-43b3-8eaf-41bc2e266ff3 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:16.762928 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-acf66ff2-4c28-43b3-8eaf-41bc2e266ff3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:05:16.762928 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:16.762928 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:16.762928 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:16.762928 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:16.762928 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:16.762928 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:16.762928 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:16.762928 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:16.762928 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:16.762928 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:16.762928 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:16.762928 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:05:16.762928 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:05:16.762928 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:05:16.763930 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:05:16.763930 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:16.763930 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:16.763930 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:16.763930 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:16.763930 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:16.763930 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:16.763930 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:16.763930 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:16.763930 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:16.763930 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:16.763930 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:16.763930 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:16.763930 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:16.763930 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:16.763930 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:16.763930 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:16.764821 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:05:16.764821 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:05:16.764821 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:05:16.764821 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:05:16.764821 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:05:16.764821 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:05:16.764821 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:05:16.764821 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:16.767376 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 288/595] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jul 4 09:05:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:16.769934 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf66ff2-4c28-43b3-8eaf-41bc2e266ff3 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:16.798659 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:16.872632 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052ca9a4-f395-4784-a864-d80ff9d5444d None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:16.882355 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf66ff2-4c28-43b3-8eaf-41bc2e266ff3 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:16.924553 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae1147a-52a0-45f0-b88a-684c03709095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:16.925404 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae1147a-52a0-45f0-b88a-684c03709095 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:16.925690 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae1147a-52a0-45f0-b88a-684c03709095 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:16.925980 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae1147a-52a0-45f0-b88a-684c03709095 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:16.928998 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378468c5-297c-4ac0-80a7-415b594f9ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:16.930026 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378468c5-297c-4ac0-80a7-415b594f9ad0 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:16.930498 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378468c5-297c-4ac0-80a7-415b594f9ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:16.930979 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378468c5-297c-4ac0-80a7-415b594f9ad0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:16.938487 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae1147a-52a0-45f0-b88a-684c03709095 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:16.940021 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae1147a-52a0-45f0-b88a-684c03709095 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:16.942849 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378468c5-297c-4ac0-80a7-415b594f9ad0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:16.944527 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378468c5-297c-4ac0-80a7-415b594f9ad0 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:16.960842 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-4ae1147a-52a0-45f0-b88a-684c03709095 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:16.960842 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:16.960842 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:16.960842 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:16.960842 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:16.960842 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:16.960842 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:16.960842 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:16.960842 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:16.960842 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:16.960842 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:16.960842 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:16.960842 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:05:16.960842 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:05:16.960842 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:05:16.961740 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:05:16.961740 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:16.961740 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:16.961740 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:16.961740 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:16.961740 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:16.961740 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:16.961740 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:16.961740 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:16.961740 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:16.961740 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:16.961740 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:16.961740 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:16.961740 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:16.961740 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:16.961740 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:16.961740 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:16.962641 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:05:16.962641 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:05:16.962641 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:16.962641 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:16.964484 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-378468c5-297c-4ac0-80a7-415b594f9ad0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:16.964484 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:16.964484 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:16.964484 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:16.964484 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:16.964484 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:16.964484 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:16.964484 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:16.964484 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:16.964484 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:16.964484 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:16.964484 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:16.964484 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:05:16.964484 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:05:16.964484 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:05:16.965317 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:05:16.965317 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:16.965317 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:16.965317 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:16.965317 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:16.965317 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:16.965317 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:16.965317 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:16.965317 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:16.965317 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:16.965317 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:16.965317 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:16.965317 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:16.965317 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:16.965317 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:16.965317 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:16.965317 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:16.966188 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:05:16.966188 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:05:16.966188 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:16.966188 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:16.966770 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 308/596] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:05:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:16.967497 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae1147a-52a0-45f0-b88a-684c03709095 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:16.968466 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 289/597] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:05:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:16.969771 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378468c5-297c-4ac0-80a7-415b594f9ad0 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:16.991278 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:17.052917 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:17.079799 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378468c5-297c-4ac0-80a7-415b594f9ad0 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:17.099962 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae1147a-52a0-45f0-b88a-684c03709095 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:17.115076 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38cc87f-639a-4b7c-a0be-f2f74797f4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:17.115622 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38cc87f-639a-4b7c-a0be-f2f74797f4fa None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:17.115736 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38cc87f-639a-4b7c-a0be-f2f74797f4fa None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:17.116171 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38cc87f-639a-4b7c-a0be-f2f74797f4fa None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:17.117019 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38cc87f-639a-4b7c-a0be-f2f74797f4fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:17.117304 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38cc87f-639a-4b7c-a0be-f2f74797f4fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:17.118864 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38cc87f-639a-4b7c-a0be-f2f74797f4fa None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:17.136020 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 290/598] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jul 4 09:05:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:05:17.137206 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38cc87f-639a-4b7c-a0be-f2f74797f4fa None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:17.141386 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc8b663-9a1b-4fdc-a57f-eeb187823f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:17.142256 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc8b663-9a1b-4fdc-a57f-eeb187823f6f None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:17.142735 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc8b663-9a1b-4fdc-a57f-eeb187823f6f None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:17.143227 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc8b663-9a1b-4fdc-a57f-eeb187823f6f None admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:17.144252 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc8b663-9a1b-4fdc-a57f-eeb187823f6f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:17.144765 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc8b663-9a1b-4fdc-a57f-eeb187823f6f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:17.146381 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc8b663-9a1b-4fdc-a57f-eeb187823f6f None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:17.158848 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 309/599] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Jul 4 09:05:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:17.160013 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc8b663-9a1b-4fdc-a57f-eeb187823f6f None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:17.240138 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:17.254294 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38cc87f-639a-4b7c-a0be-f2f74797f4fa None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:17.260325 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc8b663-9a1b-4fdc-a57f-eeb187823f6f None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:17.295361 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434e1be3-4b73-4066-b2de-184ff2042c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:17.296198 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a90008-f6b8-4ac7-a508-e94fee5fda98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:17.296923 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a90008-f6b8-4ac7-a508-e94fee5fda98 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:17.297208 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a90008-f6b8-4ac7-a508-e94fee5fda98 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:17.297746 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a90008-f6b8-4ac7-a508-e94fee5fda98 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:17.297876 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e1be3-4b73-4066-b2de-184ff2042c29 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:17.298120 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e1be3-4b73-4066-b2de-184ff2042c29 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:17.298399 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e1be3-4b73-4066-b2de-184ff2042c29 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:17.298968 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a90008-f6b8-4ac7-a508-e94fee5fda98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:17.299545 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a90008-f6b8-4ac7-a508-e94fee5fda98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:17.302130 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a90008-f6b8-4ac7-a508-e94fee5fda98 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:17.305854 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434e1be3-4b73-4066-b2de-184ff2042c29 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:17.306284 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:17.307639 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434e1be3-4b73-4066-b2de-184ff2042c29 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:17.320017 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 291/600] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jul 4 09:05:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:17.320017 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a90008-f6b8-4ac7-a508-e94fee5fda98 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:17.323025 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-434e1be3-4b73-4066-b2de-184ff2042c29 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:05:17.323025 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:17.323025 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:17.323025 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:17.323025 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:17.323025 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:17.323025 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:17.323025 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:17.323025 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:17.323025 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:17.323025 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:17.323025 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:17.323025 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:05:17.323025 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:05:17.323025 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:05:17.324127 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:05:17.324127 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:17.324127 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:17.324127 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:17.324127 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:17.324127 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:17.324127 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:17.324127 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:17.324127 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:17.324127 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:17.324127 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:17.324127 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:17.324127 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:17.324127 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:17.324127 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:17.324127 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:17.324127 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:17.325131 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:05:17.325131 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:05:17.325131 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:05:17.325131 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:05:17.325131 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:05:17.325131 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:05:17.325131 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:05:17.325131 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:17.325131 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 310/601] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jul 4 09:05:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:17.325746 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b22ce9-359c-4e22-91d1-e024d269d6c0 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:17.326030 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b22ce9-359c-4e22-91d1-e024d269d6c0 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:17.326359 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b22ce9-359c-4e22-91d1-e024d269d6c0 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:17.327730 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 311/602] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:05:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:05:17.328297 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b22ce9-359c-4e22-91d1-e024d269d6c0 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:17.425409 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a90008-f6b8-4ac7-a508-e94fee5fda98 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:17.435439 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b22ce9-359c-4e22-91d1-e024d269d6c0 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:17.460846 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc36ec36-3491-4aec-afa8-9eff9d362b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:17.461743 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc36ec36-3491-4aec-afa8-9eff9d362b75 None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:17.462022 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc36ec36-3491-4aec-afa8-9eff9d362b75 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:17.462292 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc36ec36-3491-4aec-afa8-9eff9d362b75 None admin] PATH_INFO: `/v3/projects/d015d4f3d9d4464983ff561e8e08523c/users/92e3804048824cde829e6273ce7c19b1/roles/6cc6801f39634594b9183000ff34fbf2` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:17.470561 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5423edc6-ad74-4970-9c0b-158e34011602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:17.471386 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5423edc6-ad74-4970-9c0b-158e34011602 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:17.471670 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5423edc6-ad74-4970-9c0b-158e34011602 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:17.471966 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5423edc6-ad74-4970-9c0b-158e34011602 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:17.474925 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:17.477867 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc36ec36-3491-4aec-afa8-9eff9d362b75 None admin] RBAC: Authorizing `identity:create_grant(project_id=d015d4f3d9d4464983ff561e8e08523c, user_id=92e3804048824cde829e6273ce7c19b1, role_id=6cc6801f39634594b9183000ff34fbf2)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:17.479479 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc36ec36-3491-4aec-afa8-9eff9d362b75 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:17.480103 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5423edc6-ad74-4970-9c0b-158e34011602 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:17.482157 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5423edc6-ad74-4970-9c0b-158e34011602 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:17.499988 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 292/603] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Jul 4 09:05:17 2022] PUT /identity/v3/projects/d015d4f3d9d4464983ff561e8e08523c/users/92e3804048824cde829e6273ce7c19b1/roles/6cc6801f39634594b9183000ff34fbf2 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:05:17.499988 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b86649-9f0c-4afe-b1db-a07b586068c9 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:17.499988 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b86649-9f0c-4afe-b1db-a07b586068c9 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:17.499988 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b86649-9f0c-4afe-b1db-a07b586068c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:17.500347 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-5423edc6-ad74-4970-9c0b-158e34011602 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:05:17.500347 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:17.500347 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:17.500347 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:17.500347 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:17.500347 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:17.500347 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:17.500347 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:17.500347 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:17.500347 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:17.500347 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:17.500347 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:17.500347 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:05:17.500347 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:05:17.500347 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:05:17.501172 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:05:17.501172 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:17.501172 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:17.501172 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:17.501172 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:17.501172 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:17.501172 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:17.501172 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:17.501172 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:17.501172 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:17.501172 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:17.501172 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:17.501172 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:17.501172 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:17.501172 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:17.501172 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:17.501172 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:17.502073 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:05:17.502073 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:05:17.502073 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:05:17.502073 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:05:17.502073 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:05:17.502073 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:05:17.502073 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:05:17.502073 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:17.502073 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 312/604] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jul 4 09:05:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:17.502073 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5423edc6-ad74-4970-9c0b-158e34011602 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:17.526287 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-90b86649-9f0c-4afe-b1db-a07b586068c9 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:05:17.527509 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-90b86649-9f0c-4afe-b1db-a07b586068c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:05:17.584921 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:17.626747 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 293/605] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:05:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:05:17.632882 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b86649-9f0c-4afe-b1db-a07b586068c9 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:17.638221 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5423edc6-ad74-4970-9c0b-158e34011602 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:17.685050 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce57b61-96fd-4466-8244-c7a229537b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:17.685890 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce57b61-96fd-4466-8244-c7a229537b00 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:17.686171 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce57b61-96fd-4466-8244-c7a229537b00 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:17.686641 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce57b61-96fd-4466-8244-c7a229537b00 None admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:17.688185 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce57b61-96fd-4466-8244-c7a229537b00 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:17.688757 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce57b61-96fd-4466-8244-c7a229537b00 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:17.690427 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce57b61-96fd-4466-8244-c7a229537b00 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:17.705003 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 313/606] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Jul 4 09:05:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:17.705872 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce57b61-96fd-4466-8244-c7a229537b00 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:17.764163 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b86649-9f0c-4afe-b1db-a07b586068c9 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:17.778709 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:17.807539 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac63e587-ff2e-46ab-9c92-42b1f5aa5b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:17.808708 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63e587-ff2e-46ab-9c92-42b1f5aa5b85 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:17.809190 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63e587-ff2e-46ab-9c92-42b1f5aa5b85 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:17.809745 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63e587-ff2e-46ab-9c92-42b1f5aa5b85 None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:17.810798 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac63e587-ff2e-46ab-9c92-42b1f5aa5b85 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:17.811301 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac63e587-ff2e-46ab-9c92-42b1f5aa5b85 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:17.813252 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac63e587-ff2e-46ab-9c92-42b1f5aa5b85 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:17.827216 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 294/607] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Jul 4 09:05:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:17.828546 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac63e587-ff2e-46ab-9c92-42b1f5aa5b85 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:17.834179 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce57b61-96fd-4466-8244-c7a229537b00 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:17.872021 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f486fa-184f-44a6-b910-a1902cc00a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:17.873028 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f486fa-184f-44a6-b910-a1902cc00a63 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:17.873278 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f486fa-184f-44a6-b910-a1902cc00a63 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:17.873509 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f486fa-184f-44a6-b910-a1902cc00a63 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:17.878158 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:17.890886 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f486fa-184f-44a6-b910-a1902cc00a63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:05:17.900470 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-c2f486fa-184f-44a6-b910-a1902cc00a63 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:05:17.900470 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:17.900470 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:17.900470 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:17.900470 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:17.900470 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:17.900470 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:17.900470 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:17.900470 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:17.900470 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:17.900470 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:17.900470 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:17.900470 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:05:17.900470 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:05:17.900470 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:05:17.900470 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:05:17.901437 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:05:17.901437 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:05:17.901437 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:05:17.901437 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:05:17.901437 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:17.901437 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:17.901437 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:17.901437 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:17.901437 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:17.901437 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:17.901437 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:17.901437 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:17.901437 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:17.901437 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:17.901437 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:17.901437 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:17.902304 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:17.902304 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:17.902304 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:17.902304 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:17.902304 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:05:17.902304 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:05:17.902304 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:05:17.902304 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:05:17.902304 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:05:17.902304 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:05:17.902304 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:05:17.902304 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:17.905440 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 314/608] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Jul 4 09:05:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:17.906412 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f486fa-184f-44a6-b910-a1902cc00a63 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:17.955916 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac63e587-ff2e-46ab-9c92-42b1f5aa5b85 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:18.000987 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7a738f-2cc5-4edd-aaf4-a611a6e5d128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:18.002481 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a738f-2cc5-4edd-aaf4-a611a6e5d128 None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:18.003006 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a738f-2cc5-4edd-aaf4-a611a6e5d128 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:18.003474 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a738f-2cc5-4edd-aaf4-a611a6e5d128 None admin] PATH_INFO: `/v3/projects/d015d4f3d9d4464983ff561e8e08523c/users/08f86373d65440da97c853fff3c1d0d9/roles/6cc6801f39634594b9183000ff34fbf2` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:18.019575 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7a738f-2cc5-4edd-aaf4-a611a6e5d128 None admin] RBAC: Authorizing `identity:create_grant(project_id=d015d4f3d9d4464983ff561e8e08523c, user_id=08f86373d65440da97c853fff3c1d0d9, role_id=6cc6801f39634594b9183000ff34fbf2)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:18.019728 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f486fa-184f-44a6-b910-a1902cc00a63 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:18.021574 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7a738f-2cc5-4edd-aaf4-a611a6e5d128 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:18.037240 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:18.044573 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 295/609] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Jul 4 09:05:17 2022] PUT /identity/v3/projects/d015d4f3d9d4464983ff561e8e08523c/users/08f86373d65440da97c853fff3c1d0d9/roles/6cc6801f39634594b9183000ff34fbf2 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:05:18.045850 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7a738f-2cc5-4edd-aaf4-a611a6e5d128 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:18.056730 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8763003-4c85-4f9c-86da-acbd4ed4caf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:18.057641 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8763003-4c85-4f9c-86da-acbd4ed4caf6 None admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:18.057924 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8763003-4c85-4f9c-86da-acbd4ed4caf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:18.058201 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8763003-4c85-4f9c-86da-acbd4ed4caf6 None admin] PATH_INFO: `/v3/projects/d015d4f3d9d4464983ff561e8e08523c/users/4db0575f076240559f64e9548b56ffeb/roles/6cc6801f39634594b9183000ff34fbf2` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:18.075372 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8763003-4c85-4f9c-86da-acbd4ed4caf6 None admin] RBAC: Authorizing `identity:create_grant(project_id=d015d4f3d9d4464983ff561e8e08523c, user_id=4db0575f076240559f64e9548b56ffeb, role_id=6cc6801f39634594b9183000ff34fbf2)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:18.077023 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8763003-4c85-4f9c-86da-acbd4ed4caf6 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:18.100074 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 315/610] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Jul 4 09:05:17 2022] PUT /identity/v3/projects/d015d4f3d9d4464983ff561e8e08523c/users/4db0575f076240559f64e9548b56ffeb/roles/6cc6801f39634594b9183000ff34fbf2 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:05:18.101767 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e1b320-b583-44b5-a5bb-3ad9c0c394f9 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:18.102100 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e1b320-b583-44b5-a5bb-3ad9c0c394f9 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:18.102381 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e1b320-b583-44b5-a5bb-3ad9c0c394f9 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:18.104240 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 316/611] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:05:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:05:18.109697 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1042c668-bd2f-4b91-911e-7e97bb9014e7 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:18.110384 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1042c668-bd2f-4b91-911e-7e97bb9014e7 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:18.110624 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1042c668-bd2f-4b91-911e-7e97bb9014e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:18.133467 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-1042c668-bd2f-4b91-911e-7e97bb9014e7 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:05:18.134711 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-1042c668-bd2f-4b91-911e-7e97bb9014e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:05:18.198685 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:18.210546 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 317/612] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:05:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 09:05:18.224889 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7a738f-2cc5-4edd-aaf4-a611a6e5d128 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:18.248930 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1042c668-bd2f-4b91-911e-7e97bb9014e7 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:18.269951 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe31259-a899-4401-8c52-7abae7add829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:18.270972 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe31259-a899-4401-8c52-7abae7add829 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:18.271574 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe31259-a899-4401-8c52-7abae7add829 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:18.272087 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe31259-a899-4401-8c52-7abae7add829 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:18.273098 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe31259-a899-4401-8c52-7abae7add829 None admin] RBAC: Adding query filter params (name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:18.273603 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe31259-a899-4401-8c52-7abae7add829 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:18.275322 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe31259-a899-4401-8c52-7abae7add829 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:18.287050 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 296/613] 10.222.0.42 () {56 vars in 1103 bytes} [Mon Jul 4 09:05:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:18.293307 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe31259-a899-4401-8c52-7abae7add829 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:18.369096 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:18.376802 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1042c668-bd2f-4b91-911e-7e97bb9014e7 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:18.430917 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5931bb1a-cd8a-4c04-9a6c-101571304497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:18.431793 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5931bb1a-cd8a-4c04-9a6c-101571304497 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:18.432167 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5931bb1a-cd8a-4c04-9a6c-101571304497 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:18.432494 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5931bb1a-cd8a-4c04-9a6c-101571304497 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:18.450037 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5931bb1a-cd8a-4c04-9a6c-101571304497 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:05:18.457802 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe31259-a899-4401-8c52-7abae7add829 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:18.467278 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-5931bb1a-cd8a-4c04-9a6c-101571304497 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:05:18.467278 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:18.467278 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:18.467278 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:18.467278 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:18.467278 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:18.467278 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:18.467278 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:18.467278 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:18.467278 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:18.467278 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:18.467278 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:18.467278 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:05:18.467278 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:05:18.467278 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:05:18.467278 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:05:18.468264 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:05:18.468264 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:05:18.468264 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:05:18.468264 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:05:18.468264 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:18.468264 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:18.468264 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:18.468264 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:18.468264 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:18.468264 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:18.468264 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:18.468264 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:18.468264 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:18.468264 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:18.468264 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:18.468264 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:18.469116 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:18.469116 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:18.469116 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:18.469116 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:18.469116 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:05:18.469116 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:05:18.469116 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:05:18.469116 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:05:18.469116 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:05:18.469116 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:05:18.469116 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:05:18.469116 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:18.470798 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 318/614] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Jul 4 09:05:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:05:18.474127 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5931bb1a-cd8a-4c04-9a6c-101571304497 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:18.526082 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab54c890-8942-4665-b3b5-156d1c689a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:18.526794 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab54c890-8942-4665-b3b5-156d1c689a1a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:18.527075 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab54c890-8942-4665-b3b5-156d1c689a1a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:18.527349 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab54c890-8942-4665-b3b5-156d1c689a1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:18.545229 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab54c890-8942-4665-b3b5-156d1c689a1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:18.546717 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab54c890-8942-4665-b3b5-156d1c689a1a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:18.555037 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:18.576327 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-ab54c890-8942-4665-b3b5-156d1c689a1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:18.576327 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:18.576327 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:18.576327 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:18.576327 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:18.576327 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:18.576327 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:18.576327 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:18.576327 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:18.576327 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:18.576327 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:18.576327 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:18.576327 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:05:18.576327 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:05:18.576327 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:05:18.577260 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:05:18.577260 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:18.577260 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:18.577260 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:18.577260 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:18.577260 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:18.577260 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:18.577260 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:18.577260 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:18.577260 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:18.577260 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:18.577260 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:18.577260 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:18.577260 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:18.577260 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:18.577260 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:18.577260 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:18.578143 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:05:18.578143 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:05:18.578143 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:18.578143 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:18.584665 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 297/615] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:05:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:05:18.589979 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab54c890-8942-4665-b3b5-156d1c689a1a None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:18.606590 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5931bb1a-cd8a-4c04-9a6c-101571304497 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:18.645559 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d66c942-5225-441a-afc1-1283631e2961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:18.646236 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66c942-5225-441a-afc1-1283631e2961 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:18.646514 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66c942-5225-441a-afc1-1283631e2961 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:18.646782 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66c942-5225-441a-afc1-1283631e2961 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:18.647534 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d66c942-5225-441a-afc1-1283631e2961 None admin] RBAC: Adding query filter params (name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:18.647837 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d66c942-5225-441a-afc1-1283631e2961 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:18.649247 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d66c942-5225-441a-afc1-1283631e2961 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:18.666728 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 319/616] 10.222.0.42 () {56 vars in 1103 bytes} [Mon Jul 4 09:05:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:18.672491 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d66c942-5225-441a-afc1-1283631e2961 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:18.696750 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:18.809692 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab54c890-8942-4665-b3b5-156d1c689a1a None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:18.845722 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d66c942-5225-441a-afc1-1283631e2961 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:18.849960 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cadd3cb-4486-41e5-bd34-6cb9d1147f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:18.850634 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cadd3cb-4486-41e5-bd34-6cb9d1147f33 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:18.850911 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cadd3cb-4486-41e5-bd34-6cb9d1147f33 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:18.851179 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cadd3cb-4486-41e5-bd34-6cb9d1147f33 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:18.851933 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cadd3cb-4486-41e5-bd34-6cb9d1147f33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:18.852242 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cadd3cb-4486-41e5-bd34-6cb9d1147f33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:18.853648 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cadd3cb-4486-41e5-bd34-6cb9d1147f33 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:18.878702 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 298/617] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jul 4 09:05:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:05:18.886457 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cadd3cb-4486-41e5-bd34-6cb9d1147f33 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:18.923567 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec0f035-d76e-4f38-ab93-6eaed9819f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:18.925776 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec0f035-d76e-4f38-ab93-6eaed9819f15 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:18.926054 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec0f035-d76e-4f38-ab93-6eaed9819f15 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:18.926326 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec0f035-d76e-4f38-ab93-6eaed9819f15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:18.945966 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec0f035-d76e-4f38-ab93-6eaed9819f15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:18.947467 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec0f035-d76e-4f38-ab93-6eaed9819f15 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:18.970982 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:18.985637 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-fec0f035-d76e-4f38-ab93-6eaed9819f15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:18.985637 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:18.985637 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:18.985637 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:18.985637 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:18.985637 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:18.985637 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:18.985637 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:18.985637 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:18.985637 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:18.985637 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:18.985637 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:18.985637 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:05:18.985637 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:05:18.985637 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:05:18.987337 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:05:18.987337 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:18.987337 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:18.987337 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:18.987337 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:18.987337 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:18.987337 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:18.987337 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:18.987337 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:18.987337 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:18.987337 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:18.987337 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:18.987337 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:18.987337 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:18.987337 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:18.987337 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:18.987337 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:18.988854 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:05:18.988854 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:05:18.988854 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:18.988854 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:18.988854 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 320/618] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:05:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:18.992608 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec0f035-d76e-4f38-ab93-6eaed9819f15 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:19.046804 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cadd3cb-4486-41e5-bd34-6cb9d1147f33 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:19.093358 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c97b8bb-4796-4b5e-8a41-0e75582ed204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:19.094389 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c97b8bb-4796-4b5e-8a41-0e75582ed204 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:19.094677 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c97b8bb-4796-4b5e-8a41-0e75582ed204 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:19.094969 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c97b8bb-4796-4b5e-8a41-0e75582ed204 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:19.103145 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c97b8bb-4796-4b5e-8a41-0e75582ed204 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:19.105050 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c97b8bb-4796-4b5e-8a41-0e75582ed204 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:19.107307 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:19.123084 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-9c97b8bb-4796-4b5e-8a41-0e75582ed204 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 04 09:05:19.123084 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:19.123084 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:19.123084 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:19.123084 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:19.123084 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:19.123084 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:19.123084 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:19.123084 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:19.123084 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:19.123084 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:19.123084 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:19.123084 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:05:19.123084 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:05:19.123084 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:05:19.123084 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:05:19.124164 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:19.124164 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:19.124164 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:05:19.124164 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:05:19.124164 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:05:19.124164 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:05:19.124164 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:19.124164 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:19.124164 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:19.124164 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:19.124164 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:19.124164 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:19.124164 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:19.124164 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:19.124164 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:19.124164 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:19.124164 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:19.124164 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:19.125079 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:19.125079 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:19.125079 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:05:19.125079 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:05:19.125079 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:05:19.125079 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:05:19.125079 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:05:19.125079 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:05:19.125079 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 04 09:05:19.125079 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:19.125079 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 299/619] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Jul 4 09:05:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:19.132795 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c97b8bb-4796-4b5e-8a41-0e75582ed204 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:19.171151 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec0f035-d76e-4f38-ab93-6eaed9819f15 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:19.208245 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d5a3c7-78fa-4720-8836-76bc151f112a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:19.208926 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5a3c7-78fa-4720-8836-76bc151f112a None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:19.209199 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5a3c7-78fa-4720-8836-76bc151f112a None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:19.209481 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5a3c7-78fa-4720-8836-76bc151f112a None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:19.210260 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d5a3c7-78fa-4720-8836-76bc151f112a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:19.210572 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d5a3c7-78fa-4720-8836-76bc151f112a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:19.212151 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d5a3c7-78fa-4720-8836-76bc151f112a None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:19.225092 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 321/620] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jul 4 09:05:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:05:19.230377 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d5a3c7-78fa-4720-8836-76bc151f112a None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:19.331929 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d5a3c7-78fa-4720-8836-76bc151f112a None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:19.357188 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c97b8bb-4796-4b5e-8a41-0e75582ed204 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:19.368173 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:19.371201 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2549e17-0225-45fd-ad12-5011ac9002ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:19.372265 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2549e17-0225-45fd-ad12-5011ac9002ce None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:19.372976 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2549e17-0225-45fd-ad12-5011ac9002ce None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:19.373431 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2549e17-0225-45fd-ad12-5011ac9002ce None admin] PATH_INFO: `/v3/users/nova` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:19.381932 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2549e17-0225-45fd-ad12-5011ac9002ce None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:19.383574 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2549e17-0225-45fd-ad12-5011ac9002ce None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:19.394126 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:19.413833 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-f2549e17-0225-45fd-ad12-5011ac9002ce None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 04 09:05:19.413833 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:19.413833 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:19.413833 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:19.413833 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:19.413833 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:19.413833 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:19.413833 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:19.413833 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:19.413833 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:19.413833 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:19.413833 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:19.413833 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:05:19.413833 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:05:19.413833 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:05:19.413833 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:05:19.415052 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:19.415052 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:19.415052 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:05:19.415052 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:05:19.415052 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:05:19.415052 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:05:19.415052 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:19.415052 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:19.415052 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:19.415052 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:19.415052 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:19.415052 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:19.415052 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:19.415052 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:19.415052 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:19.415052 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:19.415052 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:19.415052 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:19.416023 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:19.416023 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:19.416023 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:05:19.416023 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:05:19.416023 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:05:19.416023 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:05:19.416023 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:05:19.416023 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:05:19.416023 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 04 09:05:19.416023 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:19.424642 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 322/621] 10.222.0.42 () {56 vars in 1093 bytes} [Mon Jul 4 09:05:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:05:19.427408 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2549e17-0225-45fd-ad12-5011ac9002ce None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:19.432341 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129e8a55-2a3d-4161-936a-9dc4f17cdf1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:19.433036 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129e8a55-2a3d-4161-936a-9dc4f17cdf1e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:19.433320 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129e8a55-2a3d-4161-936a-9dc4f17cdf1e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:19.433602 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129e8a55-2a3d-4161-936a-9dc4f17cdf1e None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:19.434564 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129e8a55-2a3d-4161-936a-9dc4f17cdf1e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:19.434938 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129e8a55-2a3d-4161-936a-9dc4f17cdf1e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:19.438615 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129e8a55-2a3d-4161-936a-9dc4f17cdf1e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:19.459016 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 300/622] 10.222.0.42 () {56 vars in 1135 bytes} [Mon Jul 4 09:05:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:19.464310 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129e8a55-2a3d-4161-936a-9dc4f17cdf1e None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:19.546779 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2549e17-0225-45fd-ad12-5011ac9002ce None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:19.582195 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea910e6-7a9d-4b56-a45c-4fe501d76efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:19.583922 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea910e6-7a9d-4b56-a45c-4fe501d76efd None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:19.583922 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea910e6-7a9d-4b56-a45c-4fe501d76efd None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:19.583922 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea910e6-7a9d-4b56-a45c-4fe501d76efd None admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:19.584299 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea910e6-7a9d-4b56-a45c-4fe501d76efd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:19.584614 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea910e6-7a9d-4b56-a45c-4fe501d76efd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:19.586064 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea910e6-7a9d-4b56-a45c-4fe501d76efd None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:19.605228 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 323/623] 10.222.0.42 () {56 vars in 1133 bytes} [Mon Jul 4 09:05:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:19.611095 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea910e6-7a9d-4b56-a45c-4fe501d76efd None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:19.688254 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:19.693459 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129e8a55-2a3d-4161-936a-9dc4f17cdf1e None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:19.757806 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea910e6-7a9d-4b56-a45c-4fe501d76efd None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:19.764543 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a725ca3-3e05-4519-8f5c-add8b93f1395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:19.765538 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a725ca3-3e05-4519-8f5c-add8b93f1395 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:19.765961 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a725ca3-3e05-4519-8f5c-add8b93f1395 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:19.766371 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a725ca3-3e05-4519-8f5c-add8b93f1395 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:19.785743 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a725ca3-3e05-4519-8f5c-add8b93f1395 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:19.787405 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a725ca3-3e05-4519-8f5c-add8b93f1395 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:19.795380 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cd4843-8386-405a-9aa0-32ba4bbc8d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:19.796154 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd4843-8386-405a-9aa0-32ba4bbc8d72 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:19.796510 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd4843-8386-405a-9aa0-32ba4bbc8d72 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:19.796854 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd4843-8386-405a-9aa0-32ba4bbc8d72 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:19.823705 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-9a725ca3-3e05-4519-8f5c-add8b93f1395 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:19.823705 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:19.823705 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:19.823705 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:19.823705 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:19.823705 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:19.823705 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:19.823705 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:19.823705 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:19.823705 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:19.823705 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:19.823705 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:19.823705 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:05:19.823705 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:05:19.823705 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:05:19.824797 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:05:19.824797 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:19.824797 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:19.824797 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:19.824797 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:19.824797 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:19.824797 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:19.824797 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:19.824797 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:19.824797 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:19.824797 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:19.824797 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:19.824797 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:19.824797 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:19.824797 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:19.824797 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:19.824797 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:19.825689 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:05:19.825689 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:05:19.825689 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:19.825689 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:19.828078 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 301/624] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:05:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:19.833721 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a725ca3-3e05-4519-8f5c-add8b93f1395 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:19.868156 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cd4843-8386-405a-9aa0-32ba4bbc8d72 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:19.869568 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cd4843-8386-405a-9aa0-32ba4bbc8d72 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:19.906329 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:19.920877 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:19.977049 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 324/625] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jul 4 09:05:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 04 09:05:19.982569 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cd4843-8386-405a-9aa0-32ba4bbc8d72 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:20.023093 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a725ca3-3e05-4519-8f5c-add8b93f1395 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:20.058283 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f24278e-dc14-4fa1-b351-c16df5118d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:20.058944 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24278e-dc14-4fa1-b351-c16df5118d7b None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:20.059226 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24278e-dc14-4fa1-b351-c16df5118d7b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:20.059498 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24278e-dc14-4fa1-b351-c16df5118d7b None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:20.060249 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f24278e-dc14-4fa1-b351-c16df5118d7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:20.060630 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f24278e-dc14-4fa1-b351-c16df5118d7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:20.062148 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f24278e-dc14-4fa1-b351-c16df5118d7b None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:20.075531 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 302/626] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jul 4 09:05:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:20.077482 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5459d1-16a1-43ac-ae5d-2c00bb65dc9f None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:20.077776 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5459d1-16a1-43ac-ae5d-2c00bb65dc9f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:20.078461 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5459d1-16a1-43ac-ae5d-2c00bb65dc9f None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:20.084516 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 303/627] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:05:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:05:20.085333 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5459d1-16a1-43ac-ae5d-2c00bb65dc9f None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:20.090579 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cd4843-8386-405a-9aa0-32ba4bbc8d72 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:20.128216 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e52d04-0a8f-46b1-a9ec-4f8382055780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:20.128930 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e52d04-0a8f-46b1-a9ec-4f8382055780 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:20.129326 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e52d04-0a8f-46b1-a9ec-4f8382055780 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:20.129603 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e52d04-0a8f-46b1-a9ec-4f8382055780 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:20.140951 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e52d04-0a8f-46b1-a9ec-4f8382055780 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:20.142418 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e52d04-0a8f-46b1-a9ec-4f8382055780 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:20.151735 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:20.161982 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-32e52d04-0a8f-46b1-a9ec-4f8382055780 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:20.161982 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:20.161982 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:20.161982 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:20.161982 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:20.161982 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:20.161982 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:20.161982 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:20.161982 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:20.161982 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:20.161982 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:20.161982 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:20.161982 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:05:20.161982 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:05:20.161982 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:05:20.163915 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:05:20.163915 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:20.163915 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:20.163915 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:20.163915 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:20.163915 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:20.163915 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:20.163915 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:20.163915 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:20.163915 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:20.163915 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:20.163915 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:20.163915 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:20.163915 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:20.163915 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:20.163915 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:20.163915 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:20.166020 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:05:20.166020 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:05:20.166020 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:20.166020 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:20.171889 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 325/628] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:05:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:20.171889 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91786c8-f367-49b9-b80e-32e20710c69d None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:20.171889 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91786c8-f367-49b9-b80e-32e20710c69d None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:20.171889 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91786c8-f367-49b9-b80e-32e20710c69d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:20.186380 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:20.190906 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-f91786c8-f367-49b9-b80e-32e20710c69d None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:05:20.192099 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-f91786c8-f367-49b9-b80e-32e20710c69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:05:20.199967 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5459d1-16a1-43ac-ae5d-2c00bb65dc9f None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:20.237400 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b762a90-2e9f-4a2b-a8c7-69c3f3d3e121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:20.238526 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b762a90-2e9f-4a2b-a8c7-69c3f3d3e121 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:20.239115 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b762a90-2e9f-4a2b-a8c7-69c3f3d3e121 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:20.239532 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b762a90-2e9f-4a2b-a8c7-69c3f3d3e121 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:20.247431 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b762a90-2e9f-4a2b-a8c7-69c3f3d3e121 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:20.249373 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b762a90-2e9f-4a2b-a8c7-69c3f3d3e121 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:20.258642 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 326/629] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:05:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:05:20.259509 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91786c8-f367-49b9-b80e-32e20710c69d None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:20.265844 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-8b762a90-2e9f-4a2b-a8c7-69c3f3d3e121 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:05:20.265844 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:20.265844 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:20.265844 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:20.265844 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:20.265844 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:20.265844 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:20.265844 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:20.265844 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:20.265844 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:20.265844 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:20.265844 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:20.265844 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:05:20.265844 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:05:20.265844 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:05:20.266954 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:05:20.266954 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:20.266954 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:20.266954 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:20.266954 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:20.266954 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:20.266954 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:20.266954 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:20.266954 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:20.266954 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:20.266954 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:20.266954 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:20.266954 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:20.266954 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:20.266954 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:20.266954 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:20.266954 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:20.268038 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:05:20.268038 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:05:20.268038 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:05:20.268038 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:05:20.268038 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:05:20.268038 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:05:20.268038 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:05:20.268038 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:20.270173 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 304/630] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jul 4 09:05:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:20.276315 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b762a90-2e9f-4a2b-a8c7-69c3f3d3e121 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:20.361104 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91786c8-f367-49b9-b80e-32e20710c69d None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:20.386255 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b762a90-2e9f-4a2b-a8c7-69c3f3d3e121 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:20.390324 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:20.396760 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3ffd19-ff3f-4330-bea1-9e563bd30930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:20.397446 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ffd19-ff3f-4330-bea1-9e563bd30930 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:20.397962 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ffd19-ff3f-4330-bea1-9e563bd30930 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:20.397962 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ffd19-ff3f-4330-bea1-9e563bd30930 None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:20.398757 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3ffd19-ff3f-4330-bea1-9e563bd30930 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:20.399063 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3ffd19-ff3f-4330-bea1-9e563bd30930 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:20.400645 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3ffd19-ff3f-4330-bea1-9e563bd30930 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:20.419028 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 327/631] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jul 4 09:05:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:20.419028 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3ffd19-ff3f-4330-bea1-9e563bd30930 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:20.432389 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f158b-8a65-4f28-a69a-b3f04ac6fada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:20.433381 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f158b-8a65-4f28-a69a-b3f04ac6fada None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:20.433813 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f158b-8a65-4f28-a69a-b3f04ac6fada None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:20.434246 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f158b-8a65-4f28-a69a-b3f04ac6fada None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:20.435537 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6f158b-8a65-4f28-a69a-b3f04ac6fada None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:20.436148 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6f158b-8a65-4f28-a69a-b3f04ac6fada None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:20.437789 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6f158b-8a65-4f28-a69a-b3f04ac6fada None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:20.457159 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 305/632] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Jul 4 09:05:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:20.458379 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f158b-8a65-4f28-a69a-b3f04ac6fada None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:20.471721 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:20.525270 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3ffd19-ff3f-4330-bea1-9e563bd30930 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:20.558525 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c891d522-e5b2-470b-bf55-84e1feb4c31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:20.559321 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c891d522-e5b2-470b-bf55-84e1feb4c31b None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:20.559605 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c891d522-e5b2-470b-bf55-84e1feb4c31b None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:20.559904 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c891d522-e5b2-470b-bf55-84e1feb4c31b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:20.562442 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f158b-8a65-4f28-a69a-b3f04ac6fada None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:20.570491 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c891d522-e5b2-470b-bf55-84e1feb4c31b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:05:20.578315 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-c891d522-e5b2-470b-bf55-84e1feb4c31b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:05:20.578315 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:20.578315 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:20.578315 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:20.578315 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:20.578315 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:20.578315 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:20.578315 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:20.578315 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:20.578315 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:20.578315 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:20.578315 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:20.578315 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:05:20.578315 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:05:20.578315 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:05:20.578315 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:05:20.579263 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:05:20.579263 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:05:20.579263 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:05:20.579263 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:05:20.579263 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:20.579263 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:20.579263 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:20.579263 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:20.579263 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:20.579263 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:20.579263 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:20.579263 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:20.579263 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:20.579263 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:20.579263 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:20.579263 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:20.580132 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:20.580132 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:20.580132 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:20.580132 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:20.580132 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:05:20.580132 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:05:20.580132 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:05:20.580132 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:05:20.580132 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:05:20.580132 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:05:20.580132 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:05:20.580132 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:20.580132 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 328/633] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Jul 4 09:05:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:20.580866 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c891d522-e5b2-470b-bf55-84e1feb4c31b None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:20.599231 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3625cf-ccb6-4090-97d3-ecbdfb554b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:20.600089 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3625cf-ccb6-4090-97d3-ecbdfb554b45 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:20.600375 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3625cf-ccb6-4090-97d3-ecbdfb554b45 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:20.600657 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3625cf-ccb6-4090-97d3-ecbdfb554b45 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:20.607933 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3625cf-ccb6-4090-97d3-ecbdfb554b45 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:20.609411 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3625cf-ccb6-4090-97d3-ecbdfb554b45 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:20.624393 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-ef3625cf-ccb6-4090-97d3-ecbdfb554b45 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:05:20.624393 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:20.624393 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:20.624393 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:20.624393 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:20.624393 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:20.624393 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:20.624393 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:20.624393 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:20.624393 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:20.624393 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:20.624393 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:20.624393 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:05:20.624393 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:05:20.624393 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:05:20.625315 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:05:20.625315 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:20.625315 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:20.625315 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:20.625315 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:20.625315 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:20.625315 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:20.625315 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:20.625315 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:20.625315 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:20.625315 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:20.625315 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:20.625315 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:20.625315 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:20.625315 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:20.625315 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:20.625315 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:20.626186 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:05:20.626186 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:05:20.626186 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:05:20.626186 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:05:20.626186 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:05:20.626186 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:05:20.626186 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:05:20.626186 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:20.628164 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 306/634] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jul 4 09:05:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:20.629321 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb98001-a0c3-446d-a71d-b0e679c5f98a None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:20.629614 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb98001-a0c3-446d-a71d-b0e679c5f98a None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:20.629888 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb98001-a0c3-446d-a71d-b0e679c5f98a None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:20.631187 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 307/635] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:05:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:05:20.632134 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:20.632257 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee6e07-c52d-4fdd-b0bf-a39c0f696c36 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:20.632531 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee6e07-c52d-4fdd-b0bf-a39c0f696c36 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:20.632803 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee6e07-c52d-4fdd-b0bf-a39c0f696c36 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:20.634117 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 308/636] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:05:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:05:20.634679 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee6e07-c52d-4fdd-b0bf-a39c0f696c36 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:20.682666 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c891d522-e5b2-470b-bf55-84e1feb4c31b None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:20.703353 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:20.717458 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be2cb8e-82d0-4046-b4b0-a1eae5f32056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:20.718355 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be2cb8e-82d0-4046-b4b0-a1eae5f32056 None admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:20.718633 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be2cb8e-82d0-4046-b4b0-a1eae5f32056 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:20.718906 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be2cb8e-82d0-4046-b4b0-a1eae5f32056 None admin] PATH_INFO: `/v3/projects/d015d4f3d9d4464983ff561e8e08523c/users/59d8698c45fb46259765eb3c8de2297f/roles/6cc6801f39634594b9183000ff34fbf2` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:20.734020 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be2cb8e-82d0-4046-b4b0-a1eae5f32056 None admin] RBAC: Authorizing `identity:create_grant(project_id=d015d4f3d9d4464983ff561e8e08523c, user_id=59d8698c45fb46259765eb3c8de2297f, role_id=6cc6801f39634594b9183000ff34fbf2)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:20.734171 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee6e07-c52d-4fdd-b0bf-a39c0f696c36 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:20.735803 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be2cb8e-82d0-4046-b4b0-a1eae5f32056 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:20.749029 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 329/637] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Jul 4 09:05:20 2022] PUT /identity/v3/projects/d015d4f3d9d4464983ff561e8e08523c/users/59d8698c45fb46259765eb3c8de2297f/roles/6cc6801f39634594b9183000ff34fbf2 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:05:20.749842 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be2cb8e-82d0-4046-b4b0-a1eae5f32056 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:20.782761 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67120f0-e8d8-45b4-96dc-e4b53bccaa76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:20.783445 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67120f0-e8d8-45b4-96dc-e4b53bccaa76 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:20.783730 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67120f0-e8d8-45b4-96dc-e4b53bccaa76 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:20.784043 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67120f0-e8d8-45b4-96dc-e4b53bccaa76 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:20.784809 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67120f0-e8d8-45b4-96dc-e4b53bccaa76 None admin] RBAC: Adding query filter params (name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:20.785119 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67120f0-e8d8-45b4-96dc-e4b53bccaa76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:20.786553 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67120f0-e8d8-45b4-96dc-e4b53bccaa76 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:20.801436 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 309/638] 10.222.0.42 () {56 vars in 1103 bytes} [Mon Jul 4 09:05:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:20.803458 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f68ea-1e6d-4603-a73c-7fe84fe75141 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:20.803747 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f68ea-1e6d-4603-a73c-7fe84fe75141 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:20.804062 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f68ea-1e6d-4603-a73c-7fe84fe75141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:20.822067 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-7e5f68ea-1e6d-4603-a73c-7fe84fe75141 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:05:20.823310 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-7e5f68ea-1e6d-4603-a73c-7fe84fe75141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:05:20.862223 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:20.865148 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be2cb8e-82d0-4046-b4b0-a1eae5f32056 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:20.909411 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e49bb5e-6710-49b9-a345-b9697000d030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:20.910124 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49bb5e-6710-49b9-a345-b9697000d030 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:20.910426 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49bb5e-6710-49b9-a345-b9697000d030 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:20.910688 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49bb5e-6710-49b9-a345-b9697000d030 None admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:20.911486 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e49bb5e-6710-49b9-a345-b9697000d030 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:20.911665 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 310/639] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:05:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:05:20.911814 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e49bb5e-6710-49b9-a345-b9697000d030 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:20.912931 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e10f106-9cb6-45f4-9e4d-e89975835b0d None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:20.913163 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e10f106-9cb6-45f4-9e4d-e89975835b0d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:20.913258 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e49bb5e-6710-49b9-a345-b9697000d030 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:20.913437 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e10f106-9cb6-45f4-9e4d-e89975835b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:20.926154 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 330/640] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Jul 4 09:05:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:20.926973 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e49bb5e-6710-49b9-a345-b9697000d030 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:20.931858 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-3e10f106-9cb6-45f4-9e4d-e89975835b0d None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:05:20.933221 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3e10f106-9cb6-45f4-9e4d-e89975835b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:05:20.992541 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:21.011894 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 311/641] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:05:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:05:21.011894 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e10f106-9cb6-45f4-9e4d-e89975835b0d None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:21.038292 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e49bb5e-6710-49b9-a345-b9697000d030 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:21.073177 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f82085c-9a2e-45e4-af5b-f503979bf918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:21.073997 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f82085c-9a2e-45e4-af5b-f503979bf918 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:21.074281 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f82085c-9a2e-45e4-af5b-f503979bf918 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:21.074562 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f82085c-9a2e-45e4-af5b-f503979bf918 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:21.085289 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f82085c-9a2e-45e4-af5b-f503979bf918 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:21.086770 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f82085c-9a2e-45e4-af5b-f503979bf918 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:21.104667 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-5f82085c-9a2e-45e4-af5b-f503979bf918 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:21.104667 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:21.104667 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:21.104667 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:21.104667 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:21.104667 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:21.104667 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:21.104667 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:21.104667 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:21.104667 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:21.104667 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:21.104667 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:21.104667 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:05:21.104667 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:05:21.104667 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:05:21.105585 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:05:21.105585 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:21.105585 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:21.105585 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:21.105585 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:21.105585 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:21.105585 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:21.105585 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:21.105585 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:21.105585 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:21.105585 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:21.105585 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:21.105585 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:21.105585 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:21.105585 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:21.105585 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:21.105585 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:21.106508 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:05:21.106508 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:05:21.106508 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:21.106508 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:21.106508 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 331/642] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:05:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:21.106784 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f82085c-9a2e-45e4-af5b-f503979bf918 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:21.123110 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:21.127425 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e10f106-9cb6-45f4-9e4d-e89975835b0d None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:21.163204 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9b1201-5dab-4980-b89e-5edcea154867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:21.164234 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b1201-5dab-4980-b89e-5edcea154867 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:21.164618 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b1201-5dab-4980-b89e-5edcea154867 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:21.164902 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b1201-5dab-4980-b89e-5edcea154867 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:21.165852 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9b1201-5dab-4980-b89e-5edcea154867 None admin] RBAC: Adding query filter params (role.id=6cc6801f39634594b9183000ff34fbf2, scope.project.id=d015d4f3d9d4464983ff561e8e08523c, user.id=af3b6e252a8c434a99432bcece6493b3) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:21.166292 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9b1201-5dab-4980-b89e-5edcea154867 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:21.167774 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9b1201-5dab-4980-b89e-5edcea154867 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:21.180060 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 312/643] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Jul 4 09:05:21 2022] GET /identity/v3/role_assignments?user.id=af3b6e252a8c434a99432bcece6493b3&scope.project.id=d015d4f3d9d4464983ff561e8e08523c&role.id=6cc6801f39634594b9183000ff34fbf2 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:21.181085 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9b1201-5dab-4980-b89e-5edcea154867 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:21.216756 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f82085c-9a2e-45e4-af5b-f503979bf918 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:21.254734 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9648c9a9-b5c2-4871-84fa-43023c26d4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:21.255557 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648c9a9-b5c2-4871-84fa-43023c26d4b1 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:21.255840 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648c9a9-b5c2-4871-84fa-43023c26d4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:21.256169 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648c9a9-b5c2-4871-84fa-43023c26d4b1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:21.260268 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:21.269250 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9648c9a9-b5c2-4871-84fa-43023c26d4b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:05:21.277146 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-9648c9a9-b5c2-4871-84fa-43023c26d4b1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:05:21.277146 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:21.277146 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:21.277146 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:21.277146 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:21.277146 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:21.277146 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:21.277146 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:21.277146 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:21.277146 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:21.277146 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:21.277146 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:21.277146 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:05:21.277146 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:05:21.277146 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:05:21.277146 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:05:21.278229 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:05:21.278229 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:05:21.278229 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:05:21.278229 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:05:21.278229 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:21.278229 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:21.278229 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:21.278229 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:21.278229 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:21.278229 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:21.278229 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:21.278229 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:21.278229 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:21.278229 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:21.278229 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:21.278229 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:21.279082 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:21.279082 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:21.279082 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:21.279082 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:21.279082 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:05:21.279082 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:05:21.279082 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:05:21.279082 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:05:21.279082 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:05:21.279082 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:05:21.279082 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:05:21.279082 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:21.279082 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 332/644] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Jul 4 09:05:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:21.279845 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9648c9a9-b5c2-4871-84fa-43023c26d4b1 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:21.326697 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9b1201-5dab-4980-b89e-5edcea154867 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:21.361379 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:21.375808 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0e8abb-4ba4-498e-9c27-0589b852930e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:21.376795 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e8abb-4ba4-498e-9c27-0589b852930e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:21.377076 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e8abb-4ba4-498e-9c27-0589b852930e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:21.377348 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e8abb-4ba4-498e-9c27-0589b852930e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:21.394759 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0e8abb-4ba4-498e-9c27-0589b852930e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:05:21.397794 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9648c9a9-b5c2-4871-84fa-43023c26d4b1 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:21.405435 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-ba0e8abb-4ba4-498e-9c27-0589b852930e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:05:21.405435 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:21.405435 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:21.405435 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:21.405435 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:21.405435 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:21.405435 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:21.405435 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:21.405435 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:21.405435 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:21.405435 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:21.405435 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:21.405435 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:05:21.405435 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:05:21.405435 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:05:21.405435 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:05:21.406408 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:05:21.406408 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:05:21.406408 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:05:21.406408 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:05:21.406408 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:21.406408 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:21.406408 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:21.406408 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:21.406408 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:21.406408 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:21.406408 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:21.406408 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:21.406408 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:21.406408 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:21.406408 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:21.406408 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:21.407967 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:21.407967 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:21.407967 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:21.407967 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:21.407967 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:05:21.407967 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:05:21.407967 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:05:21.407967 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:05:21.407967 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:05:21.407967 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:05:21.407967 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:05:21.407967 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:21.407967 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 313/645] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Jul 4 09:05:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:21.408747 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0e8abb-4ba4-498e-9c27-0589b852930e None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:21.444569 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8bb7d4-83cb-48e3-897a-fde32fd26f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:21.446099 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8bb7d4-83cb-48e3-897a-fde32fd26f96 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:21.446565 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8bb7d4-83cb-48e3-897a-fde32fd26f96 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:21.447015 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8bb7d4-83cb-48e3-897a-fde32fd26f96 None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:21.448349 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8bb7d4-83cb-48e3-897a-fde32fd26f96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:21.449115 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8bb7d4-83cb-48e3-897a-fde32fd26f96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:21.450685 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8bb7d4-83cb-48e3-897a-fde32fd26f96 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:21.467005 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 333/646] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jul 4 09:05:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:21.468224 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8bb7d4-83cb-48e3-897a-fde32fd26f96 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:21.534788 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0e8abb-4ba4-498e-9c27-0589b852930e None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:21.556277 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:21.572185 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355287f0-2a1e-4277-9458-6c95cd4d6fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:21.573011 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355287f0-2a1e-4277-9458-6c95cd4d6fa5 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:21.573364 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355287f0-2a1e-4277-9458-6c95cd4d6fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:21.573812 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355287f0-2a1e-4277-9458-6c95cd4d6fa5 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:21.574657 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355287f0-2a1e-4277-9458-6c95cd4d6fa5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:21.575099 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355287f0-2a1e-4277-9458-6c95cd4d6fa5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:21.576668 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355287f0-2a1e-4277-9458-6c95cd4d6fa5 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:21.591543 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 314/647] 10.222.0.42 () {56 vars in 1103 bytes} [Mon Jul 4 09:05:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:21.591543 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355287f0-2a1e-4277-9458-6c95cd4d6fa5 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:21.599783 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8bb7d4-83cb-48e3-897a-fde32fd26f96 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:21.632351 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:21.637402 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8a2d88-5b9f-456a-8ccd-51753f9caa28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:21.638274 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a2d88-5b9f-456a-8ccd-51753f9caa28 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:21.638563 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a2d88-5b9f-456a-8ccd-51753f9caa28 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:21.638904 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a2d88-5b9f-456a-8ccd-51753f9caa28 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:21.640314 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8a2d88-5b9f-456a-8ccd-51753f9caa28 None admin] RBAC: Adding query filter params (name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:21.640314 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8a2d88-5b9f-456a-8ccd-51753f9caa28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:21.641707 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8a2d88-5b9f-456a-8ccd-51753f9caa28 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:21.651025 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 334/648] 10.222.0.42 () {56 vars in 1103 bytes} [Mon Jul 4 09:05:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:21.651969 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8a2d88-5b9f-456a-8ccd-51753f9caa28 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:21.728530 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355287f0-2a1e-4277-9458-6c95cd4d6fa5 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:21.762203 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8a2d88-5b9f-456a-8ccd-51753f9caa28 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:21.776432 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7b43e3-615d-40b0-9141-4ad2ab1650e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:21.777687 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b43e3-615d-40b0-9141-4ad2ab1650e1 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:21.778162 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b43e3-615d-40b0-9141-4ad2ab1650e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:21.778995 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b43e3-615d-40b0-9141-4ad2ab1650e1 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:21.790811 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7b43e3-615d-40b0-9141-4ad2ab1650e1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:21.793176 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7b43e3-615d-40b0-9141-4ad2ab1650e1 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:21.799144 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd6d3f5-1624-4174-ab0a-7f863e4c5ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:21.800075 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd6d3f5-1624-4174-ab0a-7f863e4c5ad9 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:21.800447 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd6d3f5-1624-4174-ab0a-7f863e4c5ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:21.800811 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd6d3f5-1624-4174-ab0a-7f863e4c5ad9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:21.811827 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd6d3f5-1624-4174-ab0a-7f863e4c5ad9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:21.812210 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-7c7b43e3-615d-40b0-9141-4ad2ab1650e1 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 04 09:05:21.812210 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:21.812210 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:21.812210 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:21.812210 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:21.812210 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:21.812210 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:21.812210 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:21.812210 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:21.812210 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:21.812210 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:21.812210 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:21.812210 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:05:21.812210 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:05:21.812210 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:05:21.812210 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:05:21.813303 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:21.813303 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:21.813303 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:05:21.813303 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:05:21.813303 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:05:21.813303 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:05:21.813303 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:21.813303 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:21.813303 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:21.813303 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:21.813303 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:21.813303 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:21.813303 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:21.813303 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:21.813303 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:21.813303 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:21.813303 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:21.813303 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:21.814482 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:21.814482 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:21.814482 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:05:21.814482 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:05:21.814482 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:05:21.814482 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:05:21.814482 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:05:21.814482 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:05:21.814482 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 04 09:05:21.814482 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:21.816052 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd6d3f5-1624-4174-ab0a-7f863e4c5ad9 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:21.817168 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 315/649] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jul 4 09:05:21 2022] GET /identity/v3/users/glance => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:21.818698 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7b43e3-615d-40b0-9141-4ad2ab1650e1 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:21.839410 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-2cd6d3f5-1624-4174-ab0a-7f863e4c5ad9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:21.839410 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:21.839410 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:21.839410 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:21.839410 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:21.839410 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:21.839410 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:21.839410 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:21.839410 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:21.839410 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:21.839410 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:21.839410 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:21.839410 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:05:21.839410 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:05:21.839410 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:05:21.840641 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:05:21.840641 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:21.840641 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:21.840641 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:21.840641 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:21.840641 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:21.840641 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:21.840641 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:21.840641 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:21.840641 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:21.840641 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:21.840641 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:21.840641 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:21.840641 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:21.840641 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:21.840641 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:21.840641 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:21.841842 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:05:21.841842 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:05:21.841842 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:21.841842 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:21.847742 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 335/650] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:05:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:21.847742 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd6d3f5-1624-4174-ab0a-7f863e4c5ad9 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:21.900681 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:21.905898 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:21.985214 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd6d3f5-1624-4174-ab0a-7f863e4c5ad9 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:22.007467 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7b43e3-615d-40b0-9141-4ad2ab1650e1 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:22.029173 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4e7ebb-d897-4cc9-9da8-61d6f3f55fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:22.030230 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e7ebb-d897-4cc9-9da8-61d6f3f55fad None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:22.030512 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e7ebb-d897-4cc9-9da8-61d6f3f55fad None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:22.030787 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e7ebb-d897-4cc9-9da8-61d6f3f55fad None admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:22.031702 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4e7ebb-d897-4cc9-9da8-61d6f3f55fad None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:22.032325 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4e7ebb-d897-4cc9-9da8-61d6f3f55fad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:22.033590 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4e7ebb-d897-4cc9-9da8-61d6f3f55fad None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:22.072485 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 336/651] 10.222.0.42 () {56 vars in 1137 bytes} [Mon Jul 4 09:05:21 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:22.073412 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4e7ebb-d897-4cc9-9da8-61d6f3f55fad None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:22.077366 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3408e4b-fcae-4b51-988e-a5e3b9ab85c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:22.078391 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3408e4b-fcae-4b51-988e-a5e3b9ab85c7 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:22.080207 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3408e4b-fcae-4b51-988e-a5e3b9ab85c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:22.080699 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3408e4b-fcae-4b51-988e-a5e3b9ab85c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:22.097836 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3408e4b-fcae-4b51-988e-a5e3b9ab85c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:22.099718 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3408e4b-fcae-4b51-988e-a5e3b9ab85c7 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:22.131214 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-e3408e4b-fcae-4b51-988e-a5e3b9ab85c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:22.131214 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:22.131214 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:22.131214 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:22.131214 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:22.131214 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:22.131214 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:22.131214 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:22.131214 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:22.131214 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:22.131214 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:22.131214 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:22.131214 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:05:22.131214 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:05:22.131214 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:05:22.132210 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:05:22.132210 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:22.132210 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:22.132210 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:22.132210 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:22.132210 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:22.132210 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:22.132210 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:22.132210 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:22.132210 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:22.132210 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:22.132210 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:22.132210 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:22.132210 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:22.132210 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:22.132210 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:22.132210 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:22.133084 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:05:22.133084 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:05:22.133084 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:22.133084 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:22.137028 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 316/652] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:05:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:22.142236 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3408e4b-fcae-4b51-988e-a5e3b9ab85c7 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:22.194058 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4e7ebb-d897-4cc9-9da8-61d6f3f55fad None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:22.197032 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:22.235130 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b054533-c1cf-4773-a43c-bff71e4039ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:22.235958 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b054533-c1cf-4773-a43c-bff71e4039ad None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:22.236200 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b054533-c1cf-4773-a43c-bff71e4039ad None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:22.236472 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b054533-c1cf-4773-a43c-bff71e4039ad None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:22.237346 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b054533-c1cf-4773-a43c-bff71e4039ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:22.237650 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b054533-c1cf-4773-a43c-bff71e4039ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:22.239209 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b054533-c1cf-4773-a43c-bff71e4039ad None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:22.252146 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 337/653] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jul 4 09:05:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:22.257429 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b054533-c1cf-4773-a43c-bff71e4039ad None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:22.356321 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:22.375099 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b054533-c1cf-4773-a43c-bff71e4039ad None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:22.378653 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3408e4b-fcae-4b51-988e-a5e3b9ab85c7 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:22.414049 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b4914-df4e-4eab-9190-5aa5c6c7ad86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:22.414732 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b4914-df4e-4eab-9190-5aa5c6c7ad86 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:22.415053 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b4914-df4e-4eab-9190-5aa5c6c7ad86 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:22.415330 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b4914-df4e-4eab-9190-5aa5c6c7ad86 None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:22.416139 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78b4914-df4e-4eab-9190-5aa5c6c7ad86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:22.416449 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78b4914-df4e-4eab-9190-5aa5c6c7ad86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:22.418060 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78b4914-df4e-4eab-9190-5aa5c6c7ad86 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:22.434739 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 338/654] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jul 4 09:05:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:22.436558 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b4914-df4e-4eab-9190-5aa5c6c7ad86 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:22.467623 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:22.474320 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36a082c-cb5e-497f-807c-67c96d1d527a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:22.475598 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a082c-cb5e-497f-807c-67c96d1d527a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:22.476103 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a082c-cb5e-497f-807c-67c96d1d527a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:22.476911 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a082c-cb5e-497f-807c-67c96d1d527a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:22.555397 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b4914-df4e-4eab-9190-5aa5c6c7ad86 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:22.556681 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36a082c-cb5e-497f-807c-67c96d1d527a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:22.558529 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36a082c-cb5e-497f-807c-67c96d1d527a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:22.592684 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ea6d1a-9bd8-41a8-9287-23661f1da655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:22.593528 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea6d1a-9bd8-41a8-9287-23661f1da655 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:22.593815 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea6d1a-9bd8-41a8-9287-23661f1da655 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:22.594101 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea6d1a-9bd8-41a8-9287-23661f1da655 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:22.601848 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ea6d1a-9bd8-41a8-9287-23661f1da655 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:22.603406 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ea6d1a-9bd8-41a8-9287-23661f1da655 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:22.619530 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-f5ea6d1a-9bd8-41a8-9287-23661f1da655 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 04 09:05:22.619530 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:22.619530 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:22.619530 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:22.619530 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:22.619530 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:22.619530 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:22.619530 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:22.619530 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:22.619530 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:22.619530 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:22.619530 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:22.619530 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:05:22.619530 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:05:22.619530 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:05:22.619530 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:05:22.620562 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:22.620562 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:22.620562 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:05:22.620562 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:05:22.620562 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:05:22.620562 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:05:22.620562 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:22.620562 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:22.620562 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:22.620562 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:22.620562 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:22.620562 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:22.620562 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:22.620562 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:22.620562 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:22.620562 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:22.620562 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:22.620562 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:22.621511 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:22.621511 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:22.621511 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:05:22.621511 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:05:22.621511 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:05:22.621511 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:05:22.621511 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:05:22.621511 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:05:22.621511 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 04 09:05:22.621511 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:22.625753 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 339/655] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Jul 4 09:05:22 2022] GET /identity/v3/users/neutron => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:22.626746 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ea6d1a-9bd8-41a8-9287-23661f1da655 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:22.656956 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:22.671087 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 317/656] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jul 4 09:05:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:05:22.672684 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36a082c-cb5e-497f-807c-67c96d1d527a None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:22.723037 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:22.741312 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ea6d1a-9bd8-41a8-9287-23661f1da655 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:22.777961 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1021249-d7bb-4ebe-9786-f5ba2c9ee272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:22.779113 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1021249-d7bb-4ebe-9786-f5ba2c9ee272 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:22.779646 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1021249-d7bb-4ebe-9786-f5ba2c9ee272 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:22.780190 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1021249-d7bb-4ebe-9786-f5ba2c9ee272 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:22.783744 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36a082c-cb5e-497f-807c-67c96d1d527a None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:22.788573 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1021249-d7bb-4ebe-9786-f5ba2c9ee272 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:22.790247 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1021249-d7bb-4ebe-9786-f5ba2c9ee272 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:22.806780 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-a1021249-d7bb-4ebe-9786-f5ba2c9ee272 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 04 09:05:22.806780 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:22.806780 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:22.806780 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:22.806780 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:22.806780 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:22.806780 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:22.806780 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:22.806780 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:22.806780 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:22.806780 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:22.806780 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:22.806780 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:05:22.806780 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:05:22.806780 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:05:22.806780 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:05:22.807759 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:22.807759 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:22.807759 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:05:22.807759 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:05:22.807759 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:05:22.807759 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:05:22.807759 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:22.807759 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:22.807759 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:22.807759 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:22.807759 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:22.807759 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:22.807759 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:22.807759 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:22.807759 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:22.807759 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:22.807759 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:22.807759 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:22.808725 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:22.808725 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:22.808725 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:05:22.808725 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:05:22.808725 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:05:22.808725 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:05:22.808725 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:05:22.808725 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:05:22.808725 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 04 09:05:22.808725 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:22.811741 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 340/657] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jul 4 09:05:22 2022] GET /identity/v3/users/cinder => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:22.812898 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1021249-d7bb-4ebe-9786-f5ba2c9ee272 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:22.819810 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382f00d4-e528-46ed-8640-75d6490e7522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:22.820019 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f00d4-e528-46ed-8640-75d6490e7522 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:22.820239 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f00d4-e528-46ed-8640-75d6490e7522 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:22.820465 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f00d4-e528-46ed-8640-75d6490e7522 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:22.821311 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382f00d4-e528-46ed-8640-75d6490e7522 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:22.821620 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382f00d4-e528-46ed-8640-75d6490e7522 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:22.823160 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382f00d4-e528-46ed-8640-75d6490e7522 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:22.845410 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 318/658] 10.222.0.42 () {56 vars in 1139 bytes} [Mon Jul 4 09:05:22 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:22.845410 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382f00d4-e528-46ed-8640-75d6490e7522 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:22.906469 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:22.939127 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1021249-d7bb-4ebe-9786-f5ba2c9ee272 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:22.958220 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382f00d4-e528-46ed-8640-75d6490e7522 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:22.974112 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a98616-e0af-414b-9c1a-0e0d8cb7803b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:22.974908 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a98616-e0af-414b-9c1a-0e0d8cb7803b None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:22.975189 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a98616-e0af-414b-9c1a-0e0d8cb7803b None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:22.975464 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a98616-e0af-414b-9c1a-0e0d8cb7803b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:22.986086 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a98616-e0af-414b-9c1a-0e0d8cb7803b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:22.987524 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a98616-e0af-414b-9c1a-0e0d8cb7803b None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:22.990300 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:22.994513 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9520842-501a-42b9-9fa4-d40aa82c2238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:22.995264 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9520842-501a-42b9-9fa4-d40aa82c2238 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:22.995636 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9520842-501a-42b9-9fa4-d40aa82c2238 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:22.996039 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9520842-501a-42b9-9fa4-d40aa82c2238 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:22.996882 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9520842-501a-42b9-9fa4-d40aa82c2238 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:22.997194 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9520842-501a-42b9-9fa4-d40aa82c2238 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:22.998700 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9520842-501a-42b9-9fa4-d40aa82c2238 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:23.007852 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-23a98616-e0af-414b-9c1a-0e0d8cb7803b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:23.007852 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:23.007852 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:23.007852 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:23.007852 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:23.007852 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:23.007852 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:23.007852 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:23.007852 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:23.007852 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:23.007852 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:23.007852 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:23.007852 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:05:23.007852 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:05:23.007852 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:05:23.008762 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:05:23.008762 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:23.008762 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:23.008762 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:23.008762 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:23.008762 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:23.008762 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:23.008762 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:23.008762 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:23.008762 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:23.008762 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:23.008762 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:23.008762 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:23.008762 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:23.008762 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:23.008762 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:23.008762 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:23.009656 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:05:23.009656 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:05:23.009656 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:23.009656 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:23.009656 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 341/659] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:05:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:23.009939 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a98616-e0af-414b-9c1a-0e0d8cb7803b None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:23.019152 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 319/660] 10.222.0.42 () {56 vars in 1137 bytes} [Mon Jul 4 09:05:22 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:23.020850 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f255f-e632-4108-b8d8-134ee1b82794 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:23.021312 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f255f-e632-4108-b8d8-134ee1b82794 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:23.021755 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f255f-e632-4108-b8d8-134ee1b82794 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:23.023183 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 320/661] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:05:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:05:23.024143 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5f255f-e632-4108-b8d8-134ee1b82794 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:23.118802 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a98616-e0af-414b-9c1a-0e0d8cb7803b None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:23.133942 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5f255f-e632-4108-b8d8-134ee1b82794 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:23.141987 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:23.151759 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ec1703-6572-4dcc-9bee-c577c3cd3e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:23.152439 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec1703-6572-4dcc-9bee-c577c3cd3e0e None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:23.152718 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec1703-6572-4dcc-9bee-c577c3cd3e0e None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:23.152987 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec1703-6572-4dcc-9bee-c577c3cd3e0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:23.171804 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9ea45e-9256-44f6-87df-75ac18eddaf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:23.172512 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9ea45e-9256-44f6-87df-75ac18eddaf4 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:23.172793 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9ea45e-9256-44f6-87df-75ac18eddaf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:23.173073 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9ea45e-9256-44f6-87df-75ac18eddaf4 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:23.173803 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9ea45e-9256-44f6-87df-75ac18eddaf4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:23.174223 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9ea45e-9256-44f6-87df-75ac18eddaf4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:23.175711 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9ea45e-9256-44f6-87df-75ac18eddaf4 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:23.192027 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 321/662] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jul 4 09:05:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:23.194180 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9ea45e-9256-44f6-87df-75ac18eddaf4 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:23.216335 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:23.224958 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ec1703-6572-4dcc-9bee-c577c3cd3e0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:23.226508 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ec1703-6572-4dcc-9bee-c577c3cd3e0e None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:23.290592 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9ea45e-9256-44f6-87df-75ac18eddaf4 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:23.323814 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeb48e9-c476-4a04-ac63-f0e6b7f317f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:23.324497 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb48e9-c476-4a04-ac63-f0e6b7f317f9 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:23.324775 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb48e9-c476-4a04-ac63-f0e6b7f317f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:23.325043 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb48e9-c476-4a04-ac63-f0e6b7f317f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:23.327602 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 342/663] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jul 4 09:05:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:05:23.328769 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e10c8a-a911-4e9c-a3d1-2da0f3df2702 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:23.329054 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e10c8a-a911-4e9c-a3d1-2da0f3df2702 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:23.329329 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e10c8a-a911-4e9c-a3d1-2da0f3df2702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:23.345432 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-11e10c8a-a911-4e9c-a3d1-2da0f3df2702 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:05:23.346585 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-11e10c8a-a911-4e9c-a3d1-2da0f3df2702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:05:23.362136 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:23.397059 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeb48e9-c476-4a04-ac63-f0e6b7f317f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:23.398465 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeb48e9-c476-4a04-ac63-f0e6b7f317f9 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:23.410283 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 343/664] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:05:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:05:23.411081 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e10c8a-a911-4e9c-a3d1-2da0f3df2702 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:23.436726 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:23.504895 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 322/665] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jul 4 09:05:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:05:23.506329 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c103eaf-2dfd-4a04-8a98-34564b94a239 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:23.506676 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c103eaf-2dfd-4a04-8a98-34564b94a239 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:23.507013 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c103eaf-2dfd-4a04-8a98-34564b94a239 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:23.508370 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 323/666] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:05:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:05:23.509070 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c103eaf-2dfd-4a04-8a98-34564b94a239 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:23.513216 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e10c8a-a911-4e9c-a3d1-2da0f3df2702 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:23.546214 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255bb3f9-fa0f-4ac1-b019-f51dec42184b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:23.546999 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255bb3f9-fa0f-4ac1-b019-f51dec42184b None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:23.547279 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255bb3f9-fa0f-4ac1-b019-f51dec42184b None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:23.547549 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255bb3f9-fa0f-4ac1-b019-f51dec42184b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:23.554078 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255bb3f9-fa0f-4ac1-b019-f51dec42184b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:23.555519 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255bb3f9-fa0f-4ac1-b019-f51dec42184b None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:23.568842 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-255bb3f9-fa0f-4ac1-b019-f51dec42184b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:05:23.568842 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:23.568842 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:23.568842 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:23.568842 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:23.568842 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:23.568842 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:23.568842 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:23.568842 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:23.568842 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:23.568842 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:23.568842 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:23.568842 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:05:23.568842 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:05:23.568842 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:05:23.569952 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:05:23.569952 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:23.569952 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:23.569952 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:23.569952 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:23.569952 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:23.569952 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:23.569952 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:23.569952 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:23.569952 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:23.569952 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:23.569952 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:23.569952 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:23.569952 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:23.569952 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:23.569952 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:23.569952 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:23.570851 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:05:23.570851 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:05:23.570851 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:05:23.570851 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:05:23.570851 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:05:23.570851 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:05:23.570851 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:05:23.570851 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:23.570851 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 344/667] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jul 4 09:05:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:23.570851 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255bb3f9-fa0f-4ac1-b019-f51dec42184b None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:23.581827 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:23.617930 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c103eaf-2dfd-4a04-8a98-34564b94a239 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:23.652370 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30807ebd-a1f9-4472-982c-2043e5d3dbfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:23.653094 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30807ebd-a1f9-4472-982c-2043e5d3dbfa None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:23.653376 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30807ebd-a1f9-4472-982c-2043e5d3dbfa None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:23.653652 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30807ebd-a1f9-4472-982c-2043e5d3dbfa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:23.653932 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:23.664047 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30807ebd-a1f9-4472-982c-2043e5d3dbfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:23.665523 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30807ebd-a1f9-4472-982c-2043e5d3dbfa None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:23.669191 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255bb3f9-fa0f-4ac1-b019-f51dec42184b None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:23.683320 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-30807ebd-a1f9-4472-982c-2043e5d3dbfa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:23.683320 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:23.683320 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:23.683320 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:23.683320 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:23.683320 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:23.683320 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:23.683320 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:23.683320 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:23.683320 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:23.683320 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:23.683320 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:23.683320 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:05:23.683320 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:05:23.683320 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:05:23.684322 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:05:23.684322 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:23.684322 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:23.684322 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:23.684322 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:23.684322 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:23.684322 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:23.684322 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:23.684322 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:23.684322 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:23.684322 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:23.684322 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:23.684322 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:23.684322 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:23.684322 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:23.684322 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:23.684322 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:23.685234 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:05:23.685234 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:05:23.685234 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:23.685234 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:23.685234 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 324/668] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:05:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:23.685553 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30807ebd-a1f9-4472-982c-2043e5d3dbfa None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:23.707999 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53606512-6abd-401d-b94a-611c2d4c0f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:23.708794 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53606512-6abd-401d-b94a-611c2d4c0f33 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:23.709073 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53606512-6abd-401d-b94a-611c2d4c0f33 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:23.709356 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53606512-6abd-401d-b94a-611c2d4c0f33 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:23.719560 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53606512-6abd-401d-b94a-611c2d4c0f33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:05:23.727294 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-53606512-6abd-401d-b94a-611c2d4c0f33 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:05:23.727294 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:23.727294 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:23.727294 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:23.727294 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:23.727294 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:23.727294 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:23.727294 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:23.727294 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:23.727294 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:23.727294 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:23.727294 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:23.727294 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:05:23.727294 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:05:23.727294 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:05:23.727294 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:05:23.728236 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:05:23.728236 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:05:23.728236 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:05:23.728236 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:05:23.728236 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:23.728236 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:23.728236 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:23.728236 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:23.728236 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:23.728236 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:23.728236 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:23.728236 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:23.728236 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:23.728236 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:23.728236 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:23.728236 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:23.729064 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:23.729064 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:23.729064 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:23.729064 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:23.729064 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:05:23.729064 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:05:23.729064 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:05:23.729064 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:05:23.729064 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:05:23.729064 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:05:23.729064 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:05:23.729064 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:23.732216 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 345/669] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Jul 4 09:05:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:23.733735 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a255d784-05fb-41f3-8df6-c6bda0cda4b8 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:23.734059 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a255d784-05fb-41f3-8df6-c6bda0cda4b8 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:23.734336 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a255d784-05fb-41f3-8df6-c6bda0cda4b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:23.751028 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-a255d784-05fb-41f3-8df6-c6bda0cda4b8 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:05:23.752271 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-a255d784-05fb-41f3-8df6-c6bda0cda4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:05:23.786982 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30807ebd-a1f9-4472-982c-2043e5d3dbfa None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:23.803549 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:23.817440 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 346/670] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:05:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:05:23.818434 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a255d784-05fb-41f3-8df6-c6bda0cda4b8 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:23.820149 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08549a86-604a-412f-af63-54aa5ed29423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:23.820938 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08549a86-604a-412f-af63-54aa5ed29423 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:23.821223 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08549a86-604a-412f-af63-54aa5ed29423 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:23.821499 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08549a86-604a-412f-af63-54aa5ed29423 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:23.831854 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08549a86-604a-412f-af63-54aa5ed29423 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:23.833340 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08549a86-604a-412f-af63-54aa5ed29423 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:23.851387 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-08549a86-604a-412f-af63-54aa5ed29423 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:23.851387 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:23.851387 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:23.851387 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:23.851387 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:23.851387 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:23.851387 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:23.851387 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:23.851387 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:23.851387 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:23.851387 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:23.851387 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:23.851387 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:05:23.851387 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:05:23.851387 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:05:23.852623 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:05:23.852623 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:23.852623 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:23.852623 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:23.852623 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:23.852623 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:23.852623 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:23.852623 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:23.852623 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:23.852623 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:23.852623 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:23.852623 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:23.852623 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:23.852623 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:23.852623 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:23.852623 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:23.852623 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:23.853511 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:05:23.853511 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:05:23.853511 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:23.853511 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:23.853511 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 325/671] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:05:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:23.853799 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08549a86-604a-412f-af63-54aa5ed29423 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:23.900569 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:23.924328 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a255d784-05fb-41f3-8df6-c6bda0cda4b8 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:23.954185 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08549a86-604a-412f-af63-54aa5ed29423 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:23.956496 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4738734-4537-4a7f-b18b-758b17b900cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:23.957156 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4738734-4537-4a7f-b18b-758b17b900cb None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:23.957440 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4738734-4537-4a7f-b18b-758b17b900cb None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:23.957713 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4738734-4537-4a7f-b18b-758b17b900cb None admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:23.958500 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4738734-4537-4a7f-b18b-758b17b900cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:23.958808 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4738734-4537-4a7f-b18b-758b17b900cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:23.960274 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4738734-4537-4a7f-b18b-758b17b900cb None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:23.971451 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 347/672] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Jul 4 09:05:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:23.972256 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4738734-4537-4a7f-b18b-758b17b900cb None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:23.990265 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af73466c-2310-4a6a-9392-c62d799babe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:23.990957 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73466c-2310-4a6a-9392-c62d799babe7 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:23.991214 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73466c-2310-4a6a-9392-c62d799babe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:23.991513 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73466c-2310-4a6a-9392-c62d799babe7 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:23.992280 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af73466c-2310-4a6a-9392-c62d799babe7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:23.992572 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af73466c-2310-4a6a-9392-c62d799babe7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:23.993962 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af73466c-2310-4a6a-9392-c62d799babe7 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:24.011532 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 326/673] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jul 4 09:05:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:24.012393 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af73466c-2310-4a6a-9392-c62d799babe7 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:24.043097 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:24.074722 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4738734-4537-4a7f-b18b-758b17b900cb None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:24.107396 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816500e7-d816-4e68-8af3-eb08c71f4ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:24.108089 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816500e7-d816-4e68-8af3-eb08c71f4ca0 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:24.108376 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816500e7-d816-4e68-8af3-eb08c71f4ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:24.108651 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816500e7-d816-4e68-8af3-eb08c71f4ca0 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:24.109452 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816500e7-d816-4e68-8af3-eb08c71f4ca0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:24.110050 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816500e7-d816-4e68-8af3-eb08c71f4ca0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:24.111455 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816500e7-d816-4e68-8af3-eb08c71f4ca0 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:24.113189 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af73466c-2310-4a6a-9392-c62d799babe7 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:24.113641 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:24.124283 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 348/674] 10.222.0.42 () {56 vars in 1103 bytes} [Mon Jul 4 09:05:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:24.124283 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816500e7-d816-4e68-8af3-eb08c71f4ca0 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:24.147435 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d50cb28-1c95-4573-b374-f217ea45cc48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:24.148228 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d50cb28-1c95-4573-b374-f217ea45cc48 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:24.148533 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d50cb28-1c95-4573-b374-f217ea45cc48 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:24.148773 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d50cb28-1c95-4573-b374-f217ea45cc48 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:24.159063 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d50cb28-1c95-4573-b374-f217ea45cc48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:05:24.166608 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-8d50cb28-1c95-4573-b374-f217ea45cc48 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:05:24.166608 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:24.166608 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:24.166608 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:24.166608 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:24.166608 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:24.166608 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:24.166608 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:24.166608 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:24.166608 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:24.166608 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:24.166608 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:24.166608 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:05:24.166608 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:05:24.166608 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:05:24.166608 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:05:24.167733 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:05:24.167733 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:05:24.167733 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:05:24.167733 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:05:24.167733 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:24.167733 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:24.167733 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:24.167733 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:24.167733 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:24.167733 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:24.167733 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:24.167733 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:24.167733 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:24.167733 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:24.167733 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:24.167733 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:24.168850 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:24.168850 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:24.168850 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:24.168850 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:24.168850 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:05:24.168850 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:05:24.168850 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:05:24.168850 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:05:24.168850 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:05:24.168850 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:05:24.168850 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:05:24.168850 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:24.168850 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 327/675] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Jul 4 09:05:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:24.169872 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d50cb28-1c95-4573-b374-f217ea45cc48 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:24.229190 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816500e7-d816-4e68-8af3-eb08c71f4ca0 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:24.258341 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:24.261746 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ab930d-b570-4f5d-a72c-830dc70235c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:24.262407 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab930d-b570-4f5d-a72c-830dc70235c8 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:24.262684 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab930d-b570-4f5d-a72c-830dc70235c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:24.262952 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab930d-b570-4f5d-a72c-830dc70235c8 None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:24.263755 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ab930d-b570-4f5d-a72c-830dc70235c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:24.264111 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ab930d-b570-4f5d-a72c-830dc70235c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:24.265481 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ab930d-b570-4f5d-a72c-830dc70235c8 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:24.268819 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d50cb28-1c95-4573-b374-f217ea45cc48 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:24.276321 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 349/676] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jul 4 09:05:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:24.277104 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ab930d-b570-4f5d-a72c-830dc70235c8 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:24.305724 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b31301-48c5-4755-b46b-30e20514bef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:24.306380 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b31301-48c5-4755-b46b-30e20514bef8 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:24.306663 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b31301-48c5-4755-b46b-30e20514bef8 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:24.306939 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b31301-48c5-4755-b46b-30e20514bef8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:24.307777 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b31301-48c5-4755-b46b-30e20514bef8 None admin] RBAC: Adding query filter params (role.id=6cc6801f39634594b9183000ff34fbf2, scope.project.id=d015d4f3d9d4464983ff561e8e08523c, user.id=92e3804048824cde829e6273ce7c19b1) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:24.308117 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b31301-48c5-4755-b46b-30e20514bef8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:24.309570 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b31301-48c5-4755-b46b-30e20514bef8 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:24.315485 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 328/677] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Jul 4 09:05:24 2022] GET /identity/v3/role_assignments?user.id=92e3804048824cde829e6273ce7c19b1&scope.project.id=d015d4f3d9d4464983ff561e8e08523c&role.id=6cc6801f39634594b9183000ff34fbf2 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:24.316511 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b31301-48c5-4755-b46b-30e20514bef8 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:24.339801 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:24.386274 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ab930d-b570-4f5d-a72c-830dc70235c8 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:24.422545 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c808252-16d0-4d4a-80b5-ef3f5da13a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:24.423380 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c808252-16d0-4d4a-80b5-ef3f5da13a3e None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:24.423660 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c808252-16d0-4d4a-80b5-ef3f5da13a3e None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:24.423967 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c808252-16d0-4d4a-80b5-ef3f5da13a3e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:24.428347 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b31301-48c5-4755-b46b-30e20514bef8 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:24.431187 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c808252-16d0-4d4a-80b5-ef3f5da13a3e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:24.432702 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c808252-16d0-4d4a-80b5-ef3f5da13a3e None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:24.453208 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-8c808252-16d0-4d4a-80b5-ef3f5da13a3e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:05:24.453208 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:24.453208 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:24.453208 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:24.453208 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:24.453208 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:24.453208 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:24.453208 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:24.453208 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:24.453208 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:24.453208 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:24.453208 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:24.453208 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:05:24.453208 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:05:24.453208 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:05:24.454910 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:05:24.454910 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:24.454910 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:24.454910 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:24.454910 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:24.454910 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:24.454910 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:24.454910 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:24.454910 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:24.454910 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:24.454910 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:24.454910 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:24.454910 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:24.454910 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:24.454910 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:24.454910 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:24.454910 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:24.456103 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:05:24.456103 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:05:24.456103 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:05:24.456103 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:05:24.456103 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:05:24.456103 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:05:24.456103 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:05:24.456103 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:24.456103 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 350/678] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jul 4 09:05:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:24.456103 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c808252-16d0-4d4a-80b5-ef3f5da13a3e None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:24.473910 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b053b2b-cc36-41f8-b970-5d18840c9830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:24.474717 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b053b2b-cc36-41f8-b970-5d18840c9830 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:24.474997 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b053b2b-cc36-41f8-b970-5d18840c9830 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:24.475267 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b053b2b-cc36-41f8-b970-5d18840c9830 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:24.489948 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b053b2b-cc36-41f8-b970-5d18840c9830 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:24.491358 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b053b2b-cc36-41f8-b970-5d18840c9830 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:24.509935 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-0b053b2b-cc36-41f8-b970-5d18840c9830 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:24.509935 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:24.509935 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:24.509935 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:24.509935 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:24.509935 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:24.509935 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:24.509935 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:24.509935 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:24.509935 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:24.509935 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:24.509935 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:24.509935 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:05:24.509935 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:05:24.509935 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:05:24.511379 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:05:24.511379 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:24.511379 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:24.511379 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:24.511379 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:24.511379 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:24.511379 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:24.511379 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:24.511379 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:24.511379 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:24.511379 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:24.511379 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:24.511379 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:24.511379 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:24.511379 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:24.511379 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:24.511379 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:24.512377 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:05:24.512377 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:05:24.512377 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:24.512377 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:24.512377 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 329/679] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:05:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:24.512377 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b053b2b-cc36-41f8-b970-5d18840c9830 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:24.522322 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:24.574510 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c808252-16d0-4d4a-80b5-ef3f5da13a3e None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:24.592859 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:24.612053 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783c2a71-9297-462c-af8d-dc16f671e9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:24.612728 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c2a71-9297-462c-af8d-dc16f671e9f9 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:24.613011 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c2a71-9297-462c-af8d-dc16f671e9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:24.613280 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c2a71-9297-462c-af8d-dc16f671e9f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:24.614024 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783c2a71-9297-462c-af8d-dc16f671e9f9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:24.614328 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783c2a71-9297-462c-af8d-dc16f671e9f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:24.615753 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783c2a71-9297-462c-af8d-dc16f671e9f9 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:24.621713 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b053b2b-cc36-41f8-b970-5d18840c9830 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:24.624727 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 351/680] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jul 4 09:05:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:24.628877 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783c2a71-9297-462c-af8d-dc16f671e9f9 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:24.656886 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c050412-5050-4365-b756-b8b934219e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:24.657679 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c050412-5050-4365-b756-b8b934219e35 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:24.658017 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c050412-5050-4365-b756-b8b934219e35 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:24.658298 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c050412-5050-4365-b756-b8b934219e35 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:24.666180 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c050412-5050-4365-b756-b8b934219e35 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:24.667650 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c050412-5050-4365-b756-b8b934219e35 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:24.682932 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-1c050412-5050-4365-b756-b8b934219e35 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:05:24.682932 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:24.682932 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:24.682932 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:24.682932 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:24.682932 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:24.682932 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:24.682932 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:24.682932 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:24.682932 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:24.682932 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:24.682932 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:24.682932 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:05:24.682932 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:05:24.682932 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:05:24.683836 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:05:24.683836 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:24.683836 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:24.683836 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:24.683836 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:24.683836 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:24.683836 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:24.683836 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:24.683836 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:24.683836 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:24.683836 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:24.683836 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:24.683836 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:24.683836 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:24.683836 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:24.683836 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:24.683836 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:24.684763 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:05:24.684763 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:05:24.684763 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:05:24.684763 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:05:24.684763 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:05:24.684763 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:05:24.684763 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:05:24.684763 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:24.684763 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 330/681] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jul 4 09:05:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:24.685252 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c050412-5050-4365-b756-b8b934219e35 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:24.736612 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783c2a71-9297-462c-af8d-dc16f671e9f9 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:24.758665 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:24.771045 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac4a647-1c0e-43bf-9e63-6948c13f1244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:24.771707 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac4a647-1c0e-43bf-9e63-6948c13f1244 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:24.772022 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac4a647-1c0e-43bf-9e63-6948c13f1244 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:24.772304 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac4a647-1c0e-43bf-9e63-6948c13f1244 None admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:24.773091 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac4a647-1c0e-43bf-9e63-6948c13f1244 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:24.773402 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac4a647-1c0e-43bf-9e63-6948c13f1244 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:24.774835 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac4a647-1c0e-43bf-9e63-6948c13f1244 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:24.787692 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 352/682] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Jul 4 09:05:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:24.788536 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac4a647-1c0e-43bf-9e63-6948c13f1244 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:24.801990 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c050412-5050-4365-b756-b8b934219e35 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:24.834572 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:24.840437 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8aaa56-51c6-4217-8215-b9e8290666cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:24.841100 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8aaa56-51c6-4217-8215-b9e8290666cd None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:24.841381 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8aaa56-51c6-4217-8215-b9e8290666cd None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:24.841725 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8aaa56-51c6-4217-8215-b9e8290666cd None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:24.842790 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8aaa56-51c6-4217-8215-b9e8290666cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:24.842790 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8aaa56-51c6-4217-8215-b9e8290666cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:24.844134 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8aaa56-51c6-4217-8215-b9e8290666cd None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:24.856194 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 331/683] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jul 4 09:05:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:24.857437 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8aaa56-51c6-4217-8215-b9e8290666cd None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:24.906011 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac4a647-1c0e-43bf-9e63-6948c13f1244 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:24.940380 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26388450-ec33-44e2-80a9-01c70866fd26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:24.941175 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26388450-ec33-44e2-80a9-01c70866fd26 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:24.941461 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26388450-ec33-44e2-80a9-01c70866fd26 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:24.941733 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26388450-ec33-44e2-80a9-01c70866fd26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:24.952093 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26388450-ec33-44e2-80a9-01c70866fd26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:24.953519 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26388450-ec33-44e2-80a9-01c70866fd26 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:24.971731 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8aaa56-51c6-4217-8215-b9e8290666cd None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:24.972598 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-26388450-ec33-44e2-80a9-01c70866fd26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:24.972598 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:24.972598 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:24.972598 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:24.972598 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:24.972598 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:24.972598 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:24.972598 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:24.972598 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:24.972598 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:24.972598 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:24.972598 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:24.972598 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:05:24.972598 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:05:24.972598 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:05:24.973427 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:05:24.973427 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:24.973427 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:24.973427 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:24.973427 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:24.973427 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:24.973427 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:24.973427 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:24.973427 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:24.973427 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:24.973427 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:24.973427 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:24.973427 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:24.973427 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:24.973427 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:24.973427 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:24.973427 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:24.974377 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:05:24.974377 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:05:24.974377 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:24.974377 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:24.974377 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 353/684] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:05:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:24.975193 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26388450-ec33-44e2-80a9-01c70866fd26 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:25.009122 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:25.020597 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1397d627-bdc5-4870-af80-3e6d9c291416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:25.021559 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1397d627-bdc5-4870-af80-3e6d9c291416 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:25.021861 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1397d627-bdc5-4870-af80-3e6d9c291416 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:25.022121 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1397d627-bdc5-4870-af80-3e6d9c291416 None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:25.023104 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1397d627-bdc5-4870-af80-3e6d9c291416 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:25.023415 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1397d627-bdc5-4870-af80-3e6d9c291416 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:25.025590 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1397d627-bdc5-4870-af80-3e6d9c291416 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:25.045628 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 332/685] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Jul 4 09:05:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:25.045628 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1397d627-bdc5-4870-af80-3e6d9c291416 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:25.069579 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:25.081545 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26388450-ec33-44e2-80a9-01c70866fd26 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:25.118614 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2012730-afe2-4911-b941-55f5b6c81ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:25.119253 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2012730-afe2-4911-b941-55f5b6c81ebf None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:25.119524 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2012730-afe2-4911-b941-55f5b6c81ebf None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:25.119792 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2012730-afe2-4911-b941-55f5b6c81ebf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:25.120716 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2012730-afe2-4911-b941-55f5b6c81ebf None admin] RBAC: Adding query filter params (role.id=6cc6801f39634594b9183000ff34fbf2, scope.project.id=d015d4f3d9d4464983ff561e8e08523c, user.id=4db0575f076240559f64e9548b56ffeb) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:25.121024 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2012730-afe2-4911-b941-55f5b6c81ebf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:25.123093 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2012730-afe2-4911-b941-55f5b6c81ebf None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:25.139902 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 354/686] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Jul 4 09:05:24 2022] GET /identity/v3/role_assignments?user.id=4db0575f076240559f64e9548b56ffeb&scope.project.id=d015d4f3d9d4464983ff561e8e08523c&role.id=6cc6801f39634594b9183000ff34fbf2 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:25.139902 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2012730-afe2-4911-b941-55f5b6c81ebf None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:25.167633 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1397d627-bdc5-4870-af80-3e6d9c291416 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:25.207922 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ce0808-ed39-4dce-8bc0-c6ddb7ec1f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:25.208845 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ce0808-ed39-4dce-8bc0-c6ddb7ec1f00 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:25.209289 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ce0808-ed39-4dce-8bc0-c6ddb7ec1f00 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:25.209682 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ce0808-ed39-4dce-8bc0-c6ddb7ec1f00 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:25.218602 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ce0808-ed39-4dce-8bc0-c6ddb7ec1f00 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:25.220511 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ce0808-ed39-4dce-8bc0-c6ddb7ec1f00 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:25.238526 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-c2ce0808-ed39-4dce-8bc0-c6ddb7ec1f00 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 04 09:05:25.238526 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:25.238526 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:25.238526 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:25.238526 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:25.238526 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:25.238526 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:25.238526 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:25.238526 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:25.238526 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:25.238526 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:25.238526 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:25.238526 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:05:25.238526 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:05:25.238526 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:05:25.238526 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:05:25.239554 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:25.239554 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:25.239554 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:05:25.239554 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:05:25.239554 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:05:25.239554 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:05:25.239554 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:25.239554 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:25.239554 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:25.239554 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:25.239554 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:25.239554 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:25.239554 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:25.239554 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:25.239554 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:25.239554 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:25.239554 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:25.239554 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:25.240678 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:25.240678 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:25.240678 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:05:25.240678 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:05:25.240678 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:05:25.240678 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:05:25.240678 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:05:25.240678 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:05:25.240678 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 04 09:05:25.240678 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:25.240678 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 333/687] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Jul 4 09:05:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:25.241965 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ce0808-ed39-4dce-8bc0-c6ddb7ec1f00 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:25.259990 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2012730-afe2-4911-b941-55f5b6c81ebf None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:25.298327 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21447201-8214-45d3-a492-8b714b9343ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:25.298327 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21447201-8214-45d3-a492-8b714b9343ce None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:25.298852 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21447201-8214-45d3-a492-8b714b9343ce None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:25.298852 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21447201-8214-45d3-a492-8b714b9343ce None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:25.300927 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21447201-8214-45d3-a492-8b714b9343ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:25.300927 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21447201-8214-45d3-a492-8b714b9343ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:25.302013 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21447201-8214-45d3-a492-8b714b9343ce None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:25.304395 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:25.314589 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 355/688] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jul 4 09:05:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:25.315232 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21447201-8214-45d3-a492-8b714b9343ce None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:25.339599 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:25.376150 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ce0808-ed39-4dce-8bc0-c6ddb7ec1f00 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:25.417053 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a84cef8-d9a8-4558-b0c7-c98f48a9aa5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:25.418117 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a84cef8-d9a8-4558-b0c7-c98f48a9aa5e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:25.418404 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a84cef8-d9a8-4558-b0c7-c98f48a9aa5e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:25.418821 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a84cef8-d9a8-4558-b0c7-c98f48a9aa5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:25.419860 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a84cef8-d9a8-4558-b0c7-c98f48a9aa5e None admin] RBAC: Adding query filter params (role.id=6cc6801f39634594b9183000ff34fbf2, scope.project.id=d015d4f3d9d4464983ff561e8e08523c, user.id=08f86373d65440da97c853fff3c1d0d9) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:25.420206 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a84cef8-d9a8-4558-b0c7-c98f48a9aa5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:25.422569 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a84cef8-d9a8-4558-b0c7-c98f48a9aa5e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:25.430968 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 334/689] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Jul 4 09:05:25 2022] GET /identity/v3/role_assignments?user.id=08f86373d65440da97c853fff3c1d0d9&scope.project.id=d015d4f3d9d4464983ff561e8e08523c&role.id=6cc6801f39634594b9183000ff34fbf2 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:25.431859 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a84cef8-d9a8-4558-b0c7-c98f48a9aa5e None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:25.458944 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21447201-8214-45d3-a492-8b714b9343ce None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:25.510510 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9376e6c8-dc03-4d36-b81b-a6b562705f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:25.511118 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9376e6c8-dc03-4d36-b81b-a6b562705f28 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:25.511400 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9376e6c8-dc03-4d36-b81b-a6b562705f28 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:25.511672 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9376e6c8-dc03-4d36-b81b-a6b562705f28 None admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:25.512576 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9376e6c8-dc03-4d36-b81b-a6b562705f28 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:25.512885 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9376e6c8-dc03-4d36-b81b-a6b562705f28 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:25.516880 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9376e6c8-dc03-4d36-b81b-a6b562705f28 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:25.545745 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 356/690] 10.222.0.42 () {56 vars in 1135 bytes} [Mon Jul 4 09:05:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:25.552937 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9376e6c8-dc03-4d36-b81b-a6b562705f28 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:25.642428 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a84cef8-d9a8-4558-b0c7-c98f48a9aa5e None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:25.654972 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:25.681527 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:25.682810 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0056bcbf-bb96-44a3-bfce-5f726be1991a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:25.683712 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0056bcbf-bb96-44a3-bfce-5f726be1991a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:25.683939 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0056bcbf-bb96-44a3-bfce-5f726be1991a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:25.684171 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0056bcbf-bb96-44a3-bfce-5f726be1991a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:25.693703 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0056bcbf-bb96-44a3-bfce-5f726be1991a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:25.695369 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0056bcbf-bb96-44a3-bfce-5f726be1991a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:25.710506 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9376e6c8-dc03-4d36-b81b-a6b562705f28 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:25.711250 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-0056bcbf-bb96-44a3-bfce-5f726be1991a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 04 09:05:25.711250 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:25.711250 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:25.711250 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:25.711250 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:25.711250 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:25.711250 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:25.711250 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:25.711250 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:25.711250 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:25.711250 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:25.711250 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:25.711250 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:05:25.711250 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:05:25.711250 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:05:25.711250 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:05:25.712228 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:25.712228 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:25.712228 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:05:25.712228 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:05:25.712228 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:05:25.712228 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:05:25.712228 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:25.712228 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:25.712228 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:25.712228 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:25.712228 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:25.712228 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:25.712228 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:25.712228 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:25.712228 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:25.712228 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:25.712228 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:25.712228 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:25.713205 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:25.713205 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:25.713205 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:05:25.713205 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:05:25.713205 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:05:25.713205 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:05:25.713205 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:05:25.713205 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:05:25.713205 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 04 09:05:25.713205 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:25.713205 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 335/691] 10.222.0.42 () {56 vars in 1093 bytes} [Mon Jul 4 09:05:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:25.721364 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0056bcbf-bb96-44a3-bfce-5f726be1991a None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:25.757594 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeaddc9-7324-463e-91c0-5bebc139001c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:25.758734 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeaddc9-7324-463e-91c0-5bebc139001c None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:25.759224 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeaddc9-7324-463e-91c0-5bebc139001c None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:25.759683 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeaddc9-7324-463e-91c0-5bebc139001c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:25.833159 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeaddc9-7324-463e-91c0-5bebc139001c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:25.835149 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeaddc9-7324-463e-91c0-5bebc139001c None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:25.837260 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0056bcbf-bb96-44a3-bfce-5f726be1991a None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:25.893347 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66a28ea-faa2-4d14-8ce8-bbdd0dd1dc83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:25.893761 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a28ea-faa2-4d14-8ce8-bbdd0dd1dc83 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:25.894040 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a28ea-faa2-4d14-8ce8-bbdd0dd1dc83 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:25.894313 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a28ea-faa2-4d14-8ce8-bbdd0dd1dc83 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:25.895173 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66a28ea-faa2-4d14-8ce8-bbdd0dd1dc83 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:25.895479 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66a28ea-faa2-4d14-8ce8-bbdd0dd1dc83 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:25.896963 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66a28ea-faa2-4d14-8ce8-bbdd0dd1dc83 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:25.914955 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:25.934513 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 336/692] 10.222.0.42 () {56 vars in 1133 bytes} [Mon Jul 4 09:05:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:25.940028 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66a28ea-faa2-4d14-8ce8-bbdd0dd1dc83 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:25.944481 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 357/693] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jul 4 09:05:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 04 09:05:25.953105 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeaddc9-7324-463e-91c0-5bebc139001c None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:26.004926 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:26.088605 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeaddc9-7324-463e-91c0-5bebc139001c None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:26.134987 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66a28ea-faa2-4d14-8ce8-bbdd0dd1dc83 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:26.152386 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e07808-928f-43c0-868a-67113b86b718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:26.153508 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e07808-928f-43c0-868a-67113b86b718 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:26.153987 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e07808-928f-43c0-868a-67113b86b718 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:26.154495 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e07808-928f-43c0-868a-67113b86b718 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:26.172631 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e07808-928f-43c0-868a-67113b86b718 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:26.175357 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e07808-928f-43c0-868a-67113b86b718 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:26.199611 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5784d186-199f-4625-8b47-e4c217e99401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:26.200575 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5784d186-199f-4625-8b47-e4c217e99401 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:26.201218 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5784d186-199f-4625-8b47-e4c217e99401 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:26.201664 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5784d186-199f-4625-8b47-e4c217e99401 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:26.206728 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-28e07808-928f-43c0-868a-67113b86b718 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:26.206728 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:26.206728 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:26.206728 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:26.206728 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:26.206728 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:26.206728 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:26.206728 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:26.206728 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:26.206728 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:26.206728 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:26.206728 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:26.206728 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:05:26.206728 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:05:26.206728 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:05:26.207606 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:05:26.207606 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:26.207606 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:26.207606 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:26.207606 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:26.207606 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:26.207606 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:26.207606 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:26.207606 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:26.207606 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:26.207606 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:26.207606 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:26.207606 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:26.207606 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:26.207606 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:26.207606 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:26.207606 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:26.208537 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:05:26.208537 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:05:26.208537 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:26.208537 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:26.217697 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 358/694] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:05:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:26.223178 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e07808-928f-43c0-868a-67113b86b718 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:26.271085 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:26.326709 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5784d186-199f-4625-8b47-e4c217e99401 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:26.328225 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5784d186-199f-4625-8b47-e4c217e99401 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:26.381203 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:26.383163 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e07808-928f-43c0-868a-67113b86b718 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:26.426389 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b270e41-8250-4be9-82e5-475a2660455c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:26.427056 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b270e41-8250-4be9-82e5-475a2660455c None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:26.427339 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b270e41-8250-4be9-82e5-475a2660455c None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:26.427616 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b270e41-8250-4be9-82e5-475a2660455c None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:26.432330 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b270e41-8250-4be9-82e5-475a2660455c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:26.432645 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b270e41-8250-4be9-82e5-475a2660455c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:26.434049 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b270e41-8250-4be9-82e5-475a2660455c None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:26.450721 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 359/695] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jul 4 09:05:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:05:26.467138 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b270e41-8250-4be9-82e5-475a2660455c None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:26.494124 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 337/696] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jul 4 09:05:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:05:26.495551 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2019ba1f-1e9c-405a-816a-8c4796fe18c7 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:26.495835 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2019ba1f-1e9c-405a-816a-8c4796fe18c7 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:26.496233 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2019ba1f-1e9c-405a-816a-8c4796fe18c7 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:26.497990 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 338/697] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:05:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:05:26.500918 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2019ba1f-1e9c-405a-816a-8c4796fe18c7 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:26.580660 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:26.597089 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b270e41-8250-4be9-82e5-475a2660455c None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:26.610295 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2019ba1f-1e9c-405a-816a-8c4796fe18c7 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:26.632714 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f62c5be-4532-42df-b54b-701430b9c035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:26.633895 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f62c5be-4532-42df-b54b-701430b9c035 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:26.634473 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f62c5be-4532-42df-b54b-701430b9c035 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:26.634957 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f62c5be-4532-42df-b54b-701430b9c035 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:26.637726 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:26.644119 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f62c5be-4532-42df-b54b-701430b9c035 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:26.645814 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f62c5be-4532-42df-b54b-701430b9c035 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:26.647961 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e3c93-1246-43a7-b88f-7e156df5d9e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:26.649342 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e3c93-1246-43a7-b88f-7e156df5d9e4 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:26.649793 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e3c93-1246-43a7-b88f-7e156df5d9e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:26.650237 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e3c93-1246-43a7-b88f-7e156df5d9e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:26.661467 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427e3c93-1246-43a7-b88f-7e156df5d9e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:26.662407 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-6f62c5be-4532-42df-b54b-701430b9c035 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:05:26.662407 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:26.662407 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:26.662407 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:26.662407 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:26.662407 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:26.662407 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:26.662407 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:26.662407 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:26.662407 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:26.662407 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:26.662407 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:26.662407 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:05:26.662407 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:05:26.662407 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:05:26.663350 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:05:26.663350 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:26.663350 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:26.663350 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:26.663350 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:26.663350 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:26.663350 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:26.663350 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:26.663350 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:26.663350 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:26.663350 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:26.663350 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:26.663350 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:26.663350 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:26.663350 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:26.663350 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:26.663350 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:26.664493 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:05:26.664493 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:05:26.664493 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:05:26.664493 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:05:26.664493 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:05:26.664493 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:05:26.664493 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:05:26.664493 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:26.665020 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427e3c93-1246-43a7-b88f-7e156df5d9e4 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:26.667509 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 360/698] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jul 4 09:05:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:05:26.668952 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec543484-4d62-4318-98b7-5e098f61eaaa None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:26.669501 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec543484-4d62-4318-98b7-5e098f61eaaa None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:26.670026 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec543484-4d62-4318-98b7-5e098f61eaaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:26.685848 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-427e3c93-1246-43a7-b88f-7e156df5d9e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:26.685848 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:26.685848 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:26.685848 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:26.685848 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:26.685848 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:26.685848 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:26.685848 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:26.685848 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:26.685848 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:26.685848 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:26.685848 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:26.685848 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:05:26.685848 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:05:26.685848 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:05:26.686770 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:05:26.686770 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:26.686770 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:26.686770 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:26.686770 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:26.686770 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:26.686770 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:26.686770 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:26.686770 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:26.686770 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:26.686770 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:26.686770 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:26.686770 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:26.686770 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:26.686770 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:26.686770 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:26.686770 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:26.687649 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:05:26.687649 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:05:26.687649 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:26.687649 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:26.689602 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-ec543484-4d62-4318-98b7-5e098f61eaaa None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:05:26.691089 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-ec543484-4d62-4318-98b7-5e098f61eaaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:05:26.691553 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 339/699] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:05:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:26.692430 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e3c93-1246-43a7-b88f-7e156df5d9e4 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:26.767947 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 361/700] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:05:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:05:26.769293 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec543484-4d62-4318-98b7-5e098f61eaaa None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:26.800128 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e3c93-1246-43a7-b88f-7e156df5d9e4 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:26.830346 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad1987a-2e20-481a-adef-0226c67dd994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:26.831011 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad1987a-2e20-481a-adef-0226c67dd994 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:26.831299 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad1987a-2e20-481a-adef-0226c67dd994 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:26.831577 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad1987a-2e20-481a-adef-0226c67dd994 None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:26.832402 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad1987a-2e20-481a-adef-0226c67dd994 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:26.832710 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad1987a-2e20-481a-adef-0226c67dd994 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:26.834256 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad1987a-2e20-481a-adef-0226c67dd994 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:26.847203 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 340/701] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Jul 4 09:05:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:26.852248 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad1987a-2e20-481a-adef-0226c67dd994 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:26.888454 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:26.904217 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec543484-4d62-4318-98b7-5e098f61eaaa None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:26.913702 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:26.950527 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1096dec0-d998-4300-b51b-bfe7073d5a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:26.951237 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096dec0-d998-4300-b51b-bfe7073d5a41 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:26.951523 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096dec0-d998-4300-b51b-bfe7073d5a41 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:26.951973 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096dec0-d998-4300-b51b-bfe7073d5a41 None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:26.952725 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1096dec0-d998-4300-b51b-bfe7073d5a41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:26.953025 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1096dec0-d998-4300-b51b-bfe7073d5a41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:26.955220 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1096dec0-d998-4300-b51b-bfe7073d5a41 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:26.971949 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 362/702] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jul 4 09:05:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:26.973132 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1096dec0-d998-4300-b51b-bfe7073d5a41 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:26.993394 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad1987a-2e20-481a-adef-0226c67dd994 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:27.029394 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dffe07b-728b-4b1f-813c-9459369b95e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:27.030188 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dffe07b-728b-4b1f-813c-9459369b95e0 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:27.030493 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dffe07b-728b-4b1f-813c-9459369b95e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:27.030777 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dffe07b-728b-4b1f-813c-9459369b95e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:27.042335 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dffe07b-728b-4b1f-813c-9459369b95e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:27.043974 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dffe07b-728b-4b1f-813c-9459369b95e0 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:27.062621 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-3dffe07b-728b-4b1f-813c-9459369b95e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:27.062621 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:27.062621 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:27.062621 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:27.062621 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:27.062621 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:27.062621 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:27.062621 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:27.062621 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:27.062621 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:27.062621 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:27.062621 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:27.062621 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:05:27.062621 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:05:27.062621 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:05:27.063601 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:05:27.063601 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:27.063601 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:27.063601 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:27.063601 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:27.063601 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:27.063601 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:27.063601 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:27.063601 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:27.063601 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:27.063601 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:27.063601 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:27.063601 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:27.063601 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:27.063601 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:27.063601 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:27.063601 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:27.064526 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:05:27.064526 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:05:27.064526 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:27.064526 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:27.068240 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 341/703] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:05:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:27.069200 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dffe07b-728b-4b1f-813c-9459369b95e0 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:27.081950 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1096dec0-d998-4300-b51b-bfe7073d5a41 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:27.118507 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea7cd2e-486f-48b2-8a93-78d80716f4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:27.119585 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea7cd2e-486f-48b2-8a93-78d80716f4cc None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:27.120126 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea7cd2e-486f-48b2-8a93-78d80716f4cc None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:27.120619 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea7cd2e-486f-48b2-8a93-78d80716f4cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:27.121743 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea7cd2e-486f-48b2-8a93-78d80716f4cc None admin] RBAC: Adding query filter params (role.id=6cc6801f39634594b9183000ff34fbf2, scope.project.id=d015d4f3d9d4464983ff561e8e08523c, user.id=59d8698c45fb46259765eb3c8de2297f) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:27.122343 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea7cd2e-486f-48b2-8a93-78d80716f4cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:27.124075 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea7cd2e-486f-48b2-8a93-78d80716f4cc None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:27.127546 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:27.131736 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 363/704] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Jul 4 09:05:26 2022] GET /identity/v3/role_assignments?user.id=59d8698c45fb46259765eb3c8de2297f&scope.project.id=d015d4f3d9d4464983ff561e8e08523c&role.id=6cc6801f39634594b9183000ff34fbf2 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:27.132805 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea7cd2e-486f-48b2-8a93-78d80716f4cc None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:27.197094 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:27.212379 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dffe07b-728b-4b1f-813c-9459369b95e0 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:27.242209 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea7cd2e-486f-48b2-8a93-78d80716f4cc None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:27.276285 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d120a5b-ae77-4fb4-ba94-850760b6e390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:27.277140 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d120a5b-ae77-4fb4-ba94-850760b6e390 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:27.277427 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d120a5b-ae77-4fb4-ba94-850760b6e390 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:27.277699 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d120a5b-ae77-4fb4-ba94-850760b6e390 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:27.279356 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690ed9a7-b653-40bc-8d32-7e944a6b5552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:27.280305 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ed9a7-b653-40bc-8d32-7e944a6b5552 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:27.280799 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ed9a7-b653-40bc-8d32-7e944a6b5552 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:27.281291 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ed9a7-b653-40bc-8d32-7e944a6b5552 None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:27.282259 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690ed9a7-b653-40bc-8d32-7e944a6b5552 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:27.282783 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690ed9a7-b653-40bc-8d32-7e944a6b5552 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:27.284481 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690ed9a7-b653-40bc-8d32-7e944a6b5552 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:27.291721 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d120a5b-ae77-4fb4-ba94-850760b6e390 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:27.293321 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d120a5b-ae77-4fb4-ba94-850760b6e390 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:27.299656 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 364/705] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jul 4 09:05:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:27.305435 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690ed9a7-b653-40bc-8d32-7e944a6b5552 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:27.324417 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-0d120a5b-ae77-4fb4-ba94-850760b6e390 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:05:27.324417 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:27.324417 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:27.324417 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:27.324417 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:27.324417 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:27.324417 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:27.324417 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:27.324417 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:27.324417 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:27.324417 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:27.324417 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:27.324417 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:05:27.324417 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:05:27.324417 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:05:27.325388 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:05:27.325388 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:27.325388 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:27.325388 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:27.325388 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:27.325388 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:27.325388 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:27.325388 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:27.325388 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:27.325388 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:27.325388 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:27.325388 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:27.325388 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:27.325388 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:27.325388 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:27.325388 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:27.325388 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:27.326357 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:05:27.326357 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:05:27.326357 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:05:27.326357 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:05:27.326357 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:05:27.326357 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:05:27.326357 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:05:27.326357 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:27.326357 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 342/706] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jul 4 09:05:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:27.331731 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d120a5b-ae77-4fb4-ba94-850760b6e390 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:27.373937 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:27.417749 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690ed9a7-b653-40bc-8d32-7e944a6b5552 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:27.473840 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1311fe-6726-424b-9133-cd00276b23bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:27.475439 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1311fe-6726-424b-9133-cd00276b23bb None admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:27.476006 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1311fe-6726-424b-9133-cd00276b23bb None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:27.476505 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1311fe-6726-424b-9133-cd00276b23bb None admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:27.477547 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1311fe-6726-424b-9133-cd00276b23bb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:27.479379 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1311fe-6726-424b-9133-cd00276b23bb None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:27.495240 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d120a5b-ae77-4fb4-ba94-850760b6e390 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:27.512419 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 365/707] 10.222.0.42 () {60 vars in 1132 bytes} [Mon Jul 4 09:05:27 2022] POST /identity/v3/users => generated 254 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:05:27.512419 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d6e6da-9330-43d6-beea-6876951f6ab3 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:27.512419 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d6e6da-9330-43d6-beea-6876951f6ab3 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:27.512419 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d6e6da-9330-43d6-beea-6876951f6ab3 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:27.512419 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 366/708] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:05:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:05:27.521737 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a53505-8fff-4851-9ab6-f1986f62db39 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:27.522076 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a53505-8fff-4851-9ab6-f1986f62db39 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:27.523904 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a53505-8fff-4851-9ab6-f1986f62db39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:27.543306 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-91a53505-8fff-4851-9ab6-f1986f62db39 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:05:27.544714 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-91a53505-8fff-4851-9ab6-f1986f62db39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:05:27.555555 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d730d531-f474-4f04-aca5-2f688345cf6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:27.556713 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d730d531-f474-4f04-aca5-2f688345cf6a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:27.557333 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d730d531-f474-4f04-aca5-2f688345cf6a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:27.557812 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d730d531-f474-4f04-aca5-2f688345cf6a None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:27.558960 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d730d531-f474-4f04-aca5-2f688345cf6a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:27.559502 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d730d531-f474-4f04-aca5-2f688345cf6a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:27.561421 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d730d531-f474-4f04-aca5-2f688345cf6a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:27.578041 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 343/709] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Jul 4 09:05:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:27.589387 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d730d531-f474-4f04-aca5-2f688345cf6a None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:27.612451 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:27.635171 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 367/710] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:05:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:05:27.663210 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a53505-8fff-4851-9ab6-f1986f62db39 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:27.715087 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:27.742539 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d730d531-f474-4f04-aca5-2f688345cf6a None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:27.786846 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aea3337-43cb-41b3-bbb2-167e71c72d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:27.787504 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea3337-43cb-41b3-bbb2-167e71c72d74 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:27.787780 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea3337-43cb-41b3-bbb2-167e71c72d74 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:27.788092 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea3337-43cb-41b3-bbb2-167e71c72d74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:27.788294 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a53505-8fff-4851-9ab6-f1986f62db39 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:27.788992 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aea3337-43cb-41b3-bbb2-167e71c72d74 None admin] RBAC: Adding query filter params (role.id=965049e7ce6144aaad23c15f3a5e37c3, scope.project.id=d015d4f3d9d4464983ff561e8e08523c, user.id=af3b6e252a8c434a99432bcece6493b3) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:27.789298 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aea3337-43cb-41b3-bbb2-167e71c72d74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:27.790858 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aea3337-43cb-41b3-bbb2-167e71c72d74 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:27.797136 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 344/711] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Jul 4 09:05:27 2022] GET /identity/v3/role_assignments?user.id=af3b6e252a8c434a99432bcece6493b3&scope.project.id=d015d4f3d9d4464983ff561e8e08523c&role.id=965049e7ce6144aaad23c15f3a5e37c3 => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:27.834885 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f69c904-e1d3-42a1-b4e1-628a5c9d3cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:27.835735 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f69c904-e1d3-42a1-b4e1-628a5c9d3cb3 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:27.836129 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f69c904-e1d3-42a1-b4e1-628a5c9d3cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:27.836414 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f69c904-e1d3-42a1-b4e1-628a5c9d3cb3 None admin] PATH_INFO: `/v3/services/network` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:27.837141 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f69c904-e1d3-42a1-b4e1-628a5c9d3cb3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:27.838597 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f69c904-e1d3-42a1-b4e1-628a5c9d3cb3 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:27.854183 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-2f69c904-e1d3-42a1-b4e1-628a5c9d3cb3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 04 09:05:27.854183 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:27.854183 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 09:05:27.854183 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 09:05:27.854183 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 09:05:27.854183 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 09:05:27.854183 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 09:05:27.854183 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:05:27.854183 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 04 09:05:27.854183 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:27.854183 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:05:27.854183 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:27.854183 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:27.854183 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:27.854183 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:27.854183 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:27.854183 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:27.856192 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:27.856192 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:27.856192 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:27.856192 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:27.856192 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:27.856192 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:27.856192 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 09:05:27.856192 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 09:05:27.856192 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 09:05:27.856192 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 09:05:27.856192 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:27.856192 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:27.856192 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:27.856192 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:27.856192 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:27.856192 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:27.857885 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:27.857885 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:27.857885 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:27.857885 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:27.857885 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:27.857885 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:27.857885 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:27.857885 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:27.857885 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:27.857885 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:27.857885 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 09:05:27.857885 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:05:27.857885 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 04 09:05:27.857885 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:27.857885 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 368/712] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jul 4 09:05:27 2022] GET /identity/v3/services/network => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:05:27.863736 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aea3337-43cb-41b3-bbb2-167e71c72d74 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:27.901376 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e853e33a-ef97-4ed6-81a2-895faf448e4d None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:27.901376 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e853e33a-ef97-4ed6-81a2-895faf448e4d None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:27.901642 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e853e33a-ef97-4ed6-81a2-895faf448e4d None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:27.906884 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 369/713] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:05:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:05:27.909062 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac42849-8f0c-4582-9ce8-0e2b863cc088 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:27.909404 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac42849-8f0c-4582-9ce8-0e2b863cc088 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:27.909686 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac42849-8f0c-4582-9ce8-0e2b863cc088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:27.930611 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-aac42849-8f0c-4582-9ce8-0e2b863cc088 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:05:27.931740 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-aac42849-8f0c-4582-9ce8-0e2b863cc088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:05:28.008318 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:28.021900 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 370/714] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:05:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:05:28.042157 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aea3337-43cb-41b3-bbb2-167e71c72d74 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:28.049518 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac42849-8f0c-4582-9ce8-0e2b863cc088 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:28.112546 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabd7719-17dc-416a-82f2-1b93be6c5ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:28.113226 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabd7719-17dc-416a-82f2-1b93be6c5ee6 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:28.113511 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabd7719-17dc-416a-82f2-1b93be6c5ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:28.113787 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabd7719-17dc-416a-82f2-1b93be6c5ee6 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:28.114510 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabd7719-17dc-416a-82f2-1b93be6c5ee6 None admin] RBAC: Adding query filter params (name=network) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:28.114818 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabd7719-17dc-416a-82f2-1b93be6c5ee6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:28.116267 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabd7719-17dc-416a-82f2-1b93be6c5ee6 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:28.120684 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:28.125868 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 345/715] 10.222.0.42 () {56 vars in 1112 bytes} [Mon Jul 4 09:05:27 2022] GET /identity/v3/services?name=network => generated 124 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:28.133077 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabd7719-17dc-416a-82f2-1b93be6c5ee6 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:28.236010 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac42849-8f0c-4582-9ce8-0e2b863cc088 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:28.281617 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14762f50-6155-476a-8bfc-039de5a1deb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:28.282349 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14762f50-6155-476a-8bfc-039de5a1deb6 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:28.282630 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14762f50-6155-476a-8bfc-039de5a1deb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:28.282902 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14762f50-6155-476a-8bfc-039de5a1deb6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:28.283566 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14762f50-6155-476a-8bfc-039de5a1deb6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:28.284984 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14762f50-6155-476a-8bfc-039de5a1deb6 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:28.297126 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-14762f50-6155-476a-8bfc-039de5a1deb6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 04 09:05:28.297126 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:28.297126 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 09:05:28.297126 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 09:05:28.297126 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 09:05:28.297126 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 09:05:28.297126 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 09:05:28.297126 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:05:28.297126 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 04 09:05:28.297126 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:28.297126 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:05:28.297126 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:28.297126 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:28.297126 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:28.297126 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:28.297126 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:28.298148 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:28.298148 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:28.298148 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:28.298148 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:28.298148 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:28.298148 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:28.298148 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:28.298148 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 09:05:28.298148 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 09:05:28.298148 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 09:05:28.298148 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 09:05:28.298148 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:28.298148 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:28.298148 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:28.298148 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:28.298148 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:28.299012 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:28.299012 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:28.299012 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:28.299012 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:28.299012 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:28.299012 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:28.299012 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:28.299012 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:28.299012 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:28.299012 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:28.299012 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:28.299012 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 09:05:28.299012 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:05:28.299012 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 04 09:05:28.299012 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:28.299835 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabd7719-17dc-416a-82f2-1b93be6c5ee6 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:28.299934 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 371/716] 10.222.0.42 () {56 vars in 1129 bytes} [Mon Jul 4 09:05:28 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:05:28.309090 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14762f50-6155-476a-8bfc-039de5a1deb6 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:28.368642 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a497a3-4578-4724-ab0e-06f64aa1419c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:28.369364 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a497a3-4578-4724-ab0e-06f64aa1419c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:28.369643 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a497a3-4578-4724-ab0e-06f64aa1419c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:28.369910 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a497a3-4578-4724-ab0e-06f64aa1419c None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:28.370671 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a497a3-4578-4724-ab0e-06f64aa1419c None admin] RBAC: Adding query filter params (type=network) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:28.370974 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a497a3-4578-4724-ab0e-06f64aa1419c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:28.372392 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a497a3-4578-4724-ab0e-06f64aa1419c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:28.380804 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 346/717] 10.222.0.42 () {56 vars in 1112 bytes} [Mon Jul 4 09:05:28 2022] GET /identity/v3/services?type=network => generated 124 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:28.446601 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14762f50-6155-476a-8bfc-039de5a1deb6 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:28.449494 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:28.482662 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4066e991-7ecd-44ae-8de4-8aee094cae31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:28.483336 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4066e991-7ecd-44ae-8de4-8aee094cae31 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:28.483596 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4066e991-7ecd-44ae-8de4-8aee094cae31 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:28.483860 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4066e991-7ecd-44ae-8de4-8aee094cae31 None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:28.484647 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4066e991-7ecd-44ae-8de4-8aee094cae31 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:28.485269 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4066e991-7ecd-44ae-8de4-8aee094cae31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:28.486755 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4066e991-7ecd-44ae-8de4-8aee094cae31 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:28.492166 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 372/718] 10.222.0.42 () {56 vars in 1124 bytes} [Mon Jul 4 09:05:28 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:05:28.497855 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a497a3-4578-4724-ab0e-06f64aa1419c None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:28.503492 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:28.653029 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a497a3-4578-4724-ab0e-06f64aa1419c None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:28.696688 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd30c37c-4b7c-4c92-b878-9185ee92ac97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:28.697348 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd30c37c-4b7c-4c92-b878-9185ee92ac97 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:28.697624 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd30c37c-4b7c-4c92-b878-9185ee92ac97 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:28.697894 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd30c37c-4b7c-4c92-b878-9185ee92ac97 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:28.698599 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd30c37c-4b7c-4c92-b878-9185ee92ac97 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:28.698901 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd30c37c-4b7c-4c92-b878-9185ee92ac97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:28.700335 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd30c37c-4b7c-4c92-b878-9185ee92ac97 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:28.705348 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 347/719] 10.222.0.42 () {56 vars in 1124 bytes} [Mon Jul 4 09:05:28 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:29.864029 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32fed42-7007-46df-b0fd-7695993514e0 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:29.864581 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32fed42-7007-46df-b0fd-7695993514e0 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:29.864862 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32fed42-7007-46df-b0fd-7695993514e0 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:29.866607 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 373/720] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:05:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:05:29.871779 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8171902-7397-480e-9ab7-3ef0f8eb7555 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:29.872212 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8171902-7397-480e-9ab7-3ef0f8eb7555 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:29.872388 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8171902-7397-480e-9ab7-3ef0f8eb7555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:29.900148 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-e8171902-7397-480e-9ab7-3ef0f8eb7555 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:05:29.901338 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e8171902-7397-480e-9ab7-3ef0f8eb7555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:05:29.982142 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:29.989395 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 348/721] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:05:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:05:30.029726 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32fed42-7007-46df-b0fd-7695993514e0 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:30.145583 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32fed42-7007-46df-b0fd-7695993514e0 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:30.166672 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd8623-882f-4998-ad95-568f48394c43 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:30.166975 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd8623-882f-4998-ad95-568f48394c43 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:30.167243 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd8623-882f-4998-ad95-568f48394c43 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:30.169062 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 349/722] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:05:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:05:30.173980 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5daa74-00e8-4593-b2fc-4825bd32fe0f None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:30.174273 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5daa74-00e8-4593-b2fc-4825bd32fe0f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:30.174559 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5daa74-00e8-4593-b2fc-4825bd32fe0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:30.195121 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1d6b1f-307f-4c89-b5ed-cf8ec631df19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:30.195942 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d6b1f-307f-4c89-b5ed-cf8ec631df19 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:30.196232 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d6b1f-307f-4c89-b5ed-cf8ec631df19 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:30.196512 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d6b1f-307f-4c89-b5ed-cf8ec631df19 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:30.197867 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-2f5daa74-00e8-4593-b2fc-4825bd32fe0f None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:05:30.199069 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-2f5daa74-00e8-4593-b2fc-4825bd32fe0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:05:30.216534 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1d6b1f-307f-4c89-b5ed-cf8ec631df19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:05:30.226991 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-bf1d6b1f-307f-4c89-b5ed-cf8ec631df19 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:05:30.226991 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:30.226991 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:30.226991 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:30.226991 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:30.226991 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:30.226991 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:30.226991 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:30.226991 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:30.226991 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:30.226991 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:30.226991 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:30.226991 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:05:30.226991 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:05:30.226991 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:05:30.226991 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:05:30.227927 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:05:30.227927 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:05:30.227927 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:05:30.227927 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:05:30.227927 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:30.227927 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:30.227927 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:30.227927 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:30.227927 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:30.227927 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:30.227927 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:30.227927 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:30.227927 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:30.227927 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:30.227927 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:30.227927 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:30.228823 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:30.228823 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:30.228823 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:30.228823 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:30.228823 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:05:30.228823 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:05:30.228823 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:05:30.228823 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:05:30.228823 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:05:30.228823 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:05:30.228823 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:05:30.228823 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:30.228823 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 374/723] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Jul 4 09:05:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:30.237702 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1d6b1f-307f-4c89-b5ed-cf8ec631df19 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:30.291757 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:30.319806 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 350/724] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:05:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:05:30.321239 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67957115-f499-4108-8b0c-217a33ebf764 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:30.321578 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67957115-f499-4108-8b0c-217a33ebf764 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:30.321860 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67957115-f499-4108-8b0c-217a33ebf764 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:30.323250 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 351/725] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:05:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:05:30.329126 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3060886-8c95-4d35-9da4-7f341f4ac133 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:30.329408 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3060886-8c95-4d35-9da4-7f341f4ac133 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:30.329674 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3060886-8c95-4d35-9da4-7f341f4ac133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:30.347117 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-e3060886-8c95-4d35-9da4-7f341f4ac133 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:05:30.348845 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e3060886-8c95-4d35-9da4-7f341f4ac133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:05:30.390640 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1d6b1f-307f-4c89-b5ed-cf8ec631df19 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:30.423651 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e5788-332c-4ed1-a569-1addeb9d88ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:30.424441 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e5788-332c-4ed1-a569-1addeb9d88ab None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:30.424800 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e5788-332c-4ed1-a569-1addeb9d88ab None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:30.425149 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e5788-332c-4ed1-a569-1addeb9d88ab None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:30.425977 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4e5788-332c-4ed1-a569-1addeb9d88ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:30.426466 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4e5788-332c-4ed1-a569-1addeb9d88ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:30.428028 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4e5788-332c-4ed1-a569-1addeb9d88ab None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:30.432304 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 352/726] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:05:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 09:05:30.433889 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3060886-8c95-4d35-9da4-7f341f4ac133 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:30.437057 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 375/727] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jul 4 09:05:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:30.448884 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e5788-332c-4ed1-a569-1addeb9d88ab None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:30.513679 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:30.551968 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:30.563581 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e5788-332c-4ed1-a569-1addeb9d88ab None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:30.565717 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3060886-8c95-4d35-9da4-7f341f4ac133 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:30.601551 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661fac0e-aa65-4b86-8354-26aa0b894515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:30.602496 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661fac0e-aa65-4b86-8354-26aa0b894515 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:30.602777 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661fac0e-aa65-4b86-8354-26aa0b894515 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:30.603049 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661fac0e-aa65-4b86-8354-26aa0b894515 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:30.612051 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01d3381-9774-4c3c-86b1-0c97b8cb95d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:30.613529 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d3381-9774-4c3c-86b1-0c97b8cb95d7 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:30.614016 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d3381-9774-4c3c-86b1-0c97b8cb95d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:30.614686 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d3381-9774-4c3c-86b1-0c97b8cb95d7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:30.615158 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661fac0e-aa65-4b86-8354-26aa0b894515 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:30.616641 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661fac0e-aa65-4b86-8354-26aa0b894515 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:30.627806 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01d3381-9774-4c3c-86b1-0c97b8cb95d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:05:30.634390 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-661fac0e-aa65-4b86-8354-26aa0b894515 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:30.634390 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:30.634390 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:30.634390 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:30.634390 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:30.634390 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:30.634390 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:30.634390 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:30.634390 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:30.634390 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:30.634390 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:30.634390 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:30.634390 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:05:30.634390 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:05:30.634390 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:05:30.635447 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:05:30.635447 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:30.635447 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:30.635447 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:30.635447 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:30.635447 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:30.635447 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:30.635447 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:30.635447 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:30.635447 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:30.635447 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:30.635447 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:30.635447 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:30.635447 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:30.635447 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:30.635447 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:30.635447 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:30.636515 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:05:30.636515 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:05:30.636515 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:30.636515 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:30.638277 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-a01d3381-9774-4c3c-86b1-0c97b8cb95d7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:05:30.638277 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:30.638277 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:30.638277 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:30.638277 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:30.638277 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:30.638277 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:30.638277 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:30.638277 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:30.638277 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:30.638277 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:30.638277 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:30.638277 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:05:30.638277 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:05:30.638277 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:05:30.638277 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:05:30.639179 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:05:30.639179 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:05:30.639179 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:05:30.639179 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:05:30.639179 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:30.639179 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:30.639179 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:30.639179 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:30.639179 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:30.639179 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:30.639179 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:30.639179 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:30.639179 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:30.639179 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:30.639179 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:30.639179 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:30.640050 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:30.640050 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:30.640050 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:30.640050 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:30.640050 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:05:30.640050 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:05:30.640050 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:05:30.640050 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:05:30.640050 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:05:30.640050 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:05:30.640050 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:05:30.640050 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:30.640799 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 376/728] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:05:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:30.641387 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661fac0e-aa65-4b86-8354-26aa0b894515 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:30.642670 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 353/729] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Jul 4 09:05:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:30.643700 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01d3381-9774-4c3c-86b1-0c97b8cb95d7 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:30.751506 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661fac0e-aa65-4b86-8354-26aa0b894515 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:30.780583 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01d3381-9774-4c3c-86b1-0c97b8cb95d7 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:30.786307 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b5517e-47bf-4cfb-86ac-358ccfaf7542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:30.787112 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b5517e-47bf-4cfb-86ac-358ccfaf7542 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:30.787391 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b5517e-47bf-4cfb-86ac-358ccfaf7542 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:30.787664 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b5517e-47bf-4cfb-86ac-358ccfaf7542 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:30.799668 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b5517e-47bf-4cfb-86ac-358ccfaf7542 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:05:30.807955 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-80b5517e-47bf-4cfb-86ac-358ccfaf7542 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:05:30.807955 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:30.807955 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:30.807955 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:30.807955 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:30.807955 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:30.807955 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:30.807955 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:30.807955 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:30.807955 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:30.807955 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:30.807955 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:30.807955 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:05:30.807955 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:05:30.807955 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:05:30.807955 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:05:30.808883 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:05:30.808883 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:05:30.808883 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:05:30.808883 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:05:30.808883 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:30.808883 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:30.808883 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:30.808883 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:30.808883 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:30.808883 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:30.808883 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:30.808883 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:30.808883 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:30.808883 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:30.808883 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:30.808883 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:30.809737 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:30.809737 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:30.809737 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:30.809737 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:30.809737 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:05:30.809737 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:05:30.809737 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:05:30.809737 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:05:30.809737 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:05:30.809737 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:05:30.809737 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:05:30.809737 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:30.813186 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:30.814294 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 377/730] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Jul 4 09:05:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:30.815087 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b5517e-47bf-4cfb-86ac-358ccfaf7542 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:30.818954 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:30.837746 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f77f5f-23ac-4de1-9203-6d6de8525572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:30.839030 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f77f5f-23ac-4de1-9203-6d6de8525572 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:30.839515 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f77f5f-23ac-4de1-9203-6d6de8525572 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:30.839984 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f77f5f-23ac-4de1-9203-6d6de8525572 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:30.840908 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f77f5f-23ac-4de1-9203-6d6de8525572 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:30.841991 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f77f5f-23ac-4de1-9203-6d6de8525572 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:30.843838 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f77f5f-23ac-4de1-9203-6d6de8525572 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:30.861546 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 354/731] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jul 4 09:05:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:30.862663 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f77f5f-23ac-4de1-9203-6d6de8525572 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:30.949240 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b5517e-47bf-4cfb-86ac-358ccfaf7542 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:30.975190 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f77f5f-23ac-4de1-9203-6d6de8525572 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:30.991900 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9010b8c2-7e1e-43ed-961c-e623fcf9cae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:30.992408 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010b8c2-7e1e-43ed-961c-e623fcf9cae8 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:30.992692 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010b8c2-7e1e-43ed-961c-e623fcf9cae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:30.992965 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010b8c2-7e1e-43ed-961c-e623fcf9cae8 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:30.993718 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9010b8c2-7e1e-43ed-961c-e623fcf9cae8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:30.994027 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9010b8c2-7e1e-43ed-961c-e623fcf9cae8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:30.995396 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9010b8c2-7e1e-43ed-961c-e623fcf9cae8 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:31.004685 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 378/732] 10.222.0.42 () {56 vars in 1103 bytes} [Mon Jul 4 09:05:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:31.005558 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9010b8c2-7e1e-43ed-961c-e623fcf9cae8 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:31.023376 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b68a822-4cd0-4c4d-bc19-8c1059a31c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:31.024582 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b68a822-4cd0-4c4d-bc19-8c1059a31c32 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:31.025065 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b68a822-4cd0-4c4d-bc19-8c1059a31c32 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:31.025783 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b68a822-4cd0-4c4d-bc19-8c1059a31c32 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:31.027091 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b68a822-4cd0-4c4d-bc19-8c1059a31c32 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:31.027574 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b68a822-4cd0-4c4d-bc19-8c1059a31c32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:31.029230 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b68a822-4cd0-4c4d-bc19-8c1059a31c32 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:31.040838 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 355/733] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jul 4 09:05:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:31.041910 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b68a822-4cd0-4c4d-bc19-8c1059a31c32 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:31.075346 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:31.086034 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:31.113874 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9010b8c2-7e1e-43ed-961c-e623fcf9cae8 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:31.147315 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b68a822-4cd0-4c4d-bc19-8c1059a31c32 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:31.150764 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422c50d7-cc1a-4c83-a782-35a25f2de156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:31.151593 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c50d7-cc1a-4c83-a782-35a25f2de156 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:31.151899 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c50d7-cc1a-4c83-a782-35a25f2de156 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:31.152184 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c50d7-cc1a-4c83-a782-35a25f2de156 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:31.160715 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422c50d7-cc1a-4c83-a782-35a25f2de156 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:31.162159 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422c50d7-cc1a-4c83-a782-35a25f2de156 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:31.176503 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-422c50d7-cc1a-4c83-a782-35a25f2de156 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 04 09:05:31.176503 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:31.176503 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:31.176503 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:31.176503 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:31.176503 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:31.176503 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:31.176503 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:31.176503 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:31.176503 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:31.176503 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:31.176503 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:31.176503 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:05:31.176503 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:05:31.176503 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:05:31.176503 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:05:31.177459 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:31.177459 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:31.177459 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:05:31.177459 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:05:31.177459 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:05:31.177459 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:05:31.177459 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:31.177459 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:31.177459 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:31.177459 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:31.177459 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:31.177459 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:31.177459 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:31.177459 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:31.177459 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:31.177459 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:31.177459 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:31.177459 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:31.178412 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:31.178412 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:31.178412 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:05:31.178412 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:05:31.178412 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:05:31.178412 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:05:31.178412 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:05:31.178412 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:05:31.178412 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 04 09:05:31.178412 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:31.178412 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 379/734] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Jul 4 09:05:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:31.178999 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a196d36-eda1-4cd9-b2d6-d37f6df9f884 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:31.179433 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a196d36-eda1-4cd9-b2d6-d37f6df9f884 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:31.179548 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a196d36-eda1-4cd9-b2d6-d37f6df9f884 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:31.180767 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 380/735] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:05:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:05:31.181506 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a196d36-eda1-4cd9-b2d6-d37f6df9f884 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:31.186752 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afdc86c-91dc-4ed9-b821-49955adf4d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:31.187550 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afdc86c-91dc-4ed9-b821-49955adf4d0a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:31.187835 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afdc86c-91dc-4ed9-b821-49955adf4d0a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:31.188144 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afdc86c-91dc-4ed9-b821-49955adf4d0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:31.198788 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afdc86c-91dc-4ed9-b821-49955adf4d0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:31.200362 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afdc86c-91dc-4ed9-b821-49955adf4d0a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:31.217522 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-8afdc86c-91dc-4ed9-b821-49955adf4d0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:31.217522 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:31.217522 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:31.217522 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:31.217522 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:31.217522 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:31.217522 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:31.217522 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:31.217522 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:31.217522 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:31.217522 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:31.217522 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:31.217522 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:05:31.217522 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:05:31.217522 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:05:31.218644 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:05:31.218644 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:31.218644 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:31.218644 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:31.218644 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:31.218644 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:31.218644 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:31.218644 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:31.218644 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:31.218644 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:31.218644 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:31.218644 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:31.218644 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:31.218644 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:31.218644 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:31.218644 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:31.218644 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:31.219683 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:05:31.219683 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:05:31.219683 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:31.219683 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:31.223300 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 356/736] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:05:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:31.224490 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f7ce9-5ba9-4b08-907e-4986d37db43e None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:31.224793 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f7ce9-5ba9-4b08-907e-4986d37db43e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:31.225092 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f7ce9-5ba9-4b08-907e-4986d37db43e None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:31.226372 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 357/737] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:05:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:05:31.227063 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f7ce9-5ba9-4b08-907e-4986d37db43e None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:31.283316 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a196d36-eda1-4cd9-b2d6-d37f6df9f884 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:31.305384 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:31.316391 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940f93db-eab1-49f5-965e-7f90e473163e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:31.317189 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f93db-eab1-49f5-965e-7f90e473163e None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:31.317476 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f93db-eab1-49f5-965e-7f90e473163e None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:31.317752 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f93db-eab1-49f5-965e-7f90e473163e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:31.320031 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:31.328629 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940f93db-eab1-49f5-965e-7f90e473163e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:31.329674 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f7ce9-5ba9-4b08-907e-4986d37db43e None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:31.330063 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940f93db-eab1-49f5-965e-7f90e473163e None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:31.347112 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-940f93db-eab1-49f5-965e-7f90e473163e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:31.347112 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:31.347112 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:31.347112 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:31.347112 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:31.347112 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:31.347112 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:31.347112 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:31.347112 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:31.347112 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:31.347112 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:31.347112 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:31.347112 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:05:31.347112 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:05:31.347112 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:05:31.348162 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:05:31.348162 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:31.348162 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:31.348162 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:31.348162 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:31.348162 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:31.348162 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:31.348162 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:31.348162 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:31.348162 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:31.348162 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:31.348162 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:31.348162 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:31.348162 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:31.348162 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:31.348162 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:31.348162 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:31.349063 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:05:31.349063 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:05:31.349063 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:31.349063 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:31.349063 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 381/738] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:05:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:31.349550 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb289602-aec7-4484-94e6-84975fa13bab None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:31.350138 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb289602-aec7-4484-94e6-84975fa13bab None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:31.350138 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb289602-aec7-4484-94e6-84975fa13bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:31.365084 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1567efae-d1c9-4dd5-b48f-ab03f4d5d681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:31.365753 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567efae-d1c9-4dd5-b48f-ab03f4d5d681 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:31.366026 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567efae-d1c9-4dd5-b48f-ab03f4d5d681 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:31.366304 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567efae-d1c9-4dd5-b48f-ab03f4d5d681 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:31.366869 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-bb289602-aec7-4484-94e6-84975fa13bab None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:05:31.367174 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1567efae-d1c9-4dd5-b48f-ab03f4d5d681 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:31.367486 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1567efae-d1c9-4dd5-b48f-ab03f4d5d681 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:31.368094 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-bb289602-aec7-4484-94e6-84975fa13bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:05:31.368965 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1567efae-d1c9-4dd5-b48f-ab03f4d5d681 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:31.386145 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 358/739] 10.222.0.42 () {56 vars in 1135 bytes} [Mon Jul 4 09:05:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:31.386939 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1567efae-d1c9-4dd5-b48f-ab03f4d5d681 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:31.435378 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 382/740] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:05:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:05:31.436468 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae376eb-b4c4-4a8e-a8e1-2cb0726c173c None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:31.436761 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae376eb-b4c4-4a8e-a8e1-2cb0726c173c None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:31.437040 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae376eb-b4c4-4a8e-a8e1-2cb0726c173c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:31.455798 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-cae376eb-b4c4-4a8e-a8e1-2cb0726c173c None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:05:31.458049 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-cae376eb-b4c4-4a8e-a8e1-2cb0726c173c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:05:31.485854 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1567efae-d1c9-4dd5-b48f-ab03f4d5d681 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:31.519630 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98469db-1891-4fca-9582-7fef783f8aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:31.520323 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98469db-1891-4fca-9582-7fef783f8aa0 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:31.520603 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98469db-1891-4fca-9582-7fef783f8aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:31.520879 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98469db-1891-4fca-9582-7fef783f8aa0 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:31.521600 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98469db-1891-4fca-9582-7fef783f8aa0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:31.521905 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98469db-1891-4fca-9582-7fef783f8aa0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:31.522474 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 383/741] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:05:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:05:31.523293 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98469db-1891-4fca-9582-7fef783f8aa0 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:31.523407 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae376eb-b4c4-4a8e-a8e1-2cb0726c173c None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:31.546889 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 359/742] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jul 4 09:05:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:31.547645 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98469db-1891-4fca-9582-7fef783f8aa0 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:31.558025 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:31.560136 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:31.620773 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae376eb-b4c4-4a8e-a8e1-2cb0726c173c None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:31.645534 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98469db-1891-4fca-9582-7fef783f8aa0 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:31.653376 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b67df85-c124-4abf-ada7-cd43c48c3c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:31.654094 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b67df85-c124-4abf-ada7-cd43c48c3c54 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:31.654356 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b67df85-c124-4abf-ada7-cd43c48c3c54 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:31.654629 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b67df85-c124-4abf-ada7-cd43c48c3c54 None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:31.655357 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b67df85-c124-4abf-ada7-cd43c48c3c54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:31.655665 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b67df85-c124-4abf-ada7-cd43c48c3c54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:31.657099 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b67df85-c124-4abf-ada7-cd43c48c3c54 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:31.669014 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 384/743] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jul 4 09:05:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:31.669819 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b67df85-c124-4abf-ada7-cd43c48c3c54 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:31.680367 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e369010-34d3-4adf-9c08-f383d92b21ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:31.681085 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e369010-34d3-4adf-9c08-f383d92b21ce None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:31.681373 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e369010-34d3-4adf-9c08-f383d92b21ce None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:31.681644 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e369010-34d3-4adf-9c08-f383d92b21ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:31.749380 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e369010-34d3-4adf-9c08-f383d92b21ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:31.750867 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e369010-34d3-4adf-9c08-f383d92b21ce None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:31.761614 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:31.766034 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:31.774456 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b67df85-c124-4abf-ada7-cd43c48c3c54 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:31.809425 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e4e44e-4587-4e78-b34d-bb28bd90089a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:31.810020 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e4e44e-4587-4e78-b34d-bb28bd90089a None admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:31.810344 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e4e44e-4587-4e78-b34d-bb28bd90089a None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:31.810619 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e4e44e-4587-4e78-b34d-bb28bd90089a None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:31.811345 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e4e44e-4587-4e78-b34d-bb28bd90089a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:31.812761 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e4e44e-4587-4e78-b34d-bb28bd90089a None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:31.826960 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 385/744] 10.222.0.42 () {60 vars in 1141 bytes} [Mon Jul 4 09:05:31 2022] POST /identity/v3/services => generated 240 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:05:31.827848 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e4e44e-4587-4e78-b34d-bb28bd90089a None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:31.853888 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 360/745] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jul 4 09:05:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:05:31.854651 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e369010-34d3-4adf-9c08-f383d92b21ce None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:31.973276 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e4e44e-4587-4e78-b34d-bb28bd90089a None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:31.987222 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e369010-34d3-4adf-9c08-f383d92b21ce None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:31.999349 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:32.016547 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b08cb30-2754-4d4e-8c42-e4c0ce154976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:32.017228 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08cb30-2754-4d4e-8c42-e4c0ce154976 None admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:32.017513 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08cb30-2754-4d4e-8c42-e4c0ce154976 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:32.017790 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08cb30-2754-4d4e-8c42-e4c0ce154976 None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:32.018530 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b08cb30-2754-4d4e-8c42-e4c0ce154976 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:32.020164 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b08cb30-2754-4d4e-8c42-e4c0ce154976 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:32.025341 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14955c1b-d1f2-4281-9d52-d6f5d78fa6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:32.026148 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14955c1b-d1f2-4281-9d52-d6f5d78fa6eb None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:32.026497 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14955c1b-d1f2-4281-9d52-d6f5d78fa6eb None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:32.026773 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14955c1b-d1f2-4281-9d52-d6f5d78fa6eb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:32.034797 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14955c1b-d1f2-4281-9d52-d6f5d78fa6eb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:32.035912 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 386/746] 10.222.0.42 () {60 vars in 1141 bytes} [Mon Jul 4 09:05:31 2022] POST /identity/v3/services => generated 251 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:05:32.036333 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14955c1b-d1f2-4281-9d52-d6f5d78fa6eb None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:32.036839 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b08cb30-2754-4d4e-8c42-e4c0ce154976 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:32.053728 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:32.062914 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-14955c1b-d1f2-4281-9d52-d6f5d78fa6eb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 04 09:05:32.062914 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:32.062914 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:32.062914 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:32.062914 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:32.062914 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:32.062914 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:32.062914 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:32.062914 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:32.062914 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:32.062914 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:32.062914 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:32.062914 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:05:32.062914 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:05:32.062914 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:05:32.062914 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:05:32.063937 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:32.063937 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:32.063937 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:05:32.063937 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:05:32.063937 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:05:32.063937 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:05:32.063937 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:32.063937 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:32.063937 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:32.063937 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:32.063937 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:32.063937 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:32.063937 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:32.063937 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:32.063937 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:32.063937 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:32.063937 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:32.063937 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:32.064891 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:32.064891 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:32.064891 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:05:32.064891 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:05:32.064891 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:05:32.064891 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:05:32.064891 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:05:32.064891 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:05:32.064891 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 04 09:05:32.064891 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:32.064891 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 361/747] 10.222.0.42 () {56 vars in 1117 bytes} [Mon Jul 4 09:05:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:32.066888 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14955c1b-d1f2-4281-9d52-d6f5d78fa6eb None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:32.180596 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b08cb30-2754-4d4e-8c42-e4c0ce154976 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:32.191829 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14955c1b-d1f2-4281-9d52-d6f5d78fa6eb None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:32.226296 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7689aa2c-9259-4150-a868-549dd4b422af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:32.227103 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7689aa2c-9259-4150-a868-549dd4b422af None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:32.227393 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7689aa2c-9259-4150-a868-549dd4b422af None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:32.227673 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7689aa2c-9259-4150-a868-549dd4b422af None admin] PATH_INFO: `/v3/users/nova` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:32.230370 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e9e86b-e031-4822-9683-d31ef701c482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:32.231730 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9e86b-e031-4822-9683-d31ef701c482 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:32.232164 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9e86b-e031-4822-9683-d31ef701c482 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:32.232442 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9e86b-e031-4822-9683-d31ef701c482 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:32.236110 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7689aa2c-9259-4150-a868-549dd4b422af None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:32.238693 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7689aa2c-9259-4150-a868-549dd4b422af None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:32.246867 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e9e86b-e031-4822-9683-d31ef701c482 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:32.249225 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e9e86b-e031-4822-9683-d31ef701c482 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:32.253958 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-7689aa2c-9259-4150-a868-549dd4b422af None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 04 09:05:32.253958 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:32.253958 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:32.253958 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:32.253958 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:32.253958 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:32.253958 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:32.253958 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:32.253958 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:32.253958 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:32.253958 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:32.253958 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:32.253958 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:05:32.253958 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:05:32.253958 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:05:32.253958 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:05:32.254931 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:32.254931 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:32.254931 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:05:32.254931 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:05:32.254931 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:05:32.254931 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:05:32.254931 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:32.254931 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:32.254931 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:32.254931 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:32.254931 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:32.254931 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:32.254931 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:32.254931 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:32.254931 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:32.254931 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:32.254931 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:32.254931 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:32.256448 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:32.256448 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:32.256448 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:05:32.256448 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:05:32.256448 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:05:32.256448 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:05:32.256448 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:05:32.256448 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:05:32.256448 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 04 09:05:32.256448 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:32.257299 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 387/748] 10.222.0.42 () {56 vars in 1093 bytes} [Mon Jul 4 09:05:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:32.258403 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7689aa2c-9259-4150-a868-549dd4b422af None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:32.267922 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-21e9e86b-e031-4822-9683-d31ef701c482 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:32.267922 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:32.267922 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:32.267922 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:32.267922 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:32.267922 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:32.267922 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:32.267922 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:32.267922 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:32.267922 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:32.267922 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:32.267922 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:32.267922 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:05:32.267922 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:05:32.267922 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:05:32.268891 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:05:32.268891 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:32.268891 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:32.268891 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:32.268891 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:32.268891 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:32.268891 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:32.268891 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:32.268891 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:32.268891 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:32.268891 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:32.268891 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:32.268891 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:32.268891 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:32.268891 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:32.268891 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:32.268891 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:32.269782 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:05:32.269782 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:05:32.269782 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:32.269782 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:32.270485 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 362/749] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:05:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:32.270670 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e9e86b-e031-4822-9683-d31ef701c482 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:32.307958 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:32.339702 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:32.384722 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e9e86b-e031-4822-9683-d31ef701c482 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:32.385913 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7689aa2c-9259-4150-a868-549dd4b422af None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:32.420984 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076bd549-7992-46ea-8aae-c80d1f00227d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:32.421996 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076bd549-7992-46ea-8aae-c80d1f00227d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:32.422492 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076bd549-7992-46ea-8aae-c80d1f00227d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:32.422966 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076bd549-7992-46ea-8aae-c80d1f00227d None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:32.424055 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076bd549-7992-46ea-8aae-c80d1f00227d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:32.424556 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076bd549-7992-46ea-8aae-c80d1f00227d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:32.426196 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076bd549-7992-46ea-8aae-c80d1f00227d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:32.430893 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80784d49-c77a-43bc-a145-ec870b442d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:32.431569 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80784d49-c77a-43bc-a145-ec870b442d58 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:32.431857 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80784d49-c77a-43bc-a145-ec870b442d58 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:32.432168 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80784d49-c77a-43bc-a145-ec870b442d58 None admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:32.433023 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80784d49-c77a-43bc-a145-ec870b442d58 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:32.433332 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80784d49-c77a-43bc-a145-ec870b442d58 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:32.434773 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80784d49-c77a-43bc-a145-ec870b442d58 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:32.447581 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 363/750] 10.222.0.42 () {56 vars in 1133 bytes} [Mon Jul 4 09:05:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:32.448832 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076bd549-7992-46ea-8aae-c80d1f00227d None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:32.460330 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 388/751] 10.222.0.42 () {56 vars in 1149 bytes} [Mon Jul 4 09:05:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:32.461453 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80784d49-c77a-43bc-a145-ec870b442d58 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:32.564828 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80784d49-c77a-43bc-a145-ec870b442d58 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:32.569412 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:32.593679 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076bd549-7992-46ea-8aae-c80d1f00227d None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:32.601945 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:32.613443 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8fc389-7df2-4106-904f-2cec4bba29cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:32.614583 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8fc389-7df2-4106-904f-2cec4bba29cb None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:32.615083 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8fc389-7df2-4106-904f-2cec4bba29cb None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:32.615556 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8fc389-7df2-4106-904f-2cec4bba29cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:32.626765 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8fc389-7df2-4106-904f-2cec4bba29cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:32.628624 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8fc389-7df2-4106-904f-2cec4bba29cb None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:32.630633 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a202a8-3d1b-44aa-8698-e5c85e97f0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:32.631311 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a202a8-3d1b-44aa-8698-e5c85e97f0e5 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:32.631591 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a202a8-3d1b-44aa-8698-e5c85e97f0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:32.631862 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a202a8-3d1b-44aa-8698-e5c85e97f0e5 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:32.632611 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a202a8-3d1b-44aa-8698-e5c85e97f0e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:32.632911 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a202a8-3d1b-44aa-8698-e5c85e97f0e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:32.634289 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a202a8-3d1b-44aa-8698-e5c85e97f0e5 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:32.647057 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 364/752] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jul 4 09:05:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:32.648024 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a202a8-3d1b-44aa-8698-e5c85e97f0e5 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:32.649544 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-1e8fc389-7df2-4106-904f-2cec4bba29cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:32.649544 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:32.649544 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:32.649544 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:32.649544 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:32.649544 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:32.649544 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:32.649544 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:32.649544 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:32.649544 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:32.649544 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:32.649544 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:32.649544 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:05:32.649544 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:05:32.649544 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:05:32.650457 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:05:32.650457 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:32.650457 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:32.650457 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:32.650457 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:32.650457 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:32.650457 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:32.650457 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:32.650457 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:32.650457 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:32.650457 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:32.650457 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:32.650457 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:32.650457 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:32.650457 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:32.650457 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:32.650457 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:32.651353 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:05:32.651353 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:05:32.651353 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:32.651353 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:32.657881 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 389/753] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:05:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:32.658961 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8fc389-7df2-4106-904f-2cec4bba29cb None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:32.749575 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a202a8-3d1b-44aa-8698-e5c85e97f0e5 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:32.761713 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8fc389-7df2-4106-904f-2cec4bba29cb None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:32.783957 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b5da2c-2ddd-4d1f-ba18-5343fcba70e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:32.784640 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b5da2c-2ddd-4d1f-ba18-5343fcba70e0 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:32.784903 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b5da2c-2ddd-4d1f-ba18-5343fcba70e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:32.785176 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b5da2c-2ddd-4d1f-ba18-5343fcba70e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:32.797167 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:32.799237 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c72536-32be-475d-b69b-321fde3f44b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:32.800369 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c72536-32be-475d-b69b-321fde3f44b4 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:32.801002 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c72536-32be-475d-b69b-321fde3f44b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:32.801499 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c72536-32be-475d-b69b-321fde3f44b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:32.809494 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c72536-32be-475d-b69b-321fde3f44b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:32.811283 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c72536-32be-475d-b69b-321fde3f44b4 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:32.825851 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-d6c72536-32be-475d-b69b-321fde3f44b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:05:32.825851 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:32.825851 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:32.825851 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:32.825851 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:32.825851 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:32.825851 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:32.825851 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:32.825851 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:32.825851 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:32.825851 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:32.825851 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:32.825851 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:05:32.825851 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:05:32.825851 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:05:32.826733 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:05:32.826733 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:32.826733 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:32.826733 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:32.826733 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:32.826733 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:32.826733 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:32.826733 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:32.826733 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:32.826733 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:32.826733 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:32.826733 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:32.826733 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:32.826733 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:32.826733 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:32.826733 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:32.826733 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:32.827621 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:05:32.827621 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:05:32.827621 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:05:32.827621 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:05:32.827621 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:05:32.827621 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:05:32.827621 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:05:32.827621 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:32.830279 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 390/754] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jul 4 09:05:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:32.831325 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c72536-32be-475d-b69b-321fde3f44b4 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:32.865977 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b5da2c-2ddd-4d1f-ba18-5343fcba70e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:32.867373 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b5da2c-2ddd-4d1f-ba18-5343fcba70e0 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:32.893697 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:32.967202 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c72536-32be-475d-b69b-321fde3f44b4 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:33.004306 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118374ba-9d4c-4330-9f1c-e362b30c31ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:33.005036 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118374ba-9d4c-4330-9f1c-e362b30c31ec None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:33.005273 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118374ba-9d4c-4330-9f1c-e362b30c31ec None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:33.005557 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118374ba-9d4c-4330-9f1c-e362b30c31ec None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:33.006289 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118374ba-9d4c-4330-9f1c-e362b30c31ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:33.006612 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118374ba-9d4c-4330-9f1c-e362b30c31ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:33.011924 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118374ba-9d4c-4330-9f1c-e362b30c31ec None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:33.012360 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 365/755] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jul 4 09:05:32 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 04 09:05:33.014471 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b5da2c-2ddd-4d1f-ba18-5343fcba70e0 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:33.028465 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 391/756] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jul 4 09:05:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:33.028465 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118374ba-9d4c-4330-9f1c-e362b30c31ec None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:33.075340 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:33.125927 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:33.130410 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118374ba-9d4c-4330-9f1c-e362b30c31ec None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:33.158303 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b5da2c-2ddd-4d1f-ba18-5343fcba70e0 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:33.167481 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98580648-00fe-4963-bad9-f844ce17def6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:33.168439 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98580648-00fe-4963-bad9-f844ce17def6 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:33.168827 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98580648-00fe-4963-bad9-f844ce17def6 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:33.169202 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98580648-00fe-4963-bad9-f844ce17def6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:33.181009 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98580648-00fe-4963-bad9-f844ce17def6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:33.183166 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98580648-00fe-4963-bad9-f844ce17def6 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:33.200879 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3033c268-a574-4637-b750-70358e6f541c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:33.201880 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033c268-a574-4637-b750-70358e6f541c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:33.202306 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033c268-a574-4637-b750-70358e6f541c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:33.202748 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033c268-a574-4637-b750-70358e6f541c None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:33.203708 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3033c268-a574-4637-b750-70358e6f541c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:33.204186 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3033c268-a574-4637-b750-70358e6f541c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:33.204645 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-98580648-00fe-4963-bad9-f844ce17def6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:33.204645 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:33.204645 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:33.204645 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:33.204645 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:33.204645 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:33.204645 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:33.204645 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:33.204645 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:33.204645 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:33.204645 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:33.204645 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:33.204645 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:05:33.204645 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:05:33.204645 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:05:33.205649 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:05:33.205649 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:33.205649 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:33.205649 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:33.205649 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:33.205649 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:33.205649 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:33.205649 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:33.205649 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:33.205649 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:33.205649 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:33.205649 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:33.205649 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:33.205649 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:33.205649 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:33.205649 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:33.205649 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:33.206524 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:05:33.206524 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:05:33.206524 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:33.206524 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:33.208308 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3033c268-a574-4637-b750-70358e6f541c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:33.210556 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 392/757] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:05:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:33.212009 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98580648-00fe-4963-bad9-f844ce17def6 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:33.227329 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 366/758] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Jul 4 09:05:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:33.228627 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3033c268-a574-4637-b750-70358e6f541c None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:33.332091 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:33.333716 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98580648-00fe-4963-bad9-f844ce17def6 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:33.334947 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3033c268-a574-4637-b750-70358e6f541c None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:33.370131 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6adeca-bcfe-4699-8bcc-0aa771528c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:33.371106 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6adeca-bcfe-4699-8bcc-0aa771528c33 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:33.371461 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6adeca-bcfe-4699-8bcc-0aa771528c33 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:33.371816 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6adeca-bcfe-4699-8bcc-0aa771528c33 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:33.372660 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f18b98-5a33-4191-8353-81b7f8b2d2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:33.372791 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6adeca-bcfe-4699-8bcc-0aa771528c33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:33.373108 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6adeca-bcfe-4699-8bcc-0aa771528c33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:33.373891 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f18b98-5a33-4191-8353-81b7f8b2d2b6 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:33.374358 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f18b98-5a33-4191-8353-81b7f8b2d2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:33.374705 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6adeca-bcfe-4699-8bcc-0aa771528c33 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:33.374936 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f18b98-5a33-4191-8353-81b7f8b2d2b6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:33.382752 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f18b98-5a33-4191-8353-81b7f8b2d2b6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:33.384591 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f18b98-5a33-4191-8353-81b7f8b2d2b6 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:33.392150 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 367/759] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jul 4 09:05:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:33.393128 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6adeca-bcfe-4699-8bcc-0aa771528c33 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:33.399546 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-67f18b98-5a33-4191-8353-81b7f8b2d2b6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:05:33.399546 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:33.399546 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:33.399546 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:33.399546 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:33.399546 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:33.399546 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:33.399546 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:33.399546 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:33.399546 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:33.399546 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:33.399546 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:33.399546 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:05:33.399546 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:05:33.399546 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:05:33.400658 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:05:33.400658 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:33.400658 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:33.400658 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:33.400658 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:33.400658 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:33.400658 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:33.400658 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:33.400658 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:33.400658 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:33.400658 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:33.400658 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:33.400658 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:33.400658 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:33.400658 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:33.400658 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:33.400658 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:33.401783 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:05:33.401783 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:05:33.401783 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:05:33.401783 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:05:33.401783 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:05:33.401783 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:05:33.401783 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:05:33.401783 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:33.408497 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 393/760] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jul 4 09:05:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:33.409560 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f18b98-5a33-4191-8353-81b7f8b2d2b6 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:33.424254 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:33.501542 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6adeca-bcfe-4699-8bcc-0aa771528c33 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:33.517085 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f18b98-5a33-4191-8353-81b7f8b2d2b6 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:33.538159 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff35826-021d-432d-9f1f-f15965548e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:33.539084 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff35826-021d-432d-9f1f-f15965548e12 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:33.539585 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff35826-021d-432d-9f1f-f15965548e12 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:33.540155 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff35826-021d-432d-9f1f-f15965548e12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:33.541252 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff35826-021d-432d-9f1f-f15965548e12 None admin] RBAC: Adding query filter params (role.id=965049e7ce6144aaad23c15f3a5e37c3, scope.project.id=d015d4f3d9d4464983ff561e8e08523c, user.id=59d8698c45fb46259765eb3c8de2297f) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:33.541739 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff35826-021d-432d-9f1f-f15965548e12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:33.543462 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff35826-021d-432d-9f1f-f15965548e12 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:33.556226 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 368/761] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Jul 4 09:05:33 2022] GET /identity/v3/role_assignments?user.id=59d8698c45fb46259765eb3c8de2297f&scope.project.id=d015d4f3d9d4464983ff561e8e08523c&role.id=965049e7ce6144aaad23c15f3a5e37c3 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:33.556226 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff35826-021d-432d-9f1f-f15965548e12 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:33.560722 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19a849f-f190-4edf-ab6c-9e95bbe6cdc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:33.561547 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a849f-f190-4edf-ab6c-9e95bbe6cdc9 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:33.561832 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a849f-f190-4edf-ab6c-9e95bbe6cdc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:33.562109 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a849f-f190-4edf-ab6c-9e95bbe6cdc9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:33.577017 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19a849f-f190-4edf-ab6c-9e95bbe6cdc9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:33.578545 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19a849f-f190-4edf-ab6c-9e95bbe6cdc9 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:33.611702 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-d19a849f-f190-4edf-ab6c-9e95bbe6cdc9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:05:33.611702 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:33.611702 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:33.611702 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:33.611702 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:33.611702 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:33.611702 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:33.611702 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:33.611702 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:33.611702 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:33.611702 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:33.611702 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:33.611702 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:05:33.611702 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:05:33.611702 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:05:33.612728 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:05:33.612728 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:33.612728 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:33.612728 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:33.612728 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:33.612728 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:33.612728 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:33.612728 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:33.612728 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:33.612728 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:33.612728 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:33.612728 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:33.612728 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:33.612728 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:33.612728 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:33.612728 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:33.612728 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:33.613616 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:05:33.613616 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:05:33.613616 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:05:33.613616 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:05:33.613616 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:05:33.613616 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:05:33.613616 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:05:33.613616 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:33.613616 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 394/762] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jul 4 09:05:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:33.617193 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:33.622117 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19a849f-f190-4edf-ab6c-9e95bbe6cdc9 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:33.768809 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:33.777547 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff35826-021d-432d-9f1f-f15965548e12 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:33.804375 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19a849f-f190-4edf-ab6c-9e95bbe6cdc9 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:33.819773 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8209932f-6aec-488f-b937-c25914cae8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:33.820604 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8209932f-6aec-488f-b937-c25914cae8c9 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:33.820981 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8209932f-6aec-488f-b937-c25914cae8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:33.821376 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8209932f-6aec-488f-b937-c25914cae8c9 None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:33.822282 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8209932f-6aec-488f-b937-c25914cae8c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:33.822685 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8209932f-6aec-488f-b937-c25914cae8c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:33.827902 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8209932f-6aec-488f-b937-c25914cae8c9 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:33.839765 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 369/763] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Jul 4 09:05:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:33.846693 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8209932f-6aec-488f-b937-c25914cae8c9 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:33.892641 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc07f079-ac20-4dfc-8614-66f84bcb3337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:33.893675 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc07f079-ac20-4dfc-8614-66f84bcb3337 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:33.894184 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc07f079-ac20-4dfc-8614-66f84bcb3337 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:33.894679 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc07f079-ac20-4dfc-8614-66f84bcb3337 None admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:33.895677 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc07f079-ac20-4dfc-8614-66f84bcb3337 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:33.896212 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc07f079-ac20-4dfc-8614-66f84bcb3337 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:33.899901 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc07f079-ac20-4dfc-8614-66f84bcb3337 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:33.920701 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 395/764] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Jul 4 09:05:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:33.922422 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217bb7dc-fcb4-4386-a4a5-5ec28ea5471a None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:33.922978 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217bb7dc-fcb4-4386-a4a5-5ec28ea5471a None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:33.923452 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217bb7dc-fcb4-4386-a4a5-5ec28ea5471a None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:33.928785 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 396/765] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:05:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:05:33.929798 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217bb7dc-fcb4-4386-a4a5-5ec28ea5471a None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:33.988252 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:33.995862 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8209932f-6aec-488f-b937-c25914cae8c9 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:34.034569 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217bb7dc-fcb4-4386-a4a5-5ec28ea5471a None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:34.039409 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00047d6d-751a-4809-a3d5-5bd8a72c5ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:34.040467 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00047d6d-751a-4809-a3d5-5bd8a72c5ba6 None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:34.040843 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00047d6d-751a-4809-a3d5-5bd8a72c5ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:34.041212 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00047d6d-751a-4809-a3d5-5bd8a72c5ba6 None admin] PATH_INFO: `/v3/projects/d015d4f3d9d4464983ff561e8e08523c/users/af3b6e252a8c434a99432bcece6493b3/roles/965049e7ce6144aaad23c15f3a5e37c3` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:34.043281 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00047d6d-751a-4809-a3d5-5bd8a72c5ba6 None admin] RBAC: Authorizing `identity:create_grant(project_id=d015d4f3d9d4464983ff561e8e08523c, user_id=af3b6e252a8c434a99432bcece6493b3, role_id=965049e7ce6144aaad23c15f3a5e37c3)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:34.045420 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00047d6d-751a-4809-a3d5-5bd8a72c5ba6 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:34.069001 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 370/766] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Jul 4 09:05:33 2022] PUT /identity/v3/projects/d015d4f3d9d4464983ff561e8e08523c/users/af3b6e252a8c434a99432bcece6493b3/roles/965049e7ce6144aaad23c15f3a5e37c3 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:05:34.069921 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:34.071553 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7407788-57f8-4f65-8d59-c8cb3ca111c3 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:34.072092 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7407788-57f8-4f65-8d59-c8cb3ca111c3 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:34.072503 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7407788-57f8-4f65-8d59-c8cb3ca111c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:34.082133 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c6f9cf-4df3-4b1a-b286-2f7db65a32f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:34.084623 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c6f9cf-4df3-4b1a-b286-2f7db65a32f4 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:34.086622 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c6f9cf-4df3-4b1a-b286-2f7db65a32f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:34.087138 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c6f9cf-4df3-4b1a-b286-2f7db65a32f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:34.088405 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c6f9cf-4df3-4b1a-b286-2f7db65a32f4 None admin] RBAC: Adding query filter params (role.id=6cc6801f39634594b9183000ff34fbf2, scope.project.id=d015d4f3d9d4464983ff561e8e08523c, user.id=bd758d5b21684027b0d199021df0ad2f) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:34.089182 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c6f9cf-4df3-4b1a-b286-2f7db65a32f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:34.092064 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c6f9cf-4df3-4b1a-b286-2f7db65a32f4 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:34.102005 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 397/767] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Jul 4 09:05:33 2022] GET /identity/v3/role_assignments?user.id=bd758d5b21684027b0d199021df0ad2f&scope.project.id=d015d4f3d9d4464983ff561e8e08523c&role.id=6cc6801f39634594b9183000ff34fbf2 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:34.110889 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-d7407788-57f8-4f65-8d59-c8cb3ca111c3 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:05:34.110889 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d7407788-57f8-4f65-8d59-c8cb3ca111c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:05:34.170872 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a98040-a39c-437b-9283-f55253f5ef30 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:34.171260 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a98040-a39c-437b-9283-f55253f5ef30 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:34.171540 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a98040-a39c-437b-9283-f55253f5ef30 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:34.174856 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 398/768] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:05:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:05:34.186428 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41496dba-b505-4351-997e-6794eb90ec95 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:34.187042 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 371/769] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:05:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:05:34.187343 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41496dba-b505-4351-997e-6794eb90ec95 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:34.187821 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41496dba-b505-4351-997e-6794eb90ec95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:34.211355 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7407788-57f8-4f65-8d59-c8cb3ca111c3 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:34.229833 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-41496dba-b505-4351-997e-6794eb90ec95 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:05:34.231187 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-41496dba-b505-4351-997e-6794eb90ec95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:05:34.341103 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:34.358116 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 399/770] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:05:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:05:34.377897 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7407788-57f8-4f65-8d59-c8cb3ca111c3 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:34.382299 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41496dba-b505-4351-997e-6794eb90ec95 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:34.441902 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8a1751-14d7-41b1-a7dc-71d8d6a2135a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:34.442707 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8a1751-14d7-41b1-a7dc-71d8d6a2135a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:34.442991 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8a1751-14d7-41b1-a7dc-71d8d6a2135a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:34.443269 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8a1751-14d7-41b1-a7dc-71d8d6a2135a None admin] PATH_INFO: `/v3/services/network` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:34.443958 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8a1751-14d7-41b1-a7dc-71d8d6a2135a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:34.445373 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8a1751-14d7-41b1-a7dc-71d8d6a2135a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:34.469296 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-fa8a1751-14d7-41b1-a7dc-71d8d6a2135a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 04 09:05:34.469296 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:34.469296 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 09:05:34.469296 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 09:05:34.469296 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 09:05:34.469296 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 09:05:34.469296 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 09:05:34.469296 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:05:34.469296 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 04 09:05:34.469296 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:34.469296 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:05:34.469296 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:34.469296 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:34.469296 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:34.469296 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:34.469296 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:34.469296 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:34.470564 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:34.470564 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:34.470564 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:34.470564 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:34.470564 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:34.470564 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:34.470564 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 09:05:34.470564 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 09:05:34.470564 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 09:05:34.470564 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 09:05:34.470564 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:34.470564 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:34.470564 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:34.470564 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:34.470564 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:34.470564 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:34.471620 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:34.471620 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:34.471620 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:34.471620 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:34.471620 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:34.471620 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:34.471620 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:34.471620 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:34.471620 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:34.471620 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:34.471620 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 09:05:34.471620 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:05:34.471620 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 04 09:05:34.471620 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:34.471620 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 372/771] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jul 4 09:05:34 2022] GET /identity/v3/services/network => generated 88 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:05:34.477417 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8a1751-14d7-41b1-a7dc-71d8d6a2135a None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:34.542729 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41496dba-b505-4351-997e-6794eb90ec95 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:34.569722 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:34.594903 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635c030b-0d6e-4c72-b1d7-91230f794370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:34.595975 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c030b-0d6e-4c72-b1d7-91230f794370 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:34.596264 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c030b-0d6e-4c72-b1d7-91230f794370 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:34.596537 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c030b-0d6e-4c72-b1d7-91230f794370 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:34.597207 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635c030b-0d6e-4c72-b1d7-91230f794370 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:34.598617 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635c030b-0d6e-4c72-b1d7-91230f794370 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:34.624341 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-635c030b-0d6e-4c72-b1d7-91230f794370 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 04 09:05:34.624341 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:34.624341 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 09:05:34.624341 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 09:05:34.624341 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 09:05:34.624341 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 09:05:34.624341 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 09:05:34.624341 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:05:34.624341 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 04 09:05:34.624341 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:34.624341 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:05:34.624341 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:34.624341 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:34.624341 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:34.624341 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:34.624341 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:34.625599 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:34.625599 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:34.625599 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:34.625599 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:34.625599 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:34.625599 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:34.625599 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:34.625599 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 09:05:34.625599 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 09:05:34.625599 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 09:05:34.625599 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 09:05:34.625599 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:34.625599 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:34.625599 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:34.625599 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:34.625599 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:34.626524 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:34.626524 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:34.626524 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:34.626524 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:34.626524 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:34.626524 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:34.626524 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:34.626524 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:34.626524 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:34.626524 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:34.626524 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:34.626524 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 09:05:34.626524 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:05:34.626524 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 04 09:05:34.626524 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:34.626524 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 400/772] 10.222.0.42 () {56 vars in 1129 bytes} [Mon Jul 4 09:05:34 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:34.635740 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635c030b-0d6e-4c72-b1d7-91230f794370 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:34.703731 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8a1751-14d7-41b1-a7dc-71d8d6a2135a None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:34.774920 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d16a3de-3c6b-490c-bf5a-0b5060173e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:34.775885 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d16a3de-3c6b-490c-bf5a-0b5060173e67 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:34.776203 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d16a3de-3c6b-490c-bf5a-0b5060173e67 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:34.776483 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d16a3de-3c6b-490c-bf5a-0b5060173e67 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:34.777371 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d16a3de-3c6b-490c-bf5a-0b5060173e67 None admin] RBAC: Adding query filter params (name=network) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:34.777966 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d16a3de-3c6b-490c-bf5a-0b5060173e67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:34.779437 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d16a3de-3c6b-490c-bf5a-0b5060173e67 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:34.792054 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 373/773] 10.222.0.42 () {56 vars in 1112 bytes} [Mon Jul 4 09:05:34 2022] GET /identity/v3/services?name=network => generated 124 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:34.797528 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d16a3de-3c6b-490c-bf5a-0b5060173e67 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:34.801356 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:34.817675 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635c030b-0d6e-4c72-b1d7-91230f794370 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:34.898558 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20592e81-8675-4558-a1df-969d026daba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:34.899293 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20592e81-8675-4558-a1df-969d026daba6 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:34.899679 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20592e81-8675-4558-a1df-969d026daba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:34.900085 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20592e81-8675-4558-a1df-969d026daba6 None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:34.900913 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20592e81-8675-4558-a1df-969d026daba6 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:34.901321 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20592e81-8675-4558-a1df-969d026daba6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:34.902819 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20592e81-8675-4558-a1df-969d026daba6 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:34.916519 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 401/774] 10.222.0.42 () {56 vars in 1124 bytes} [Mon Jul 4 09:05:34 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:34.918785 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d16a3de-3c6b-490c-bf5a-0b5060173e67 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:34.922203 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20592e81-8675-4558-a1df-969d026daba6 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:34.955673 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e9533e-978c-4ccf-831d-ecd79bfad23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:34.956688 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e9533e-978c-4ccf-831d-ecd79bfad23d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:34.957164 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e9533e-978c-4ccf-831d-ecd79bfad23d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:34.957561 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e9533e-978c-4ccf-831d-ecd79bfad23d None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:34.958483 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e9533e-978c-4ccf-831d-ecd79bfad23d None admin] RBAC: Adding query filter params (type=network) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:34.958917 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e9533e-978c-4ccf-831d-ecd79bfad23d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:34.960473 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e9533e-978c-4ccf-831d-ecd79bfad23d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:34.966403 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 374/775] 10.222.0.42 () {56 vars in 1112 bytes} [Mon Jul 4 09:05:34 2022] GET /identity/v3/services?type=network => generated 350 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:34.974510 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e9533e-978c-4ccf-831d-ecd79bfad23d None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:35.035947 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:35.072647 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:35.133779 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e9533e-978c-4ccf-831d-ecd79bfad23d None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:35.143738 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20592e81-8675-4558-a1df-969d026daba6 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:35.169589 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a397f-ead0-4c8b-8261-25bf48b3065a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:35.170535 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a397f-ead0-4c8b-8261-25bf48b3065a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:35.170983 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a397f-ead0-4c8b-8261-25bf48b3065a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:35.171394 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a397f-ead0-4c8b-8261-25bf48b3065a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:35.172352 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27a397f-ead0-4c8b-8261-25bf48b3065a None admin] RBAC: Adding query filter params (interface=public, service_id=6561b81187064c8ca3ecbbecfc21e471, region_id=RegionOne) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:35.172914 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27a397f-ead0-4c8b-8261-25bf48b3065a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:35.174464 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27a397f-ead0-4c8b-8261-25bf48b3065a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:35.182791 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 375/776] 10.222.0.42 () {56 vars in 1251 bytes} [Mon Jul 4 09:05:34 2022] GET /identity/v3/endpoints?service_id=6561b81187064c8ca3ecbbecfc21e471&interface=public®ion_id=RegionOne => generated 194 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:05:35.189278 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a397f-ead0-4c8b-8261-25bf48b3065a None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:35.213917 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf17fd1-8e46-465f-9305-c34b8b389278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:35.215182 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf17fd1-8e46-465f-9305-c34b8b389278 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:35.216865 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf17fd1-8e46-465f-9305-c34b8b389278 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:35.218774 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf17fd1-8e46-465f-9305-c34b8b389278 None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:35.219643 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf17fd1-8e46-465f-9305-c34b8b389278 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:35.220119 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf17fd1-8e46-465f-9305-c34b8b389278 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:35.222639 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf17fd1-8e46-465f-9305-c34b8b389278 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:35.235433 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 402/777] 10.222.0.42 () {56 vars in 1124 bytes} [Mon Jul 4 09:05:34 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:05:35.241243 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf17fd1-8e46-465f-9305-c34b8b389278 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:35.360293 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a397f-ead0-4c8b-8261-25bf48b3065a None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:35.391038 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:35.397843 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48560a89-5395-432d-bca2-bcfa368d4db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:35.398759 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48560a89-5395-432d-bca2-bcfa368d4db6 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:35.399410 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48560a89-5395-432d-bca2-bcfa368d4db6 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:35.399857 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48560a89-5395-432d-bca2-bcfa368d4db6 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:35.400868 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48560a89-5395-432d-bca2-bcfa368d4db6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:35.402585 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48560a89-5395-432d-bca2-bcfa368d4db6 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:35.409460 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 376/778] 10.222.0.42 () {56 vars in 1087 bytes} [Mon Jul 4 09:05:35 2022] GET /identity/v3/services => generated 772 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:05:35.454323 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf17fd1-8e46-465f-9305-c34b8b389278 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:35.478249 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:35.507534 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a2b32c-f038-4d39-ba07-3e6c555a5788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:35.508262 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a2b32c-f038-4d39-ba07-3e6c555a5788 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:35.508550 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a2b32c-f038-4d39-ba07-3e6c555a5788 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:35.508827 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a2b32c-f038-4d39-ba07-3e6c555a5788 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:35.509661 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a2b32c-f038-4d39-ba07-3e6c555a5788 None admin] RBAC: Adding query filter params (interface=public, service_id=b3c17eb2e1434c66842f1ce61fbef21a, region_id=RegionOne) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:35.509981 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a2b32c-f038-4d39-ba07-3e6c555a5788 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:35.511433 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a2b32c-f038-4d39-ba07-3e6c555a5788 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:35.525017 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 403/779] 10.222.0.42 () {56 vars in 1251 bytes} [Mon Jul 4 09:05:35 2022] GET /identity/v3/endpoints?service_id=b3c17eb2e1434c66842f1ce61fbef21a&interface=public®ion_id=RegionOne => generated 194 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:35.530274 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48560a89-5395-432d-bca2-bcfa368d4db6 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:35.657884 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48560a89-5395-432d-bca2-bcfa368d4db6 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:35.693448 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb5eb28-0738-4922-94e5-050e4dcb419a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:35.694489 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb5eb28-0738-4922-94e5-050e4dcb419a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:35.694970 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb5eb28-0738-4922-94e5-050e4dcb419a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:35.695464 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb5eb28-0738-4922-94e5-050e4dcb419a None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:35.696370 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb5eb28-0738-4922-94e5-050e4dcb419a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:35.697955 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb5eb28-0738-4922-94e5-050e4dcb419a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:35.703830 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 377/780] 10.222.0.42 () {56 vars in 1087 bytes} [Mon Jul 4 09:05:35 2022] GET /identity/v3/services => generated 772 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:36.051359 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f866e5-415e-4fd6-8445-9f260146e6fe None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:36.051942 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f866e5-415e-4fd6-8445-9f260146e6fe None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:36.051942 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f866e5-415e-4fd6-8445-9f260146e6fe None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:36.053585 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 404/781] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:05:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:05:36.059237 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab41de8-f1e2-402a-9f2e-0f20bba45f2c None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:36.059531 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab41de8-f1e2-402a-9f2e-0f20bba45f2c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:36.059812 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab41de8-f1e2-402a-9f2e-0f20bba45f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:36.077519 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-8ab41de8-f1e2-402a-9f2e-0f20bba45f2c None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:05:36.078725 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-8ab41de8-f1e2-402a-9f2e-0f20bba45f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:05:36.146643 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:36.161898 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 378/782] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:05:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 09:05:36.184728 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f866e5-415e-4fd6-8445-9f260146e6fe None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:36.291944 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f866e5-415e-4fd6-8445-9f260146e6fe None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:36.303467 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce80284-555b-44dd-b1a2-e7f95b30733d None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:36.303744 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce80284-555b-44dd-b1a2-e7f95b30733d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:36.304051 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce80284-555b-44dd-b1a2-e7f95b30733d None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:36.305444 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 379/783] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:05:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:05:36.310753 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92723f64-f708-4e48-b506-a6d7ce8e4acd None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:36.311045 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92723f64-f708-4e48-b506-a6d7ce8e4acd None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:36.311326 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92723f64-f708-4e48-b506-a6d7ce8e4acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:36.330725 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654d8233-2352-498a-9467-e6b73bb00374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:36.331532 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d8233-2352-498a-9467-e6b73bb00374 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:36.331819 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d8233-2352-498a-9467-e6b73bb00374 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:36.332400 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d8233-2352-498a-9467-e6b73bb00374 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:36.343197 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654d8233-2352-498a-9467-e6b73bb00374 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:05:36.347692 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-92723f64-f708-4e48-b506-a6d7ce8e4acd None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:05:36.348941 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-92723f64-f708-4e48-b506-a6d7ce8e4acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:05:36.350998 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-654d8233-2352-498a-9467-e6b73bb00374 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:05:36.350998 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:36.350998 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:36.350998 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:36.350998 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:36.350998 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:36.350998 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:36.350998 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:36.350998 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:36.350998 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:36.350998 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:36.350998 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:36.350998 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:05:36.350998 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:05:36.350998 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:05:36.350998 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:05:36.351936 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:05:36.351936 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:05:36.351936 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:05:36.351936 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:05:36.351936 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:36.351936 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:36.351936 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:36.351936 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:36.351936 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:36.351936 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:36.351936 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:36.351936 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:36.351936 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:36.351936 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:36.351936 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:36.351936 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:36.352819 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:36.352819 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:36.352819 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:36.352819 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:36.352819 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:05:36.352819 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:05:36.352819 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:05:36.352819 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:05:36.352819 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:05:36.352819 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:05:36.352819 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:05:36.352819 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:36.352819 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 405/784] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Jul 4 09:05:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:36.361615 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654d8233-2352-498a-9467-e6b73bb00374 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:36.440302 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 380/785] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:05:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:05:36.452256 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:36.472672 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92723f64-f708-4e48-b506-a6d7ce8e4acd None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:36.558040 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654d8233-2352-498a-9467-e6b73bb00374 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:36.579115 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92723f64-f708-4e48-b506-a6d7ce8e4acd None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:36.599131 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:36.619509 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec945f46-9b51-44c8-9d6f-256edd25497e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:36.620332 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec945f46-9b51-44c8-9d6f-256edd25497e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:36.620705 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec945f46-9b51-44c8-9d6f-256edd25497e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:36.620983 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec945f46-9b51-44c8-9d6f-256edd25497e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:36.621088 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376d9e4b-28fb-4b59-8e5b-bc19f66d61ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:36.621934 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d9e4b-28fb-4b59-8e5b-bc19f66d61ed None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:36.622215 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d9e4b-28fb-4b59-8e5b-bc19f66d61ed None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:36.622520 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d9e4b-28fb-4b59-8e5b-bc19f66d61ed None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:36.623278 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376d9e4b-28fb-4b59-8e5b-bc19f66d61ed None admin] RBAC: Adding query filter params (name=admin) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:36.623582 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376d9e4b-28fb-4b59-8e5b-bc19f66d61ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:36.624984 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376d9e4b-28fb-4b59-8e5b-bc19f66d61ed None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:36.632334 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec945f46-9b51-44c8-9d6f-256edd25497e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:05:36.633991 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 406/786] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jul 4 09:05:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:36.635410 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a52af-7c9d-4c69-9d45-c8f9b295075a None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:36.635696 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a52af-7c9d-4c69-9d45-c8f9b295075a None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:36.635990 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a52af-7c9d-4c69-9d45-c8f9b295075a None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:36.637779 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 407/787] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:05:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:05:36.640199 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-ec945f46-9b51-44c8-9d6f-256edd25497e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:05:36.640199 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:36.640199 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:36.640199 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:36.640199 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:36.640199 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:36.640199 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:36.640199 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:36.640199 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:36.640199 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:36.640199 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:36.640199 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:36.640199 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:05:36.640199 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:05:36.640199 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:05:36.640199 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:05:36.641141 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:05:36.641141 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:05:36.641141 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:05:36.641141 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:05:36.641141 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:36.641141 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:36.641141 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:36.641141 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:36.641141 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:36.641141 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:36.641141 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:36.641141 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:36.641141 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:36.641141 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:36.641141 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:36.641141 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:36.641982 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:36.641982 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:36.641982 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:36.641982 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:36.641982 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:05:36.641982 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:05:36.641982 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:05:36.641982 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:05:36.641982 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:05:36.641982 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:05:36.641982 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:05:36.641982 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:36.642617 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a52af-7c9d-4c69-9d45-c8f9b295075a None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:36.642688 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 381/788] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Jul 4 09:05:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:05:36.642879 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df0c668-c9cd-41ec-867f-7a8e4f535987 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:36.643366 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df0c668-c9cd-41ec-867f-7a8e4f535987 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:36.647821 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df0c668-c9cd-41ec-867f-7a8e4f535987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:36.664674 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-7df0c668-c9cd-41ec-867f-7a8e4f535987 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:05:36.665867 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-7df0c668-c9cd-41ec-867f-7a8e4f535987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:05:36.733665 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 382/789] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:05:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:05:36.734502 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df0c668-c9cd-41ec-867f-7a8e4f535987 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:36.758436 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a52af-7c9d-4c69-9d45-c8f9b295075a None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:36.762309 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:36.796565 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78518b36-6277-4177-a4e7-7e926f4ce348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:36.797757 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78518b36-6277-4177-a4e7-7e926f4ce348 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:36.798245 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78518b36-6277-4177-a4e7-7e926f4ce348 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:36.798717 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78518b36-6277-4177-a4e7-7e926f4ce348 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:36.810508 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78518b36-6277-4177-a4e7-7e926f4ce348 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:36.812408 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78518b36-6277-4177-a4e7-7e926f4ce348 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:36.831431 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-78518b36-6277-4177-a4e7-7e926f4ce348 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:36.831431 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:36.831431 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:36.831431 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:36.831431 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:36.831431 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:36.831431 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:36.831431 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:36.831431 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:36.831431 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:36.831431 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:36.831431 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:36.831431 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:05:36.831431 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:05:36.831431 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:05:36.832386 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:05:36.832386 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:36.832386 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:36.832386 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:36.832386 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:36.832386 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:36.832386 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:36.832386 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:36.832386 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:36.832386 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:36.832386 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:36.832386 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:36.832386 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:36.832386 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:36.832386 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:36.832386 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:36.832386 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:36.833305 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:05:36.833305 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:05:36.833305 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:36.833305 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:36.833530 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df0c668-c9cd-41ec-867f-7a8e4f535987 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:36.835672 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 408/790] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:05:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:36.841266 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78518b36-6277-4177-a4e7-7e926f4ce348 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:36.842374 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:36.868362 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d274ddb-d3fb-4bcd-8210-8600208b49e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:36.868969 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d274ddb-d3fb-4bcd-8210-8600208b49e6 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:36.869247 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d274ddb-d3fb-4bcd-8210-8600208b49e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:36.869514 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d274ddb-d3fb-4bcd-8210-8600208b49e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:36.870269 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d274ddb-d3fb-4bcd-8210-8600208b49e6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:36.870580 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d274ddb-d3fb-4bcd-8210-8600208b49e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:36.871979 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d274ddb-d3fb-4bcd-8210-8600208b49e6 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:36.886271 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 383/791] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jul 4 09:05:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:36.890886 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d274ddb-d3fb-4bcd-8210-8600208b49e6 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:36.953825 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78518b36-6277-4177-a4e7-7e926f4ce348 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:36.993035 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020812a9-4bf1-4108-9ead-6f7103e6d515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:36.993796 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d274ddb-d3fb-4bcd-8210-8600208b49e6 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:36.994470 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020812a9-4bf1-4108-9ead-6f7103e6d515 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:36.995003 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020812a9-4bf1-4108-9ead-6f7103e6d515 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:36.995527 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020812a9-4bf1-4108-9ead-6f7103e6d515 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:37.007365 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020812a9-4bf1-4108-9ead-6f7103e6d515 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:05:37.015935 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-020812a9-4bf1-4108-9ead-6f7103e6d515 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:05:37.015935 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:37.015935 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:37.015935 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:37.015935 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:37.015935 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:37.015935 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:37.015935 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:37.015935 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:37.015935 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:37.015935 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:37.015935 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:37.015935 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:05:37.015935 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:05:37.015935 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:05:37.015935 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:05:37.017034 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:05:37.017034 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:05:37.017034 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:05:37.017034 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:05:37.017034 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:37.017034 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:37.017034 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:37.017034 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:37.017034 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:37.017034 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:37.017034 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:37.017034 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:37.017034 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:37.017034 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:37.017034 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:37.017034 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:37.017896 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:37.017896 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:37.017896 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:37.017896 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:37.017896 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:05:37.017896 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:05:37.017896 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:05:37.017896 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:05:37.017896 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:05:37.017896 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:05:37.017896 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:05:37.017896 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:37.020877 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 409/792] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Jul 4 09:05:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:37.022003 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020812a9-4bf1-4108-9ead-6f7103e6d515 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:37.027907 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce2a8b7-6765-41b1-8b57-f3762b456680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:37.028570 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce2a8b7-6765-41b1-8b57-f3762b456680 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:37.028910 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce2a8b7-6765-41b1-8b57-f3762b456680 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:37.029183 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce2a8b7-6765-41b1-8b57-f3762b456680 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:37.029904 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce2a8b7-6765-41b1-8b57-f3762b456680 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:37.030204 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce2a8b7-6765-41b1-8b57-f3762b456680 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:37.031581 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce2a8b7-6765-41b1-8b57-f3762b456680 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:37.041463 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:37.047943 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 384/793] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jul 4 09:05:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:37.047943 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce2a8b7-6765-41b1-8b57-f3762b456680 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:37.081673 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:37.142010 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020812a9-4bf1-4108-9ead-6f7103e6d515 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:37.169063 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce2a8b7-6765-41b1-8b57-f3762b456680 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:37.182135 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704be209-607a-4950-b45b-4878f60d8b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:37.182929 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704be209-607a-4950-b45b-4878f60d8b59 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:37.183210 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704be209-607a-4950-b45b-4878f60d8b59 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:37.183706 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704be209-607a-4950-b45b-4878f60d8b59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:37.198311 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704be209-607a-4950-b45b-4878f60d8b59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:37.200028 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704be209-607a-4950-b45b-4878f60d8b59 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:37.206432 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e013df-83e1-43d1-a331-6cc80e796462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:37.207353 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e013df-83e1-43d1-a331-6cc80e796462 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:37.207911 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e013df-83e1-43d1-a331-6cc80e796462 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:37.208446 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e013df-83e1-43d1-a331-6cc80e796462 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:37.209434 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e013df-83e1-43d1-a331-6cc80e796462 None admin] RBAC: Adding query filter params (name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:37.209983 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e013df-83e1-43d1-a331-6cc80e796462 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:37.211643 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e013df-83e1-43d1-a331-6cc80e796462 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:37.219565 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-704be209-607a-4950-b45b-4878f60d8b59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:37.219565 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:37.219565 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:37.219565 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:37.219565 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:37.219565 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:37.219565 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:37.219565 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:37.219565 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:37.219565 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:37.219565 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:37.219565 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:37.219565 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:05:37.219565 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:05:37.219565 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:05:37.220518 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:05:37.220518 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:37.220518 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:37.220518 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:37.220518 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:37.220518 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:37.220518 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:37.220518 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:37.220518 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:37.220518 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:37.220518 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:37.220518 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:37.220518 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:37.220518 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:37.220518 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:37.220518 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:37.220518 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:37.221403 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:05:37.221403 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:05:37.221403 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:37.221403 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:37.221403 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 410/794] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:05:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:37.223010 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704be209-607a-4950-b45b-4878f60d8b59 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:37.224325 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 385/795] 10.222.0.42 () {56 vars in 1103 bytes} [Mon Jul 4 09:05:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:37.226150 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e013df-83e1-43d1-a331-6cc80e796462 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:37.310472 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:37.325123 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:37.336460 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e013df-83e1-43d1-a331-6cc80e796462 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:37.358741 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704be209-607a-4950-b45b-4878f60d8b59 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:37.374736 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0576e2a2-2bb4-48bd-9d50-30873e70ac2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:37.375852 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576e2a2-2bb4-48bd-9d50-30873e70ac2b None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:37.376432 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576e2a2-2bb4-48bd-9d50-30873e70ac2b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:37.376911 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576e2a2-2bb4-48bd-9d50-30873e70ac2b None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:37.377840 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0576e2a2-2bb4-48bd-9d50-30873e70ac2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:37.378400 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0576e2a2-2bb4-48bd-9d50-30873e70ac2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:37.380041 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0576e2a2-2bb4-48bd-9d50-30873e70ac2b None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:37.394288 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 386/796] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jul 4 09:05:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:05:37.395534 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0576e2a2-2bb4-48bd-9d50-30873e70ac2b None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:37.405303 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4f0321-fe12-4433-b575-512e1f62dc17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:37.406481 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f0321-fe12-4433-b575-512e1f62dc17 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:37.407039 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f0321-fe12-4433-b575-512e1f62dc17 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:37.407534 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f0321-fe12-4433-b575-512e1f62dc17 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:37.415996 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4f0321-fe12-4433-b575-512e1f62dc17 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:37.417741 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4f0321-fe12-4433-b575-512e1f62dc17 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:37.432950 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-8d4f0321-fe12-4433-b575-512e1f62dc17 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 04 09:05:37.432950 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:37.432950 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:37.432950 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:37.432950 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:37.432950 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:37.432950 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:37.432950 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:37.432950 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:37.432950 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:37.432950 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:37.432950 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:37.432950 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:05:37.432950 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:05:37.432950 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:05:37.432950 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:05:37.433948 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:37.433948 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:37.433948 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:05:37.433948 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:05:37.433948 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:05:37.433948 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:05:37.433948 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:37.433948 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:37.433948 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:37.433948 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:37.433948 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:37.433948 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:37.433948 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:37.433948 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:37.433948 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:37.433948 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:37.433948 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:37.433948 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:37.434951 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:37.434951 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:37.434951 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:05:37.434951 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:05:37.434951 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:05:37.434951 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:05:37.434951 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:05:37.434951 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:05:37.434951 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 04 09:05:37.434951 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:37.442319 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 411/797] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Jul 4 09:05:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:37.443496 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4f0321-fe12-4433-b575-512e1f62dc17 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:37.521527 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0576e2a2-2bb4-48bd-9d50-30873e70ac2b None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:37.547597 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4f0321-fe12-4433-b575-512e1f62dc17 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:37.569807 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba6c25-4b9d-420c-8fce-f998c03dc55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:37.570524 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba6c25-4b9d-420c-8fce-f998c03dc55b None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:37.570802 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba6c25-4b9d-420c-8fce-f998c03dc55b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:37.571074 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba6c25-4b9d-420c-8fce-f998c03dc55b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:37.576253 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:37.583971 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daba6c25-4b9d-420c-8fce-f998c03dc55b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:37.586026 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daba6c25-4b9d-420c-8fce-f998c03dc55b None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:37.587954 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa3ab08-a3e1-486e-9e8d-05b0251d748d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:37.589663 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3ab08-a3e1-486e-9e8d-05b0251d748d None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:37.590145 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3ab08-a3e1-486e-9e8d-05b0251d748d None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:37.590591 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3ab08-a3e1-486e-9e8d-05b0251d748d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:37.600282 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa3ab08-a3e1-486e-9e8d-05b0251d748d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:37.602073 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa3ab08-a3e1-486e-9e8d-05b0251d748d None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:37.606429 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-daba6c25-4b9d-420c-8fce-f998c03dc55b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:37.606429 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:37.606429 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:37.606429 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:37.606429 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:37.606429 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:37.606429 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:37.606429 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:37.606429 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:37.606429 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:37.606429 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:37.606429 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:37.606429 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:05:37.606429 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:05:37.606429 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:05:37.607430 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:05:37.607430 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:37.607430 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:37.607430 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:37.607430 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:37.607430 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:37.607430 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:37.607430 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:37.607430 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:37.607430 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:37.607430 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:37.607430 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:37.607430 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:37.607430 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:37.607430 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:37.607430 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:37.607430 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:37.608601 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:05:37.608601 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:05:37.608601 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:37.608601 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:37.608601 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 387/798] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:05:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:37.609283 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba6c25-4b9d-420c-8fce-f998c03dc55b None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:37.614385 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:37.624135 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-7aa3ab08-a3e1-486e-9e8d-05b0251d748d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 04 09:05:37.624135 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:37.624135 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:37.624135 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:37.624135 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:37.624135 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:37.624135 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:37.624135 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:37.624135 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:37.624135 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:37.624135 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:37.624135 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:37.624135 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:05:37.624135 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:05:37.624135 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:05:37.624135 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:05:37.625272 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:37.625272 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:37.625272 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:05:37.625272 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:05:37.625272 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:05:37.625272 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:05:37.625272 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:37.625272 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:37.625272 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:37.625272 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:37.625272 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:37.625272 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:37.625272 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:37.625272 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:37.625272 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:37.625272 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:37.625272 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:37.625272 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:37.626496 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:37.626496 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:37.626496 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:05:37.626496 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:05:37.626496 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:05:37.626496 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:05:37.626496 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:05:37.626496 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:05:37.626496 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 04 09:05:37.626496 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:37.629434 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 412/799] 10.222.0.42 () {56 vars in 1093 bytes} [Mon Jul 4 09:05:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:37.630700 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa3ab08-a3e1-486e-9e8d-05b0251d748d None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:37.728309 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba6c25-4b9d-420c-8fce-f998c03dc55b None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:37.765516 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ebda23-6716-4096-89ce-c226d20148ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:37.766561 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ebda23-6716-4096-89ce-c226d20148ab None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:37.766950 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ebda23-6716-4096-89ce-c226d20148ab None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:37.767348 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ebda23-6716-4096-89ce-c226d20148ab None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:37.767931 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa3ab08-a3e1-486e-9e8d-05b0251d748d None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:37.768434 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ebda23-6716-4096-89ce-c226d20148ab None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:37.768850 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ebda23-6716-4096-89ce-c226d20148ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:37.770617 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ebda23-6716-4096-89ce-c226d20148ab None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:37.794472 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 388/800] 10.222.0.42 () {56 vars in 1135 bytes} [Mon Jul 4 09:05:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:37.795816 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ebda23-6716-4096-89ce-c226d20148ab None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:37.815957 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289dcf2b-06e0-42fe-83a1-7e6607bada2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:37.816953 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289dcf2b-06e0-42fe-83a1-7e6607bada2b None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:37.817243 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289dcf2b-06e0-42fe-83a1-7e6607bada2b None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:37.817521 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289dcf2b-06e0-42fe-83a1-7e6607bada2b None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:37.818264 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289dcf2b-06e0-42fe-83a1-7e6607bada2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:37.818575 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289dcf2b-06e0-42fe-83a1-7e6607bada2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:37.820067 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289dcf2b-06e0-42fe-83a1-7e6607bada2b None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:37.833174 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 413/801] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jul 4 09:05:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:37.834128 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289dcf2b-06e0-42fe-83a1-7e6607bada2b None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:37.867409 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:37.893431 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:37.917366 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ebda23-6716-4096-89ce-c226d20148ab None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:37.953664 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289dcf2b-06e0-42fe-83a1-7e6607bada2b None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:37.955887 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6853e7d-b86f-46ec-a098-64b5d819fcc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:37.956649 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6853e7d-b86f-46ec-a098-64b5d819fcc4 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:37.956935 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6853e7d-b86f-46ec-a098-64b5d819fcc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:37.957209 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6853e7d-b86f-46ec-a098-64b5d819fcc4 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:37.958053 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6853e7d-b86f-46ec-a098-64b5d819fcc4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:37.958363 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6853e7d-b86f-46ec-a098-64b5d819fcc4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:37.959815 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6853e7d-b86f-46ec-a098-64b5d819fcc4 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:37.982264 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 389/802] 10.222.0.42 () {56 vars in 1133 bytes} [Mon Jul 4 09:05:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:37.983191 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6853e7d-b86f-46ec-a098-64b5d819fcc4 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:37.989527 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e651d951-0c87-4a19-b306-7534cb6eab11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:37.990326 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e651d951-0c87-4a19-b306-7534cb6eab11 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:37.990595 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e651d951-0c87-4a19-b306-7534cb6eab11 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:37.990867 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e651d951-0c87-4a19-b306-7534cb6eab11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:38.001364 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e651d951-0c87-4a19-b306-7534cb6eab11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:38.002824 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e651d951-0c87-4a19-b306-7534cb6eab11 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:38.020681 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-e651d951-0c87-4a19-b306-7534cb6eab11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:38.020681 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:38.020681 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:38.020681 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:38.020681 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:38.020681 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:38.020681 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:38.020681 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:38.020681 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:38.020681 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:38.020681 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:38.020681 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:38.020681 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:05:38.020681 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:05:38.020681 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:05:38.021605 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:05:38.021605 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:38.021605 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:38.021605 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:38.021605 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:38.021605 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:38.021605 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:38.021605 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:38.021605 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:38.021605 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:38.021605 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:38.021605 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:38.021605 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:38.021605 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:38.021605 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:38.021605 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:38.021605 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:38.022497 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:05:38.022497 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:05:38.022497 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:38.022497 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:38.022497 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 414/803] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:05:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:38.023535 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4298993b-018d-46a7-bd23-652a77e02b88 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:38.023535 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4298993b-018d-46a7-bd23-652a77e02b88 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:38.023701 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4298993b-018d-46a7-bd23-652a77e02b88 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:38.025085 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 415/804] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:05:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:05:38.025606 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4298993b-018d-46a7-bd23-652a77e02b88 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:38.092688 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6853e7d-b86f-46ec-a098-64b5d819fcc4 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:38.113113 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:38.127479 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc9d7bc-6ec4-43c7-8039-4afbf77750eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:38.128403 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc9d7bc-6ec4-43c7-8039-4afbf77750eb None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:38.128689 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc9d7bc-6ec4-43c7-8039-4afbf77750eb None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:38.128966 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc9d7bc-6ec4-43c7-8039-4afbf77750eb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:38.131462 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:38.136884 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4298993b-018d-46a7-bd23-652a77e02b88 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:38.140323 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc9d7bc-6ec4-43c7-8039-4afbf77750eb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:38.142855 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc9d7bc-6ec4-43c7-8039-4afbf77750eb None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:38.158152 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-ecc9d7bc-6ec4-43c7-8039-4afbf77750eb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 04 09:05:38.158152 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:38.158152 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:38.158152 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:38.158152 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:38.158152 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:38.158152 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:38.158152 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:38.158152 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:38.158152 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:38.158152 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:38.158152 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:38.158152 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:05:38.158152 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:05:38.158152 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:05:38.158152 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:05:38.159316 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:38.159316 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:38.159316 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:05:38.159316 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:05:38.159316 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:05:38.159316 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:05:38.159316 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:38.159316 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:38.159316 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:38.159316 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:38.159316 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:38.159316 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:38.159316 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:38.159316 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:38.159316 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:38.159316 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:38.159316 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:38.159316 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:38.160489 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:38.160489 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:38.160489 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:05:38.160489 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:05:38.160489 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:05:38.160489 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:05:38.160489 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:05:38.160489 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:05:38.160489 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 04 09:05:38.160489 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:38.160489 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 390/805] 10.222.0.42 () {56 vars in 1117 bytes} [Mon Jul 4 09:05:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:38.161188 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc9d7bc-6ec4-43c7-8039-4afbf77750eb None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:38.174365 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d72a65-f27d-4a7b-96ec-66fc6160ddcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:38.175014 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d72a65-f27d-4a7b-96ec-66fc6160ddcc None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:38.175321 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d72a65-f27d-4a7b-96ec-66fc6160ddcc None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:38.175549 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d72a65-f27d-4a7b-96ec-66fc6160ddcc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:38.241257 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d72a65-f27d-4a7b-96ec-66fc6160ddcc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:38.242718 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d72a65-f27d-4a7b-96ec-66fc6160ddcc None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:38.259829 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc9d7bc-6ec4-43c7-8039-4afbf77750eb None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:38.294138 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530aa32b-ec28-4d23-9273-b2cdc03256d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:38.294825 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530aa32b-ec28-4d23-9273-b2cdc03256d7 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:38.295123 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530aa32b-ec28-4d23-9273-b2cdc03256d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:38.295391 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530aa32b-ec28-4d23-9273-b2cdc03256d7 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:38.296134 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530aa32b-ec28-4d23-9273-b2cdc03256d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:38.296431 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530aa32b-ec28-4d23-9273-b2cdc03256d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:38.297810 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530aa32b-ec28-4d23-9273-b2cdc03256d7 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:38.309007 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 391/806] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jul 4 09:05:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:38.310003 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce06c08-1804-4085-aa47-04c3481efb58 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:38.310286 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce06c08-1804-4085-aa47-04c3481efb58 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:38.310560 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce06c08-1804-4085-aa47-04c3481efb58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:38.326514 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-0ce06c08-1804-4085-aa47-04c3481efb58 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:05:38.327708 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0ce06c08-1804-4085-aa47-04c3481efb58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:05:38.344170 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:38.349433 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 416/807] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jul 4 09:05:38 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 04 09:05:38.351105 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85519844-af27-44aa-a771-bb1349ee1865 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:38.351405 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85519844-af27-44aa-a771-bb1349ee1865 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:38.351693 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85519844-af27-44aa-a771-bb1349ee1865 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:38.354280 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 417/808] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:05:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:05:38.354280 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85519844-af27-44aa-a771-bb1349ee1865 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:38.368665 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:38.405853 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 392/809] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:05:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:05:38.406952 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce06c08-1804-4085-aa47-04c3481efb58 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:38.469260 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85519844-af27-44aa-a771-bb1349ee1865 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:38.502708 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85e6aef-3c4a-49a0-97f8-8ef0fab8167b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:38.503376 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85e6aef-3c4a-49a0-97f8-8ef0fab8167b None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:38.503655 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85e6aef-3c4a-49a0-97f8-8ef0fab8167b None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:38.503931 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85e6aef-3c4a-49a0-97f8-8ef0fab8167b None admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:38.504787 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85e6aef-3c4a-49a0-97f8-8ef0fab8167b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:38.505095 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85e6aef-3c4a-49a0-97f8-8ef0fab8167b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:38.506555 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85e6aef-3c4a-49a0-97f8-8ef0fab8167b None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:38.513080 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce06c08-1804-4085-aa47-04c3481efb58 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:38.524572 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 418/810] 10.222.0.42 () {56 vars in 1149 bytes} [Mon Jul 4 09:05:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:38.525378 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85e6aef-3c4a-49a0-97f8-8ef0fab8167b None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:38.547125 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d71c410-283e-46b4-95fc-a43a221200bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:38.547934 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d71c410-283e-46b4-95fc-a43a221200bc None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:38.548224 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d71c410-283e-46b4-95fc-a43a221200bc None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:38.548488 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d71c410-283e-46b4-95fc-a43a221200bc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:38.555186 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d71c410-283e-46b4-95fc-a43a221200bc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:38.556689 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d71c410-283e-46b4-95fc-a43a221200bc None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:38.573204 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-8d71c410-283e-46b4-95fc-a43a221200bc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:05:38.573204 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:38.573204 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:38.573204 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:38.573204 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:38.573204 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:38.573204 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:38.573204 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:38.573204 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:38.573204 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:38.573204 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:38.573204 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:38.573204 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:05:38.573204 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:05:38.573204 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:05:38.574353 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:05:38.574353 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:38.574353 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:38.574353 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:38.574353 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:38.574353 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:38.574353 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:38.574353 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:38.574353 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:38.574353 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:38.574353 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:38.574353 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:38.574353 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:38.574353 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:38.574353 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:38.574353 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:38.574353 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:38.575238 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:05:38.575238 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:05:38.575238 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:05:38.575238 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:05:38.575238 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:05:38.575238 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:05:38.575238 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:05:38.575238 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:38.575238 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 393/811] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jul 4 09:05:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:38.575956 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28260549-b936-4284-a7de-74e83b627cc9 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:38.576798 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28260549-b936-4284-a7de-74e83b627cc9 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:38.576798 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28260549-b936-4284-a7de-74e83b627cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:38.586536 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:38.593316 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-28260549-b936-4284-a7de-74e83b627cc9 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:05:38.594565 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-28260549-b936-4284-a7de-74e83b627cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:05:38.617613 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:38.631944 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85e6aef-3c4a-49a0-97f8-8ef0fab8167b None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:38.659809 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 394/812] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:05:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:05:38.660662 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28260549-b936-4284-a7de-74e83b627cc9 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:38.685034 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91efac02-9aa7-441b-a605-575727cdca39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:38.685834 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91efac02-9aa7-441b-a605-575727cdca39 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:38.686116 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91efac02-9aa7-441b-a605-575727cdca39 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:38.686397 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91efac02-9aa7-441b-a605-575727cdca39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:38.696783 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91efac02-9aa7-441b-a605-575727cdca39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:38.698238 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91efac02-9aa7-441b-a605-575727cdca39 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:38.715124 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-91efac02-9aa7-441b-a605-575727cdca39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:38.715124 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:38.715124 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:38.715124 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:38.715124 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:38.715124 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:38.715124 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:38.715124 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:38.715124 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:38.715124 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:38.715124 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:38.715124 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:38.715124 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:05:38.715124 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:05:38.715124 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:05:38.716279 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:05:38.716279 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:38.716279 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:38.716279 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:38.716279 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:38.716279 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:38.716279 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:38.716279 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:38.716279 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:38.716279 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:38.716279 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:38.716279 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:38.716279 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:38.716279 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:38.716279 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:38.716279 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:38.716279 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:38.721812 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:05:38.721812 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:05:38.721812 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:38.721812 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:38.721812 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 419/813] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:05:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:38.721812 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91efac02-9aa7-441b-a605-575727cdca39 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:38.761020 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28260549-b936-4284-a7de-74e83b627cc9 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:38.798470 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d082a8-0b05-44f1-aa15-6c8fd4c9c331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:38.799271 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d082a8-0b05-44f1-aa15-6c8fd4c9c331 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:38.799555 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d082a8-0b05-44f1-aa15-6c8fd4c9c331 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:38.799829 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d082a8-0b05-44f1-aa15-6c8fd4c9c331 None admin] PATH_INFO: `/v3/services/network` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:38.800521 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d082a8-0b05-44f1-aa15-6c8fd4c9c331 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:38.801918 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d082a8-0b05-44f1-aa15-6c8fd4c9c331 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:38.814086 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-38d082a8-0b05-44f1-aa15-6c8fd4c9c331 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 04 09:05:38.814086 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:38.814086 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 09:05:38.814086 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 09:05:38.814086 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 09:05:38.814086 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 09:05:38.814086 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 09:05:38.814086 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:05:38.814086 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 04 09:05:38.814086 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:38.814086 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:05:38.814086 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:38.814086 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:38.814086 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:38.814086 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:38.814086 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:38.814086 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:38.815186 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:38.815186 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:38.815186 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:38.815186 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:38.815186 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:38.815186 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:38.815186 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 09:05:38.815186 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 09:05:38.815186 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 09:05:38.815186 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 09:05:38.815186 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:38.815186 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:38.815186 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:38.815186 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:38.815186 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:38.815186 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:38.816277 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:38.816277 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:38.816277 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:38.816277 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:38.816277 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:38.816277 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:38.816277 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:38.816277 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:38.816277 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:38.816277 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:38.816277 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 09:05:38.816277 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:05:38.816277 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 04 09:05:38.816277 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:38.816277 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 395/814] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jul 4 09:05:38 2022] GET /identity/v3/services/network => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:38.817244 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d082a8-0b05-44f1-aa15-6c8fd4c9c331 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:38.821206 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91efac02-9aa7-441b-a605-575727cdca39 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:38.830733 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:38.842984 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:38.857943 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbdbba2-f1f4-4658-99f3-2f783ef316e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:38.858676 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbdbba2-f1f4-4658-99f3-2f783ef316e2 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:38.858961 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbdbba2-f1f4-4658-99f3-2f783ef316e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:38.859245 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbdbba2-f1f4-4658-99f3-2f783ef316e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:38.869610 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbdbba2-f1f4-4658-99f3-2f783ef316e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:38.871063 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbdbba2-f1f4-4658-99f3-2f783ef316e2 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:38.889236 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-acbdbba2-f1f4-4658-99f3-2f783ef316e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:38.889236 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:38.889236 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:38.889236 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:38.889236 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:38.889236 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:38.889236 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:38.889236 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:38.889236 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:38.889236 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:38.889236 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:38.889236 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:38.889236 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:05:38.889236 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:05:38.889236 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:05:38.890152 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:05:38.890152 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:38.890152 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:38.890152 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:38.890152 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:38.890152 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:38.890152 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:38.890152 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:38.890152 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:38.890152 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:38.890152 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:38.890152 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:38.890152 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:38.890152 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:38.890152 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:38.890152 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:38.890152 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:38.891670 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:05:38.891670 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:05:38.891670 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:38.891670 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:38.891670 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 420/815] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:05:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:38.891670 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbdbba2-f1f4-4658-99f3-2f783ef316e2 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:38.921683 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d082a8-0b05-44f1-aa15-6c8fd4c9c331 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:38.954614 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f85432-f395-49fe-88a3-548e574a7a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:38.955268 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f85432-f395-49fe-88a3-548e574a7a35 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:38.955547 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f85432-f395-49fe-88a3-548e574a7a35 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:38.955817 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f85432-f395-49fe-88a3-548e574a7a35 None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:38.956637 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f85432-f395-49fe-88a3-548e574a7a35 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:38.956937 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f85432-f395-49fe-88a3-548e574a7a35 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:38.958454 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f85432-f395-49fe-88a3-548e574a7a35 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:38.970236 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 396/816] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Jul 4 09:05:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:38.971022 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f85432-f395-49fe-88a3-548e574a7a35 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:38.993313 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbdbba2-f1f4-4658-99f3-2f783ef316e2 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:39.025735 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789c7fb1-49f4-4903-86d4-82b51859edf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:39.026584 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c7fb1-49f4-4903-86d4-82b51859edf8 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:39.026867 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c7fb1-49f4-4903-86d4-82b51859edf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:39.027141 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c7fb1-49f4-4903-86d4-82b51859edf8 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:39.027792 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789c7fb1-49f4-4903-86d4-82b51859edf8 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:39.029204 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789c7fb1-49f4-4903-86d4-82b51859edf8 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:39.041073 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-789c7fb1-49f4-4903-86d4-82b51859edf8 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 04 09:05:39.041073 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:39.041073 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 09:05:39.041073 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 09:05:39.041073 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 09:05:39.041073 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 09:05:39.041073 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 09:05:39.041073 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:05:39.041073 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 04 09:05:39.041073 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:39.041073 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:05:39.041073 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:39.041073 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:39.041073 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:39.041073 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:39.041073 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:39.042168 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:39.042168 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:39.042168 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:39.042168 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:39.042168 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:39.042168 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:39.042168 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:39.042168 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 09:05:39.042168 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 09:05:39.042168 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 09:05:39.042168 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 09:05:39.042168 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:39.042168 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:39.042168 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:39.042168 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:39.042168 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:39.043187 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:39.043187 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:39.043187 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:39.043187 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:39.043187 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:39.043187 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:39.043187 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:39.043187 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:39.043187 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:39.043187 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:39.043187 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:39.043187 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 09:05:39.043187 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:05:39.043187 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 04 09:05:39.043187 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:39.043187 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 421/817] 10.222.0.42 () {56 vars in 1129 bytes} [Mon Jul 4 09:05:38 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:39.044275 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789c7fb1-49f4-4903-86d4-82b51859edf8 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:39.054595 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:39.068251 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:39.071016 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f85432-f395-49fe-88a3-548e574a7a35 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:39.105310 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d662f619-62a0-4060-993a-9efa7c9b4c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:39.105973 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d662f619-62a0-4060-993a-9efa7c9b4c23 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:39.106255 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d662f619-62a0-4060-993a-9efa7c9b4c23 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:39.106519 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d662f619-62a0-4060-993a-9efa7c9b4c23 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:39.107296 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d662f619-62a0-4060-993a-9efa7c9b4c23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:39.107602 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d662f619-62a0-4060-993a-9efa7c9b4c23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:39.109083 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d662f619-62a0-4060-993a-9efa7c9b4c23 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:39.120731 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 397/818] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jul 4 09:05:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:39.121520 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d662f619-62a0-4060-993a-9efa7c9b4c23 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:39.140259 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789c7fb1-49f4-4903-86d4-82b51859edf8 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:39.176551 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c42a388-8050-4bb3-bf0c-45b4885f8d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:39.177257 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42a388-8050-4bb3-bf0c-45b4885f8d7f None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:39.177496 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42a388-8050-4bb3-bf0c-45b4885f8d7f None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:39.177763 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42a388-8050-4bb3-bf0c-45b4885f8d7f None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:39.178472 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c42a388-8050-4bb3-bf0c-45b4885f8d7f None admin] RBAC: Adding query filter params (name=network) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:39.178780 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c42a388-8050-4bb3-bf0c-45b4885f8d7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:39.180212 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c42a388-8050-4bb3-bf0c-45b4885f8d7f None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:39.184911 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 422/819] 10.222.0.42 () {56 vars in 1112 bytes} [Mon Jul 4 09:05:39 2022] GET /identity/v3/services?name=network => generated 124 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:39.185984 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c42a388-8050-4bb3-bf0c-45b4885f8d7f None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:39.223163 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d662f619-62a0-4060-993a-9efa7c9b4c23 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:39.256840 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5779ce40-5952-4e40-a43a-995b09e02cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:39.257495 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5779ce40-5952-4e40-a43a-995b09e02cb9 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:39.257797 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5779ce40-5952-4e40-a43a-995b09e02cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:39.258066 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5779ce40-5952-4e40-a43a-995b09e02cb9 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:39.258839 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5779ce40-5952-4e40-a43a-995b09e02cb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:39.259107 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5779ce40-5952-4e40-a43a-995b09e02cb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:39.260528 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5779ce40-5952-4e40-a43a-995b09e02cb9 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:39.272084 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 398/820] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jul 4 09:05:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:39.272286 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:39.273377 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5779ce40-5952-4e40-a43a-995b09e02cb9 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:39.279431 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:39.285991 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c42a388-8050-4bb3-bf0c-45b4885f8d7f None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:39.319776 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca0fd49-cf02-4794-8566-b0788dc122c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:39.320709 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0fd49-cf02-4794-8566-b0788dc122c4 None admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:39.320993 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0fd49-cf02-4794-8566-b0788dc122c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:39.321272 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0fd49-cf02-4794-8566-b0788dc122c4 None admin] PATH_INFO: `/v3/projects/d015d4f3d9d4464983ff561e8e08523c/users/59d8698c45fb46259765eb3c8de2297f/roles/965049e7ce6144aaad23c15f3a5e37c3` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:39.323286 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca0fd49-cf02-4794-8566-b0788dc122c4 None admin] RBAC: Authorizing `identity:create_grant(project_id=d015d4f3d9d4464983ff561e8e08523c, user_id=59d8698c45fb46259765eb3c8de2297f, role_id=965049e7ce6144aaad23c15f3a5e37c3)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:39.324829 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca0fd49-cf02-4794-8566-b0788dc122c4 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:39.337222 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 423/821] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Jul 4 09:05:39 2022] PUT /identity/v3/projects/d015d4f3d9d4464983ff561e8e08523c/users/59d8698c45fb46259765eb3c8de2297f/roles/965049e7ce6144aaad23c15f3a5e37c3 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:05:39.338034 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca0fd49-cf02-4794-8566-b0788dc122c4 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:39.392610 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5779ce40-5952-4e40-a43a-995b09e02cb9 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:39.429465 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec42215-eccd-4848-a11a-aa23af122397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:39.430141 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec42215-eccd-4848-a11a-aa23af122397 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:39.430428 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec42215-eccd-4848-a11a-aa23af122397 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:39.430704 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec42215-eccd-4848-a11a-aa23af122397 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:39.431425 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec42215-eccd-4848-a11a-aa23af122397 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:39.431732 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec42215-eccd-4848-a11a-aa23af122397 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:39.433183 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec42215-eccd-4848-a11a-aa23af122397 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:39.438707 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 399/822] 10.222.0.42 () {56 vars in 1124 bytes} [Mon Jul 4 09:05:39 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:39.439552 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec42215-eccd-4848-a11a-aa23af122397 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:39.472597 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca0fd49-cf02-4794-8566-b0788dc122c4 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:39.512029 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af32351-b620-4a9d-958b-9d6555c2043f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:39.512556 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:39.513177 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af32351-b620-4a9d-958b-9d6555c2043f None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:39.513317 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af32351-b620-4a9d-958b-9d6555c2043f None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:39.513638 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af32351-b620-4a9d-958b-9d6555c2043f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:39.521198 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af32351-b620-4a9d-958b-9d6555c2043f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:39.522805 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af32351-b620-4a9d-958b-9d6555c2043f None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:39.537311 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-7af32351-b620-4a9d-958b-9d6555c2043f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:05:39.537311 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:39.537311 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:39.537311 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:39.537311 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:39.537311 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:39.537311 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:39.537311 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:39.537311 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:39.537311 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:39.537311 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:39.537311 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:39.537311 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:05:39.537311 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:05:39.537311 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:05:39.538245 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:05:39.538245 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:39.538245 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:39.538245 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:39.538245 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:39.538245 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:39.538245 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:39.538245 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:39.538245 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:39.538245 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:39.538245 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:39.538245 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:39.538245 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:39.538245 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:39.538245 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:39.538245 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:39.538245 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:39.539126 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:05:39.539126 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:05:39.539126 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:05:39.539126 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:05:39.539126 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:05:39.539126 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:05:39.539126 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:05:39.539126 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:39.539126 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 424/823] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jul 4 09:05:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:39.539600 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af32351-b620-4a9d-958b-9d6555c2043f None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:39.551650 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:39.553192 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec42215-eccd-4848-a11a-aa23af122397 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:39.588399 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c12cab-1276-45e1-96a3-c2e6dcca632e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:39.589103 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c12cab-1276-45e1-96a3-c2e6dcca632e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:39.589392 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c12cab-1276-45e1-96a3-c2e6dcca632e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:39.589743 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c12cab-1276-45e1-96a3-c2e6dcca632e None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:39.590457 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c12cab-1276-45e1-96a3-c2e6dcca632e None admin] RBAC: Adding query filter params (type=network) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:39.590761 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c12cab-1276-45e1-96a3-c2e6dcca632e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:39.592245 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c12cab-1276-45e1-96a3-c2e6dcca632e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:39.603276 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 400/824] 10.222.0.42 () {56 vars in 1112 bytes} [Mon Jul 4 09:05:39 2022] GET /identity/v3/services?type=network => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:39.603276 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c12cab-1276-45e1-96a3-c2e6dcca632e None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:39.660471 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af32351-b620-4a9d-958b-9d6555c2043f None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:39.697774 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f09be73-3dbe-466b-8425-1c3e0d2d79d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:39.698709 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09be73-3dbe-466b-8425-1c3e0d2d79d7 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:39.699079 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09be73-3dbe-466b-8425-1c3e0d2d79d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:39.699352 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09be73-3dbe-466b-8425-1c3e0d2d79d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:39.700605 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c12cab-1276-45e1-96a3-c2e6dcca632e None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:39.706512 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f09be73-3dbe-466b-8425-1c3e0d2d79d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:39.708078 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f09be73-3dbe-466b-8425-1c3e0d2d79d7 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:39.722441 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-1f09be73-3dbe-466b-8425-1c3e0d2d79d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:05:39.722441 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:39.722441 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:39.722441 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:39.722441 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:39.722441 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:39.722441 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:39.722441 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:39.722441 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:39.722441 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:39.722441 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:39.722441 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:39.722441 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:05:39.722441 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:05:39.722441 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:05:39.723371 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:05:39.723371 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:39.723371 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:39.723371 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:39.723371 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:39.723371 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:39.723371 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:39.723371 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:39.723371 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:39.723371 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:39.723371 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:39.723371 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:39.723371 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:39.723371 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:39.723371 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:39.723371 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:39.723371 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:39.724351 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:05:39.724351 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:05:39.724351 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:05:39.724351 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:05:39.724351 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:05:39.724351 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:05:39.724351 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:05:39.724351 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:39.724351 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 425/825] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jul 4 09:05:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:39.724863 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f09be73-3dbe-466b-8425-1c3e0d2d79d7 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:39.738210 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:39.745078 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959adc91-3229-46ba-b435-703c97dac7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:39.745861 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959adc91-3229-46ba-b435-703c97dac7cd None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:39.746155 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959adc91-3229-46ba-b435-703c97dac7cd None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:39.746407 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959adc91-3229-46ba-b435-703c97dac7cd None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:39.747149 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959adc91-3229-46ba-b435-703c97dac7cd None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:39.748036 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959adc91-3229-46ba-b435-703c97dac7cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:39.749705 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959adc91-3229-46ba-b435-703c97dac7cd None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:39.756290 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 401/826] 10.222.0.42 () {56 vars in 1124 bytes} [Mon Jul 4 09:05:39 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:39.757146 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959adc91-3229-46ba-b435-703c97dac7cd None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:39.811140 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:39.847054 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f09be73-3dbe-466b-8425-1c3e0d2d79d7 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:39.859297 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959adc91-3229-46ba-b435-703c97dac7cd None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:39.886748 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b7401-9b11-4b6e-bcf8-ac97d9fdd01a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:39.887517 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b7401-9b11-4b6e-bcf8-ac97d9fdd01a None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:39.887800 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b7401-9b11-4b6e-bcf8-ac97d9fdd01a None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:39.891080 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b7401-9b11-4b6e-bcf8-ac97d9fdd01a None admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:39.891080 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386b7401-9b11-4b6e-bcf8-ac97d9fdd01a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:39.891080 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386b7401-9b11-4b6e-bcf8-ac97d9fdd01a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:39.891080 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386b7401-9b11-4b6e-bcf8-ac97d9fdd01a None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:39.900417 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f794fb1b-4599-42c8-be2d-9dcb23ffc81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:39.901109 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f794fb1b-4599-42c8-be2d-9dcb23ffc81e None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:39.901387 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f794fb1b-4599-42c8-be2d-9dcb23ffc81e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:39.901672 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f794fb1b-4599-42c8-be2d-9dcb23ffc81e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:39.902397 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f794fb1b-4599-42c8-be2d-9dcb23ffc81e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:39.908834 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 426/827] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Jul 4 09:05:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:39.908967 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f794fb1b-4599-42c8-be2d-9dcb23ffc81e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:39.909053 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b7401-9b11-4b6e-bcf8-ac97d9fdd01a None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:39.936089 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 402/828] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Jul 4 09:05:39 2022] POST /identity/v3/endpoints => generated 327 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:05:39.937258 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f794fb1b-4599-42c8-be2d-9dcb23ffc81e None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:39.998953 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:40.066347 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f794fb1b-4599-42c8-be2d-9dcb23ffc81e None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:40.068651 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b7401-9b11-4b6e-bcf8-ac97d9fdd01a None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:40.106182 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:40.107022 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf8e0dc-d12c-4560-bded-b38efea9fb42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:40.107692 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8e0dc-d12c-4560-bded-b38efea9fb42 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:40.108091 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8e0dc-d12c-4560-bded-b38efea9fb42 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:40.108262 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8e0dc-d12c-4560-bded-b38efea9fb42 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:40.109070 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf8e0dc-d12c-4560-bded-b38efea9fb42 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:40.110733 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf8e0dc-d12c-4560-bded-b38efea9fb42 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:40.114815 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746d61e4-daaf-4a21-98b0-3eb1845411a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:40.115774 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d61e4-daaf-4a21-98b0-3eb1845411a8 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:40.116092 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d61e4-daaf-4a21-98b0-3eb1845411a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:40.116760 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d61e4-daaf-4a21-98b0-3eb1845411a8 None admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:40.117930 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746d61e4-daaf-4a21-98b0-3eb1845411a8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:40.118482 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746d61e4-daaf-4a21-98b0-3eb1845411a8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:40.120009 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746d61e4-daaf-4a21-98b0-3eb1845411a8 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:40.132947 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 427/829] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Jul 4 09:05:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:40.133771 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746d61e4-daaf-4a21-98b0-3eb1845411a8 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:40.137274 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 403/830] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Jul 4 09:05:39 2022] POST /identity/v3/endpoints => generated 346 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:05:40.139221 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf8e0dc-d12c-4560-bded-b38efea9fb42 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:40.268367 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746d61e4-daaf-4a21-98b0-3eb1845411a8 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:40.274701 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:40.280027 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf8e0dc-d12c-4560-bded-b38efea9fb42 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:40.308895 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae5e6d5-e745-42e4-88df-0c916a968210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:40.309564 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5e6d5-e745-42e4-88df-0c916a968210 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:40.309879 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5e6d5-e745-42e4-88df-0c916a968210 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:40.310153 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5e6d5-e745-42e4-88df-0c916a968210 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:40.311027 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae5e6d5-e745-42e4-88df-0c916a968210 None admin] RBAC: Adding query filter params (role.id=965049e7ce6144aaad23c15f3a5e37c3, scope.project.id=d015d4f3d9d4464983ff561e8e08523c, user.id=af3b6e252a8c434a99432bcece6493b3) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:40.311342 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae5e6d5-e745-42e4-88df-0c916a968210 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:40.314722 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae5e6d5-e745-42e4-88df-0c916a968210 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:40.321624 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 428/831] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Jul 4 09:05:40 2022] GET /identity/v3/role_assignments?user.id=af3b6e252a8c434a99432bcece6493b3&scope.project.id=d015d4f3d9d4464983ff561e8e08523c&role.id=965049e7ce6144aaad23c15f3a5e37c3 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:40.331811 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83c5846-7d2d-4212-9a46-bedb8469acdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:40.333197 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c5846-7d2d-4212-9a46-bedb8469acdc None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:40.333759 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c5846-7d2d-4212-9a46-bedb8469acdc None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:40.334076 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c5846-7d2d-4212-9a46-bedb8469acdc None admin] PATH_INFO: `/v3/projects/d015d4f3d9d4464983ff561e8e08523c/users/bd758d5b21684027b0d199021df0ad2f/roles/6cc6801f39634594b9183000ff34fbf2` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:40.352996 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83c5846-7d2d-4212-9a46-bedb8469acdc None admin] RBAC: Authorizing `identity:create_grant(project_id=d015d4f3d9d4464983ff561e8e08523c, user_id=bd758d5b21684027b0d199021df0ad2f, role_id=6cc6801f39634594b9183000ff34fbf2)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:40.354604 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83c5846-7d2d-4212-9a46-bedb8469acdc None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:40.371245 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 404/832] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Jul 4 09:05:40 2022] PUT /identity/v3/projects/d015d4f3d9d4464983ff561e8e08523c/users/bd758d5b21684027b0d199021df0ad2f/roles/6cc6801f39634594b9183000ff34fbf2 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:05:41.379048 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e4e3d-b21b-4965-9c18-069ff990ee05 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:41.379610 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e4e3d-b21b-4965-9c18-069ff990ee05 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:41.379610 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e4e3d-b21b-4965-9c18-069ff990ee05 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:41.381223 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 429/833] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:05:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:05:41.386520 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874b1ba-7161-435a-bd4c-af9a7ac56cc2 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:41.386905 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874b1ba-7161-435a-bd4c-af9a7ac56cc2 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:41.387085 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874b1ba-7161-435a-bd4c-af9a7ac56cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:41.404127 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-1874b1ba-7161-435a-bd4c-af9a7ac56cc2 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:05:41.405307 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-1874b1ba-7161-435a-bd4c-af9a7ac56cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:05:41.474670 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 405/834] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:05:41 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:05:41.498290 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352e4e3d-b21b-4965-9c18-069ff990ee05 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:41.680246 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:41.721516 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352e4e3d-b21b-4965-9c18-069ff990ee05 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:41.755137 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086c0532-eece-47be-94b1-de25d2f028da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:41.755953 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086c0532-eece-47be-94b1-de25d2f028da None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:41.756242 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086c0532-eece-47be-94b1-de25d2f028da None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:41.756516 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086c0532-eece-47be-94b1-de25d2f028da None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:41.766716 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086c0532-eece-47be-94b1-de25d2f028da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:05:41.774461 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-086c0532-eece-47be-94b1-de25d2f028da None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:05:41.774461 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:41.774461 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:41.774461 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:41.774461 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:41.774461 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:41.774461 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:41.774461 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:41.774461 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:41.774461 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:41.774461 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:41.774461 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:41.774461 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:05:41.774461 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:05:41.774461 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:05:41.774461 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:05:41.775551 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:05:41.775551 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:05:41.775551 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:05:41.775551 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:05:41.775551 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:41.775551 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:41.775551 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:41.775551 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:41.775551 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:41.775551 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:41.775551 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:41.775551 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:41.775551 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:41.775551 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:41.775551 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:41.775551 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:41.776544 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:41.776544 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:41.776544 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:41.776544 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:41.776544 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:05:41.776544 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:05:41.776544 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:05:41.776544 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:05:41.776544 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:05:41.776544 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:05:41.776544 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:05:41.776544 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:41.776544 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 430/835] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Jul 4 09:05:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:41.787472 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1874b1ba-7161-435a-bd4c-af9a7ac56cc2 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:41.868150 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:41.891361 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1874b1ba-7161-435a-bd4c-af9a7ac56cc2 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:41.928924 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4245d319-6751-4cea-ac9d-f877c50b5af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:41.929644 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4245d319-6751-4cea-ac9d-f877c50b5af1 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:41.929932 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4245d319-6751-4cea-ac9d-f877c50b5af1 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:41.930225 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4245d319-6751-4cea-ac9d-f877c50b5af1 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:41.931117 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4245d319-6751-4cea-ac9d-f877c50b5af1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:41.931371 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4245d319-6751-4cea-ac9d-f877c50b5af1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:41.932975 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4245d319-6751-4cea-ac9d-f877c50b5af1 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:41.942420 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 406/836] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jul 4 09:05:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:41.947652 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086c0532-eece-47be-94b1-de25d2f028da None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:42.048136 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086c0532-eece-47be-94b1-de25d2f028da None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:42.061143 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:42.083269 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993daae2-d23e-43d3-a8ea-e7c7ad9087b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:42.084104 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993daae2-d23e-43d3-a8ea-e7c7ad9087b4 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:42.084389 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993daae2-d23e-43d3-a8ea-e7c7ad9087b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:42.084663 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993daae2-d23e-43d3-a8ea-e7c7ad9087b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:42.095530 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993daae2-d23e-43d3-a8ea-e7c7ad9087b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:42.097086 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993daae2-d23e-43d3-a8ea-e7c7ad9087b4 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:42.114614 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-993daae2-d23e-43d3-a8ea-e7c7ad9087b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:42.114614 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:42.114614 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:42.114614 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:42.114614 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:42.114614 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:42.114614 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:42.114614 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:42.114614 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:42.114614 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:42.114614 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:42.114614 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:42.114614 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:05:42.114614 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:05:42.114614 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:05:42.115515 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:05:42.115515 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:42.115515 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:42.115515 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:42.115515 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:42.115515 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:42.115515 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:42.115515 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:42.115515 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:42.115515 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:42.115515 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:42.115515 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:42.115515 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:42.115515 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:42.115515 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:42.115515 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:42.115515 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:42.116443 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:05:42.116443 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:05:42.116443 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:42.116443 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:42.116443 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 431/837] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:05:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:42.121820 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4245d319-6751-4cea-ac9d-f877c50b5af1 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:42.234873 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4245d319-6751-4cea-ac9d-f877c50b5af1 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:42.271161 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d30d746-2a8e-4eb5-8bbe-56359c9570e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:42.271901 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d30d746-2a8e-4eb5-8bbe-56359c9570e2 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:42.272192 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d30d746-2a8e-4eb5-8bbe-56359c9570e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:42.272472 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d30d746-2a8e-4eb5-8bbe-56359c9570e2 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:42.273268 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d30d746-2a8e-4eb5-8bbe-56359c9570e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:42.273599 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d30d746-2a8e-4eb5-8bbe-56359c9570e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:42.275116 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d30d746-2a8e-4eb5-8bbe-56359c9570e2 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:42.277041 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3702c44e-54ae-41d1-b80f-88f5040663be None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:42.277560 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3702c44e-54ae-41d1-b80f-88f5040663be None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:42.278039 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3702c44e-54ae-41d1-b80f-88f5040663be None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:42.279934 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 432/838] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:05:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:05:42.284967 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d5220b-2d43-48c8-90ab-5cacb2f9020b None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:42.285518 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d5220b-2d43-48c8-90ab-5cacb2f9020b None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:42.286001 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d5220b-2d43-48c8-90ab-5cacb2f9020b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:42.289209 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 407/839] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jul 4 09:05:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:42.294678 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d30d746-2a8e-4eb5-8bbe-56359c9570e2 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:42.308174 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:42.308937 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-b9d5220b-2d43-48c8-90ab-5cacb2f9020b None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:05:42.310294 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-b9d5220b-2d43-48c8-90ab-5cacb2f9020b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:05:42.389513 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 433/840] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:05:42 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 09:05:42.410832 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d5220b-2d43-48c8-90ab-5cacb2f9020b None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:42.415748 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d30d746-2a8e-4eb5-8bbe-56359c9570e2 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:42.452523 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25118e64-58f0-467f-acc9-ec19922198e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:42.453719 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25118e64-58f0-467f-acc9-ec19922198e8 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:42.454143 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25118e64-58f0-467f-acc9-ec19922198e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:42.454553 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25118e64-58f0-467f-acc9-ec19922198e8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:42.465575 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25118e64-58f0-467f-acc9-ec19922198e8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:42.467191 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25118e64-58f0-467f-acc9-ec19922198e8 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:42.486113 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-25118e64-58f0-467f-acc9-ec19922198e8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 04 09:05:42.486113 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:42.486113 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:42.486113 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:42.486113 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:42.486113 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:42.486113 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:42.486113 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:42.486113 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:42.486113 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:42.486113 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:42.486113 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:42.486113 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:05:42.486113 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:05:42.486113 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:05:42.486113 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:05:42.487078 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:42.487078 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:42.487078 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:05:42.487078 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:05:42.487078 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:05:42.487078 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:05:42.487078 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:42.487078 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:42.487078 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:42.487078 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:42.487078 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:42.487078 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:42.487078 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:42.487078 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:42.487078 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:42.487078 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:42.487078 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:42.487078 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:42.488052 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:42.488052 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:42.488052 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:05:42.488052 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:05:42.488052 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:05:42.488052 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:05:42.488052 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:05:42.488052 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:05:42.488052 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 04 09:05:42.488052 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:42.492489 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 408/841] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Jul 4 09:05:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:42.493419 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25118e64-58f0-467f-acc9-ec19922198e8 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:42.520319 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:42.529512 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d5220b-2d43-48c8-90ab-5cacb2f9020b None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:42.562834 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:42.564785 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6602aae2-c72d-4f6e-a181-a48d268b4c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:42.565639 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6602aae2-c72d-4f6e-a181-a48d268b4c24 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:42.565924 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6602aae2-c72d-4f6e-a181-a48d268b4c24 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:42.566266 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6602aae2-c72d-4f6e-a181-a48d268b4c24 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:42.566847 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6602aae2-c72d-4f6e-a181-a48d268b4c24 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:42.568403 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6602aae2-c72d-4f6e-a181-a48d268b4c24 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:42.582698 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-6602aae2-c72d-4f6e-a181-a48d268b4c24 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 04 09:05:42.582698 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:42.582698 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 09:05:42.582698 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 09:05:42.582698 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 09:05:42.582698 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 09:05:42.582698 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 09:05:42.582698 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:05:42.582698 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 04 09:05:42.582698 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:42.582698 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:05:42.582698 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:42.582698 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:42.582698 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:42.582698 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:42.582698 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:42.582698 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:42.583735 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:42.583735 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:42.583735 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:42.583735 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:42.583735 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:42.583735 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:42.583735 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 09:05:42.583735 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 09:05:42.583735 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 09:05:42.583735 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 09:05:42.583735 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:42.583735 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:42.583735 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:42.583735 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:42.583735 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:42.583735 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:42.584963 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:42.584963 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:42.584963 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:42.584963 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:42.584963 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:42.584963 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:42.584963 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:42.584963 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:42.584963 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:42.584963 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:42.584963 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 09:05:42.584963 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:05:42.584963 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 04 09:05:42.584963 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:42.584963 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 434/842] 10.222.0.42 () {56 vars in 1114 bytes} [Mon Jul 4 09:05:42 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:42.585973 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e09309-3491-4663-953f-8ce7ddb3747e None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:42.585973 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e09309-3491-4663-953f-8ce7ddb3747e None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:42.586249 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e09309-3491-4663-953f-8ce7ddb3747e None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:42.587708 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 435/843] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:05:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:05:42.592592 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e09309-3491-4663-953f-8ce7ddb3747e None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:42.613106 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25118e64-58f0-467f-acc9-ec19922198e8 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:42.650035 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f80ab4-959f-4266-9a92-1f9b64e08225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:42.650749 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f80ab4-959f-4266-9a92-1f9b64e08225 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:42.651060 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f80ab4-959f-4266-9a92-1f9b64e08225 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:42.651375 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f80ab4-959f-4266-9a92-1f9b64e08225 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:42.652328 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f80ab4-959f-4266-9a92-1f9b64e08225 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:42.652655 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f80ab4-959f-4266-9a92-1f9b64e08225 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:42.654150 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f80ab4-959f-4266-9a92-1f9b64e08225 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:42.672334 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 409/844] 10.222.0.42 () {56 vars in 1135 bytes} [Mon Jul 4 09:05:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:42.673718 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e5f34a-4514-42c7-9afc-628077b7e741 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:42.674009 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e5f34a-4514-42c7-9afc-628077b7e741 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:42.674285 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e5f34a-4514-42c7-9afc-628077b7e741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:42.690648 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-62e5f34a-4514-42c7-9afc-628077b7e741 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:05:42.691936 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-62e5f34a-4514-42c7-9afc-628077b7e741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:05:42.695835 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e09309-3491-4663-953f-8ce7ddb3747e None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:42.729744 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e5c012-322f-49d5-84f1-64620969c1b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:42.730402 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e5c012-322f-49d5-84f1-64620969c1b6 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:42.730684 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e5c012-322f-49d5-84f1-64620969c1b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:42.730961 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e5c012-322f-49d5-84f1-64620969c1b6 None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:42.731716 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e5c012-322f-49d5-84f1-64620969c1b6 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:42.732059 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e5c012-322f-49d5-84f1-64620969c1b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:42.733429 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e5c012-322f-49d5-84f1-64620969c1b6 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:42.738548 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 436/845] 10.222.0.42 () {56 vars in 1114 bytes} [Mon Jul 4 09:05:42 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:42.739510 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe1826-68ac-45dd-a5f4-101c22880691 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:42.739783 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe1826-68ac-45dd-a5f4-101c22880691 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:42.740095 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe1826-68ac-45dd-a5f4-101c22880691 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:42.741299 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 437/846] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:05:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:05:42.741999 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efe1826-68ac-45dd-a5f4-101c22880691 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:42.775900 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 410/847] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:05:42 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:05:42.775900 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e5f34a-4514-42c7-9afc-628077b7e741 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:42.781949 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:42.821367 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:42.839641 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efe1826-68ac-45dd-a5f4-101c22880691 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:42.871116 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e5f34a-4514-42c7-9afc-628077b7e741 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:42.874138 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd041f-e6e2-4d93-aa58-ad56070105a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:42.874783 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd041f-e6e2-4d93-aa58-ad56070105a1 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:42.875081 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd041f-e6e2-4d93-aa58-ad56070105a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:42.875333 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd041f-e6e2-4d93-aa58-ad56070105a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:42.906369 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58a7e8a-d36d-4640-a33e-7a1d0057291b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:42.907036 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58a7e8a-d36d-4640-a33e-7a1d0057291b None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:42.907314 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58a7e8a-d36d-4640-a33e-7a1d0057291b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:42.907585 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58a7e8a-d36d-4640-a33e-7a1d0057291b None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:42.908330 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58a7e8a-d36d-4640-a33e-7a1d0057291b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:42.908635 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58a7e8a-d36d-4640-a33e-7a1d0057291b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:42.910039 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58a7e8a-d36d-4640-a33e-7a1d0057291b None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:42.914867 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 411/848] 10.222.0.42 () {56 vars in 1114 bytes} [Mon Jul 4 09:05:42 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:42.916240 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c443b-23a2-48d5-96b1-47bd0f05b0e4 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:42.916531 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c443b-23a2-48d5-96b1-47bd0f05b0e4 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:42.916891 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c443b-23a2-48d5-96b1-47bd0f05b0e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:42.935429 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-237c443b-23a2-48d5-96b1-47bd0f05b0e4 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:05:42.936852 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-237c443b-23a2-48d5-96b1-47bd0f05b0e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:05:42.965865 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befd041f-e6e2-4d93-aa58-ad56070105a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:42.967578 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befd041f-e6e2-4d93-aa58-ad56070105a1 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:42.994459 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:43.027904 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 412/849] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:05:42 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:05:43.027904 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237c443b-23a2-48d5-96b1-47bd0f05b0e4 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:43.099188 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 438/850] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jul 4 09:05:42 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 04 09:05:43.100099 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd041f-e6e2-4d93-aa58-ad56070105a1 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:43.186997 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:43.208667 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd041f-e6e2-4d93-aa58-ad56070105a1 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:43.232545 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:43.244167 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237c443b-23a2-48d5-96b1-47bd0f05b0e4 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:43.248208 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d94f1cf-32fb-433f-b89c-a43fcb257662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:43.248976 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d94f1cf-32fb-433f-b89c-a43fcb257662 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:43.249260 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d94f1cf-32fb-433f-b89c-a43fcb257662 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:43.249533 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d94f1cf-32fb-433f-b89c-a43fcb257662 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:43.250187 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d94f1cf-32fb-433f-b89c-a43fcb257662 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:43.252019 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d94f1cf-32fb-433f-b89c-a43fcb257662 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:43.265005 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-7d94f1cf-32fb-433f-b89c-a43fcb257662 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 04 09:05:43.265005 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:43.265005 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 09:05:43.265005 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 09:05:43.265005 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 09:05:43.265005 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 09:05:43.265005 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 09:05:43.265005 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:05:43.265005 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 04 09:05:43.265005 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:43.265005 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:05:43.265005 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:43.265005 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:43.265005 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:43.265005 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:43.265005 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:43.265995 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:43.265995 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:43.265995 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:43.265995 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:43.265995 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:43.265995 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:43.265995 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:43.265995 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 09:05:43.265995 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 09:05:43.265995 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 09:05:43.265995 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 09:05:43.265995 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:43.265995 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:43.265995 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:43.265995 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:43.265995 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:43.266829 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:43.266829 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:43.266829 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:43.266829 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:43.266829 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:43.266829 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:43.266829 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:43.266829 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:43.266829 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:43.266829 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:43.266829 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:43.266829 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 09:05:43.266829 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:05:43.266829 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 04 09:05:43.266829 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:43.266829 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 439/851] 10.222.0.42 () {56 vars in 1132 bytes} [Mon Jul 4 09:05:43 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:43.267674 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d94f1cf-32fb-433f-b89c-a43fcb257662 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:43.283706 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea06eeb-0745-4be4-9669-e3472cb661fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:43.284521 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea06eeb-0745-4be4-9669-e3472cb661fb None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:43.284803 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea06eeb-0745-4be4-9669-e3472cb661fb None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:43.285076 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea06eeb-0745-4be4-9669-e3472cb661fb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:43.295345 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea06eeb-0745-4be4-9669-e3472cb661fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:05:43.303040 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-8ea06eeb-0745-4be4-9669-e3472cb661fb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:05:43.303040 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:43.303040 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:43.303040 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:43.303040 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:43.303040 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:43.303040 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:43.303040 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:43.303040 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:43.303040 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:43.303040 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:43.303040 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:43.303040 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:05:43.303040 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:05:43.303040 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:05:43.303040 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:05:43.304196 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:05:43.304196 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:05:43.304196 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:05:43.304196 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:05:43.304196 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:43.304196 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:43.304196 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:43.304196 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:43.304196 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:43.304196 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:43.304196 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:43.304196 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:43.304196 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:43.304196 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:43.304196 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:43.304196 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:43.305061 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:43.305061 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:43.305061 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:43.305061 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:43.305061 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:05:43.305061 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:05:43.305061 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:05:43.305061 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:05:43.305061 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:05:43.305061 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:05:43.305061 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:05:43.305061 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:43.305061 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 413/852] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Jul 4 09:05:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:43.305750 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea06eeb-0745-4be4-9669-e3472cb661fb None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:43.386213 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d94f1cf-32fb-433f-b89c-a43fcb257662 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:43.411375 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea06eeb-0745-4be4-9669-e3472cb661fb None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:43.414698 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:43.422807 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac625ce-763b-4b28-ac0a-49ad3d144f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:43.423605 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac625ce-763b-4b28-ac0a-49ad3d144f72 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:43.423908 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac625ce-763b-4b28-ac0a-49ad3d144f72 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:43.424254 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac625ce-763b-4b28-ac0a-49ad3d144f72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:43.434872 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac625ce-763b-4b28-ac0a-49ad3d144f72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:43.436360 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac625ce-763b-4b28-ac0a-49ad3d144f72 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:43.450747 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae29150-9f2e-4968-9178-3f3996bb5e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:43.451994 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae29150-9f2e-4968-9178-3f3996bb5e7d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:43.452463 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae29150-9f2e-4968-9178-3f3996bb5e7d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:43.452905 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae29150-9f2e-4968-9178-3f3996bb5e7d None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:43.453211 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-dac625ce-763b-4b28-ac0a-49ad3d144f72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:43.453211 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:43.453211 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:43.453211 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:43.453211 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:43.453211 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:43.453211 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:43.453211 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:43.453211 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:43.453211 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:43.453211 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:43.453211 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:43.453211 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:05:43.453211 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:05:43.453211 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:05:43.454052 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:05:43.454052 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:43.454052 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:43.454052 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:43.454052 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:43.454052 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:43.454052 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:43.454052 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:43.454052 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:43.454052 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:43.454052 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:43.454052 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:43.454052 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:43.454052 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:43.454052 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:43.454052 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:43.454052 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:43.454936 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:05:43.454936 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:05:43.454936 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:43.454936 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:43.454936 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 440/853] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:05:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:43.455207 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac625ce-763b-4b28-ac0a-49ad3d144f72 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:43.456252 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae29150-9f2e-4968-9178-3f3996bb5e7d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:43.456564 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae29150-9f2e-4968-9178-3f3996bb5e7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:43.457952 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae29150-9f2e-4968-9178-3f3996bb5e7d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:43.468255 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 414/854] 10.222.0.42 () {56 vars in 1126 bytes} [Mon Jul 4 09:05:43 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:43.469908 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae29150-9f2e-4968-9178-3f3996bb5e7d None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:43.500374 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:43.566943 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac625ce-763b-4b28-ac0a-49ad3d144f72 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:43.579165 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae29150-9f2e-4968-9178-3f3996bb5e7d None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:43.605273 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c46203d-bfdb-41c6-9002-f46473c8f486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:43.606051 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c46203d-bfdb-41c6-9002-f46473c8f486 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:43.606362 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c46203d-bfdb-41c6-9002-f46473c8f486 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:43.606729 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c46203d-bfdb-41c6-9002-f46473c8f486 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:43.607552 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c46203d-bfdb-41c6-9002-f46473c8f486 None admin] RBAC: Adding query filter params (name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:43.608038 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c46203d-bfdb-41c6-9002-f46473c8f486 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:43.609999 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c46203d-bfdb-41c6-9002-f46473c8f486 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:43.613620 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea5c5a4-60a0-4014-a1fd-4bdf3f8eb9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:43.614273 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5c5a4-60a0-4014-a1fd-4bdf3f8eb9e1 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:43.614552 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5c5a4-60a0-4014-a1fd-4bdf3f8eb9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:43.614820 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5c5a4-60a0-4014-a1fd-4bdf3f8eb9e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:43.615527 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea5c5a4-60a0-4014-a1fd-4bdf3f8eb9e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:43.615969 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea5c5a4-60a0-4014-a1fd-4bdf3f8eb9e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:43.617333 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea5c5a4-60a0-4014-a1fd-4bdf3f8eb9e1 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:43.619657 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 441/855] 10.222.0.42 () {56 vars in 1103 bytes} [Mon Jul 4 09:05:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:43.620787 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c46203d-bfdb-41c6-9002-f46473c8f486 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:43.635531 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 415/856] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jul 4 09:05:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:43.636981 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea5c5a4-60a0-4014-a1fd-4bdf3f8eb9e1 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:43.667700 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:43.730695 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:43.734170 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c46203d-bfdb-41c6-9002-f46473c8f486 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:43.743737 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea5c5a4-60a0-4014-a1fd-4bdf3f8eb9e1 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:43.772972 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa7219b-bc5f-434d-a05d-5c08c9d63c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:43.773650 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa7219b-bc5f-434d-a05d-5c08c9d63c56 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:43.773826 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa7219b-bc5f-434d-a05d-5c08c9d63c56 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:43.774111 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa7219b-bc5f-434d-a05d-5c08c9d63c56 None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:43.774941 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa7219b-bc5f-434d-a05d-5c08c9d63c56 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:43.775111 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa7219b-bc5f-434d-a05d-5c08c9d63c56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:43.776517 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa7219b-bc5f-434d-a05d-5c08c9d63c56 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:43.780827 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c758f9b-863f-4737-88b6-454e12fb2dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:43.781110 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 442/857] 10.222.0.42 () {56 vars in 1126 bytes} [Mon Jul 4 09:05:43 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:43.788244 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c758f9b-863f-4737-88b6-454e12fb2dc8 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:43.788366 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa7219b-bc5f-434d-a05d-5c08c9d63c56 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:43.788480 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c758f9b-863f-4737-88b6-454e12fb2dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:43.788480 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c758f9b-863f-4737-88b6-454e12fb2dc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:43.800153 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c758f9b-863f-4737-88b6-454e12fb2dc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:43.801753 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c758f9b-863f-4737-88b6-454e12fb2dc8 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:43.820702 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-9c758f9b-863f-4737-88b6-454e12fb2dc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:43.820702 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:43.820702 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:43.820702 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:43.820702 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:43.820702 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:43.820702 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:43.820702 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:43.820702 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:43.820702 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:43.820702 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:43.820702 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:43.820702 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:05:43.820702 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:05:43.820702 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:05:43.821692 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:05:43.821692 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:43.821692 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:43.821692 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:43.821692 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:43.821692 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:43.821692 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:43.821692 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:43.821692 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:43.821692 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:43.821692 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:43.821692 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:43.821692 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:43.821692 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:43.821692 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:43.821692 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:43.821692 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:43.822577 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:05:43.822577 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:05:43.822577 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:43.822577 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:43.822577 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 416/858] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:05:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:43.828136 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c758f9b-863f-4737-88b6-454e12fb2dc8 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:43.920154 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa7219b-bc5f-434d-a05d-5c08c9d63c56 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:43.937847 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:43.960588 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2058f9-662e-49a4-a136-d9088e21f67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:43.961404 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c758f9b-863f-4737-88b6-454e12fb2dc8 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:43.961641 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2058f9-662e-49a4-a136-d9088e21f67d None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:43.961927 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2058f9-662e-49a4-a136-d9088e21f67d None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:43.962198 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2058f9-662e-49a4-a136-d9088e21f67d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:43.970352 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2058f9-662e-49a4-a136-d9088e21f67d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:43.971933 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2058f9-662e-49a4-a136-d9088e21f67d None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:43.988512 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-6d2058f9-662e-49a4-a136-d9088e21f67d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:05:43.988512 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:43.988512 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:43.988512 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:43.988512 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:43.988512 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:43.988512 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:43.988512 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:43.988512 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:43.988512 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:43.988512 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:43.988512 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:43.988512 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:05:43.988512 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:05:43.988512 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:05:43.989440 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:05:43.989440 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:43.989440 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:43.989440 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:43.989440 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:43.989440 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:43.989440 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:43.989440 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:43.989440 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:43.989440 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:43.989440 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:43.989440 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:43.989440 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:43.989440 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:43.989440 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:43.989440 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:43.989440 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:43.990343 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:05:43.990343 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:05:43.990343 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:05:43.990343 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:05:43.990343 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:05:43.990343 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:05:43.990343 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:05:43.990343 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:43.990343 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 443/859] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jul 4 09:05:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:43.996331 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2058f9-662e-49a4-a136-d9088e21f67d None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:44.003361 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31327e35-e30f-4095-89e5-0c8701e7f157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:44.004178 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31327e35-e30f-4095-89e5-0c8701e7f157 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:44.004460 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31327e35-e30f-4095-89e5-0c8701e7f157 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:44.004733 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31327e35-e30f-4095-89e5-0c8701e7f157 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:44.005463 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31327e35-e30f-4095-89e5-0c8701e7f157 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:44.005767 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31327e35-e30f-4095-89e5-0c8701e7f157 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:44.007146 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31327e35-e30f-4095-89e5-0c8701e7f157 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:44.019905 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 417/860] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jul 4 09:05:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:05:44.025007 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:44.025372 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31327e35-e30f-4095-89e5-0c8701e7f157 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:44.105851 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2058f9-662e-49a4-a136-d9088e21f67d None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:44.139738 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10c1339-6c76-4e8a-8705-975073b35831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:44.140465 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10c1339-6c76-4e8a-8705-975073b35831 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:44.140748 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10c1339-6c76-4e8a-8705-975073b35831 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:44.141065 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10c1339-6c76-4e8a-8705-975073b35831 None admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:44.141315 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31327e35-e30f-4095-89e5-0c8701e7f157 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:44.141863 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10c1339-6c76-4e8a-8705-975073b35831 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:44.142167 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10c1339-6c76-4e8a-8705-975073b35831 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:44.143605 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10c1339-6c76-4e8a-8705-975073b35831 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:44.160321 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 444/861] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Jul 4 09:05:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:44.161374 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10c1339-6c76-4e8a-8705-975073b35831 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:44.177858 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385bd195-2053-46a6-ad74-3e6e6c39da2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:44.178769 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385bd195-2053-46a6-ad74-3e6e6c39da2d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:44.179049 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385bd195-2053-46a6-ad74-3e6e6c39da2d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:44.179314 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385bd195-2053-46a6-ad74-3e6e6c39da2d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:44.187437 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385bd195-2053-46a6-ad74-3e6e6c39da2d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:44.189063 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385bd195-2053-46a6-ad74-3e6e6c39da2d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:44.191738 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:44.209100 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-385bd195-2053-46a6-ad74-3e6e6c39da2d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 04 09:05:44.209100 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:44.209100 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:44.209100 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:44.209100 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:44.209100 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:44.209100 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:44.209100 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:44.209100 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:44.209100 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:44.209100 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:44.209100 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:44.209100 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:05:44.209100 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:05:44.209100 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:05:44.209100 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:05:44.210382 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:44.210382 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:44.210382 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:05:44.210382 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:05:44.210382 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:05:44.210382 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:05:44.210382 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:44.210382 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:44.210382 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:44.210382 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:44.210382 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:44.210382 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:44.210382 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:44.210382 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:44.210382 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:44.210382 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:44.210382 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:44.210382 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:44.211313 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:44.211313 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:44.211313 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:05:44.211313 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:05:44.211313 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:05:44.211313 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:05:44.211313 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:05:44.211313 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:05:44.211313 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 04 09:05:44.211313 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:44.211313 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 418/862] 10.222.0.42 () {56 vars in 1117 bytes} [Mon Jul 4 09:05:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:05:44.215768 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385bd195-2053-46a6-ad74-3e6e6c39da2d None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:44.263161 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:44.280270 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10c1339-6c76-4e8a-8705-975073b35831 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:44.316257 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c661725-3a07-4964-9d91-054f2e827085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:44.317429 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c661725-3a07-4964-9d91-054f2e827085 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:44.317827 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c661725-3a07-4964-9d91-054f2e827085 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:44.318109 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c661725-3a07-4964-9d91-054f2e827085 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:44.319189 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c661725-3a07-4964-9d91-054f2e827085 None admin] RBAC: Adding query filter params (role.id=965049e7ce6144aaad23c15f3a5e37c3, scope.project.id=d015d4f3d9d4464983ff561e8e08523c, user.id=59d8698c45fb46259765eb3c8de2297f) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:44.319499 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c661725-3a07-4964-9d91-054f2e827085 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:44.321638 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c661725-3a07-4964-9d91-054f2e827085 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:44.327010 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385bd195-2053-46a6-ad74-3e6e6c39da2d None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:44.329268 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 445/863] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Jul 4 09:05:44 2022] GET /identity/v3/role_assignments?user.id=59d8698c45fb46259765eb3c8de2297f&scope.project.id=d015d4f3d9d4464983ff561e8e08523c&role.id=965049e7ce6144aaad23c15f3a5e37c3 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:05:44.366626 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785c5ebb-a4ba-4c06-8efc-bf3530efb866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:44.367309 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c5ebb-a4ba-4c06-8efc-bf3530efb866 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:44.367588 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c5ebb-a4ba-4c06-8efc-bf3530efb866 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:44.367861 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c5ebb-a4ba-4c06-8efc-bf3530efb866 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:44.368755 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785c5ebb-a4ba-4c06-8efc-bf3530efb866 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:44.369063 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785c5ebb-a4ba-4c06-8efc-bf3530efb866 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:44.370552 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785c5ebb-a4ba-4c06-8efc-bf3530efb866 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:44.394004 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 419/864] 10.222.0.42 () {56 vars in 1149 bytes} [Mon Jul 4 09:05:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:05:44.399959 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c661725-3a07-4964-9d91-054f2e827085 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:44.508895 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c661725-3a07-4964-9d91-054f2e827085 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:44.544476 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7492d4-a0f6-4461-a909-944f3f6b4e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:44.545460 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7492d4-a0f6-4461-a909-944f3f6b4e3e None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:44.545961 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7492d4-a0f6-4461-a909-944f3f6b4e3e None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:44.546434 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7492d4-a0f6-4461-a909-944f3f6b4e3e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:44.565550 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:44.618539 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7492d4-a0f6-4461-a909-944f3f6b4e3e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:44.620055 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7492d4-a0f6-4461-a909-944f3f6b4e3e None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:44.724871 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 446/865] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jul 4 09:05:44 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 04 09:05:44.730203 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785c5ebb-a4ba-4c06-8efc-bf3530efb866 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:44.790370 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:44.831720 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785c5ebb-a4ba-4c06-8efc-bf3530efb866 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:44.865689 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e65e417-b3f5-4573-9970-2889753fbc9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:44.866810 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65e417-b3f5-4573-9970-2889753fbc9d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:44.867309 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65e417-b3f5-4573-9970-2889753fbc9d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:44.867783 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65e417-b3f5-4573-9970-2889753fbc9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:44.878326 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e65e417-b3f5-4573-9970-2889753fbc9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:44.880145 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e65e417-b3f5-4573-9970-2889753fbc9d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:44.898629 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-4e65e417-b3f5-4573-9970-2889753fbc9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:44.898629 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:44.898629 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:44.898629 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:44.898629 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:44.898629 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:44.898629 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:44.898629 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:44.898629 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:44.898629 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:44.898629 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:44.898629 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:44.898629 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:05:44.898629 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:05:44.898629 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:05:44.899727 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:05:44.899727 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:44.899727 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:44.899727 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:44.899727 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:44.899727 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:44.899727 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:44.899727 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:44.899727 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:44.899727 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:44.899727 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:44.899727 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:44.899727 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:44.899727 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:44.899727 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:44.899727 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:44.899727 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:44.900892 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:05:44.900892 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:05:44.900892 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:44.900892 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:44.902380 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 420/866] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:05:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:44.908980 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7492d4-a0f6-4461-a909-944f3f6b4e3e None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:44.958059 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:44.986993 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d363be51-bd9d-4b97-af91-0c4a17181fd2 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:44.987268 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d363be51-bd9d-4b97-af91-0c4a17181fd2 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:44.987638 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d363be51-bd9d-4b97-af91-0c4a17181fd2 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:44.989357 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 421/867] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:05:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:05:44.995716 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb478d2-d5bb-42ab-addc-ea7fa6a9027b None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:44.996037 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb478d2-d5bb-42ab-addc-ea7fa6a9027b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:44.996368 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb478d2-d5bb-42ab-addc-ea7fa6a9027b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:45.011375 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7492d4-a0f6-4461-a909-944f3f6b4e3e None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:45.013180 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-adb478d2-d5bb-42ab-addc-ea7fa6a9027b None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:05:45.014350 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-adb478d2-d5bb-42ab-addc-ea7fa6a9027b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:05:45.053610 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf90e2b5-1947-4b35-b388-9a2c0ed2c0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:45.054295 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf90e2b5-1947-4b35-b388-9a2c0ed2c0ca None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:45.054576 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf90e2b5-1947-4b35-b388-9a2c0ed2c0ca None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:45.054853 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf90e2b5-1947-4b35-b388-9a2c0ed2c0ca None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:45.055587 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf90e2b5-1947-4b35-b388-9a2c0ed2c0ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:45.055930 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf90e2b5-1947-4b35-b388-9a2c0ed2c0ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:45.058055 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf90e2b5-1947-4b35-b388-9a2c0ed2c0ca None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:45.072886 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 447/868] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jul 4 09:05:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:45.078589 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf90e2b5-1947-4b35-b388-9a2c0ed2c0ca None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:45.088068 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 422/869] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:05:44 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:05:45.107055 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb478d2-d5bb-42ab-addc-ea7fa6a9027b None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:45.149631 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:45.201005 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf90e2b5-1947-4b35-b388-9a2c0ed2c0ca None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:45.218122 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb478d2-d5bb-42ab-addc-ea7fa6a9027b None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:45.232332 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:45.241273 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5bf385-53dc-439e-9744-57681e2af752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:45.242209 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5bf385-53dc-439e-9744-57681e2af752 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:45.242619 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5bf385-53dc-439e-9744-57681e2af752 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:45.243115 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5bf385-53dc-439e-9744-57681e2af752 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:45.253553 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5bf385-53dc-439e-9744-57681e2af752 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:45.255965 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5bf385-53dc-439e-9744-57681e2af752 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:45.260151 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500d7eba-9b32-41b1-8941-64e8b5398bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:45.261013 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d7eba-9b32-41b1-8941-64e8b5398bd1 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:45.261458 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d7eba-9b32-41b1-8941-64e8b5398bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:45.261893 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d7eba-9b32-41b1-8941-64e8b5398bd1 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:45.263077 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500d7eba-9b32-41b1-8941-64e8b5398bd1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:45.264700 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500d7eba-9b32-41b1-8941-64e8b5398bd1 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:45.272159 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-5d5bf385-53dc-439e-9744-57681e2af752 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:05:45.272159 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:45.272159 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:45.272159 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:45.272159 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:45.272159 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:45.272159 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:45.272159 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:45.272159 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:45.272159 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:45.272159 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:45.272159 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:45.272159 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:05:45.272159 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:05:45.272159 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:05:45.273422 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:05:45.273422 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:45.273422 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:45.273422 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:45.273422 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:45.273422 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:45.273422 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:45.273422 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:45.273422 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:45.273422 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:45.273422 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:45.273422 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:45.273422 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:45.273422 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:45.273422 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:45.273422 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:45.273422 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:45.274351 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:05:45.274351 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:05:45.274351 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:05:45.274351 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:05:45.274351 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:05:45.274351 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:05:45.274351 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:05:45.274351 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:45.274351 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 448/870] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jul 4 09:05:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:45.279211 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5bf385-53dc-439e-9744-57681e2af752 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:45.284542 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 423/871] 10.222.0.42 () {60 vars in 1141 bytes} [Mon Jul 4 09:05:45 2022] POST /identity/v3/services => generated 251 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:05:45.387382 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5bf385-53dc-439e-9744-57681e2af752 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:45.430463 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6395013e-86a6-467d-a8ce-5db6765cfcd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:45.431379 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395013e-86a6-467d-a8ce-5db6765cfcd2 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:45.431805 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395013e-86a6-467d-a8ce-5db6765cfcd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:45.432239 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395013e-86a6-467d-a8ce-5db6765cfcd2 None admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:45.433166 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6395013e-86a6-467d-a8ce-5db6765cfcd2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:45.434263 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6395013e-86a6-467d-a8ce-5db6765cfcd2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:45.435945 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6395013e-86a6-467d-a8ce-5db6765cfcd2 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:45.448518 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 449/872] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Jul 4 09:05:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:45.454329 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500d7eba-9b32-41b1-8941-64e8b5398bd1 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:45.557387 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:45.562859 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500d7eba-9b32-41b1-8941-64e8b5398bd1 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:45.599350 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e765d-3944-4afe-a7b9-812cc3077bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:45.600038 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e765d-3944-4afe-a7b9-812cc3077bd0 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:45.600315 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e765d-3944-4afe-a7b9-812cc3077bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:45.600585 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e765d-3944-4afe-a7b9-812cc3077bd0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:45.601414 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562e765d-3944-4afe-a7b9-812cc3077bd0 None admin] RBAC: Adding query filter params (role.id=6cc6801f39634594b9183000ff34fbf2, scope.project.id=d015d4f3d9d4464983ff561e8e08523c, user.id=bd758d5b21684027b0d199021df0ad2f) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:45.601719 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562e765d-3944-4afe-a7b9-812cc3077bd0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:45.603169 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562e765d-3944-4afe-a7b9-812cc3077bd0 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:45.610046 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 424/873] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Jul 4 09:05:45 2022] GET /identity/v3/role_assignments?user.id=bd758d5b21684027b0d199021df0ad2f&scope.project.id=d015d4f3d9d4464983ff561e8e08523c&role.id=6cc6801f39634594b9183000ff34fbf2 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:45.981085 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8cbfc2-787a-4bf0-90ab-71c175c748d5 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:45.981660 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8cbfc2-787a-4bf0-90ab-71c175c748d5 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:45.981660 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8cbfc2-787a-4bf0-90ab-71c175c748d5 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:45.983315 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 450/874] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:05:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:05:45.989040 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205680ce-ac76-4848-9ab1-dd427b238c43 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:45.989469 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205680ce-ac76-4848-9ab1-dd427b238c43 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:45.989646 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205680ce-ac76-4848-9ab1-dd427b238c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:46.007278 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-205680ce-ac76-4848-9ab1-dd427b238c43 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:05:46.008491 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-205680ce-ac76-4848-9ab1-dd427b238c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:05:46.079177 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 425/875] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:05:45 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:05:46.101620 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8cbfc2-787a-4bf0-90ab-71c175c748d5 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:46.127643 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:46.203826 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8cbfc2-787a-4bf0-90ab-71c175c748d5 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:46.237342 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e2ae05-9989-431c-bb63-66d83f33b1e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:46.238059 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e2ae05-9989-431c-bb63-66d83f33b1e8 None admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:46.238343 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e2ae05-9989-431c-bb63-66d83f33b1e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:46.238617 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e2ae05-9989-431c-bb63-66d83f33b1e8 None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:46.239350 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e2ae05-9989-431c-bb63-66d83f33b1e8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:46.240760 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e2ae05-9989-431c-bb63-66d83f33b1e8 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:46.260034 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 451/876] 10.222.0.42 () {60 vars in 1141 bytes} [Mon Jul 4 09:05:46 2022] POST /identity/v3/services => generated 269 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:05:46.579828 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b307ed7d-acb9-487e-8eae-08a54c8983ff None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:46.580039 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b307ed7d-acb9-487e-8eae-08a54c8983ff None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:46.580323 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b307ed7d-acb9-487e-8eae-08a54c8983ff None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:46.581903 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 426/877] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:05:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:05:46.587430 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ef9d9-505d-4141-806d-4167c8e61999 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:46.587731 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ef9d9-505d-4141-806d-4167c8e61999 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:46.588214 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ef9d9-505d-4141-806d-4167c8e61999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:46.606770 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-a58ef9d9-505d-4141-806d-4167c8e61999 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:05:46.607982 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-a58ef9d9-505d-4141-806d-4167c8e61999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:05:46.688219 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 452/878] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:05:46 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:05:46.710257 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b307ed7d-acb9-487e-8eae-08a54c8983ff None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:46.808607 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:46.818361 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b307ed7d-acb9-487e-8eae-08a54c8983ff None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:46.852665 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64facd70-bbdb-474a-8ffa-d04b60baa627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:46.853391 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64facd70-bbdb-474a-8ffa-d04b60baa627 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:46.853670 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64facd70-bbdb-474a-8ffa-d04b60baa627 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:46.853953 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64facd70-bbdb-474a-8ffa-d04b60baa627 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:46.854585 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64facd70-bbdb-474a-8ffa-d04b60baa627 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:46.855990 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64facd70-bbdb-474a-8ffa-d04b60baa627 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:46.868235 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-64facd70-bbdb-474a-8ffa-d04b60baa627 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 04 09:05:46.868235 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:46.868235 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 09:05:46.868235 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 09:05:46.868235 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 09:05:46.868235 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 09:05:46.868235 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 09:05:46.868235 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:05:46.868235 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 04 09:05:46.868235 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:46.868235 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:05:46.868235 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:46.868235 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:46.868235 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:46.868235 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:46.868235 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:46.868235 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:46.869439 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:46.869439 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:46.869439 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:46.869439 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:46.869439 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:46.869439 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:46.869439 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 09:05:46.869439 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 09:05:46.869439 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 09:05:46.869439 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 09:05:46.869439 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:46.869439 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:46.869439 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:46.869439 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:46.869439 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:46.869439 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:46.870452 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:46.870452 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:46.870452 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:46.870452 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:46.870452 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:46.870452 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:46.870452 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:46.870452 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:46.870452 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:46.870452 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:46.870452 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 09:05:46.870452 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:05:46.870452 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 04 09:05:46.870452 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:46.870452 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 427/879] 10.222.0.42 () {56 vars in 1126 bytes} [Mon Jul 4 09:05:46 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:46.875795 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58ef9d9-505d-4141-806d-4167c8e61999 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:46.908293 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:46.983227 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58ef9d9-505d-4141-806d-4167c8e61999 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:47.017689 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0224680b-4e85-406d-a330-92569c66484a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:47.018351 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0224680b-4e85-406d-a330-92569c66484a None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:47.018634 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0224680b-4e85-406d-a330-92569c66484a None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:47.018906 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0224680b-4e85-406d-a330-92569c66484a None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:47.019609 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0224680b-4e85-406d-a330-92569c66484a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:47.019928 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0224680b-4e85-406d-a330-92569c66484a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:47.021307 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0224680b-4e85-406d-a330-92569c66484a None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:47.026268 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 453/880] 10.222.0.42 () {56 vars in 1122 bytes} [Mon Jul 4 09:05:46 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:47.031888 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64facd70-bbdb-474a-8ffa-d04b60baa627 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:47.131476 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64facd70-bbdb-474a-8ffa-d04b60baa627 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:47.164768 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c58b4a6-546b-4ca0-be66-e4eeab0e0ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:47.165487 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c58b4a6-546b-4ca0-be66-e4eeab0e0ff1 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:47.165768 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c58b4a6-546b-4ca0-be66-e4eeab0e0ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:47.166034 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c58b4a6-546b-4ca0-be66-e4eeab0e0ff1 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:47.166732 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c58b4a6-546b-4ca0-be66-e4eeab0e0ff1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:47.167031 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c58b4a6-546b-4ca0-be66-e4eeab0e0ff1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:47.168451 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c58b4a6-546b-4ca0-be66-e4eeab0e0ff1 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:47.173459 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 428/881] 10.222.0.42 () {56 vars in 1122 bytes} [Mon Jul 4 09:05:47 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:47.396026 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385f413e-9a1c-487b-b49e-3f8794085465 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:47.396686 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385f413e-9a1c-487b-b49e-3f8794085465 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:47.397188 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385f413e-9a1c-487b-b49e-3f8794085465 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:47.399058 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 454/882] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:05:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:05:47.404789 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9440e1ce-807e-4134-8269-f2cb3c476374 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:47.405384 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9440e1ce-807e-4134-8269-f2cb3c476374 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:47.405880 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9440e1ce-807e-4134-8269-f2cb3c476374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:47.424252 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-9440e1ce-807e-4134-8269-f2cb3c476374 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:05:47.425835 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9440e1ce-807e-4134-8269-f2cb3c476374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:05:47.443692 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:47.495901 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 429/883] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:05:47 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:05:47.522992 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385f413e-9a1c-487b-b49e-3f8794085465 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:47.601040 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:47.628742 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385f413e-9a1c-487b-b49e-3f8794085465 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:47.663043 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae74825-7739-4536-8b85-b0f924c02c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:47.663921 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae74825-7739-4536-8b85-b0f924c02c5f None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:47.664251 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae74825-7739-4536-8b85-b0f924c02c5f None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:47.664529 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae74825-7739-4536-8b85-b0f924c02c5f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:47.665183 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae74825-7739-4536-8b85-b0f924c02c5f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:47.666559 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae74825-7739-4536-8b85-b0f924c02c5f None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:47.678933 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-2ae74825-7739-4536-8b85-b0f924c02c5f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 04 09:05:47.678933 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:47.678933 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 09:05:47.678933 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 09:05:47.678933 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 09:05:47.678933 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 09:05:47.678933 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 09:05:47.678933 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:05:47.678933 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 04 09:05:47.678933 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:47.678933 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:05:47.678933 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:47.678933 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:47.678933 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:47.678933 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:47.678933 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:47.678933 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:47.679949 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:47.679949 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:47.679949 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:47.679949 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:47.679949 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:47.679949 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:47.679949 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 09:05:47.679949 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 09:05:47.679949 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 09:05:47.679949 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 09:05:47.679949 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:47.679949 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:47.679949 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:47.679949 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:47.679949 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:47.679949 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:47.681189 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:47.681189 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:47.681189 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:47.681189 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:47.681189 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:47.681189 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:47.681189 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:47.681189 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:47.681189 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:47.681189 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:47.681189 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 09:05:47.681189 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:05:47.681189 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 04 09:05:47.681189 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:47.681189 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 455/884] 10.222.0.42 () {56 vars in 1114 bytes} [Mon Jul 4 09:05:47 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:47.686451 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9440e1ce-807e-4134-8269-f2cb3c476374 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:47.720159 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d04d53-a76e-4abe-862f-bcf5d0267b63 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:47.720478 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d04d53-a76e-4abe-862f-bcf5d0267b63 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:47.720714 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d04d53-a76e-4abe-862f-bcf5d0267b63 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:47.723185 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 456/885] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:05:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:05:47.727827 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faedb89e-fdaf-47b1-949c-26046f505c09 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:47.728139 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faedb89e-fdaf-47b1-949c-26046f505c09 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:47.728414 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faedb89e-fdaf-47b1-949c-26046f505c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:47.746902 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-faedb89e-fdaf-47b1-949c-26046f505c09 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:05:47.748787 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-faedb89e-fdaf-47b1-949c-26046f505c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:05:47.795532 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9440e1ce-807e-4134-8269-f2cb3c476374 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:47.830513 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3861fec9-3a6b-468b-a926-8ed5e9d401bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:47.831203 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3861fec9-3a6b-468b-a926-8ed5e9d401bd None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:47.831424 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3861fec9-3a6b-468b-a926-8ed5e9d401bd None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:47.831694 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3861fec9-3a6b-468b-a926-8ed5e9d401bd None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:47.832439 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3861fec9-3a6b-468b-a926-8ed5e9d401bd None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:47.832738 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3861fec9-3a6b-468b-a926-8ed5e9d401bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:47.834249 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3861fec9-3a6b-468b-a926-8ed5e9d401bd None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:47.839355 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 430/886] 10.222.0.42 () {56 vars in 1114 bytes} [Mon Jul 4 09:05:47 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:47.839767 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 457/887] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:05:47 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 09:05:47.844874 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3861fec9-3a6b-468b-a926-8ed5e9d401bd None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:47.863499 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faedb89e-fdaf-47b1-949c-26046f505c09 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:47.866853 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:47.952640 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:47.956083 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3861fec9-3a6b-468b-a926-8ed5e9d401bd None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:47.994001 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387107c2-811d-4be2-a10d-40468c08c957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:47.994409 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faedb89e-fdaf-47b1-949c-26046f505c09 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:47.995556 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387107c2-811d-4be2-a10d-40468c08c957 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:47.996122 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387107c2-811d-4be2-a10d-40468c08c957 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:47.996700 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387107c2-811d-4be2-a10d-40468c08c957 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:47.997687 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387107c2-811d-4be2-a10d-40468c08c957 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:47.998184 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387107c2-811d-4be2-a10d-40468c08c957 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:47.999787 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387107c2-811d-4be2-a10d-40468c08c957 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:48.005778 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 431/888] 10.222.0.42 () {56 vars in 1114 bytes} [Mon Jul 4 09:05:47 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:48.011122 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387107c2-811d-4be2-a10d-40468c08c957 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:48.037716 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1f950a-12ab-406c-b646-5f20bae8a863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:48.039366 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f950a-12ab-406c-b646-5f20bae8a863 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:48.040145 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f950a-12ab-406c-b646-5f20bae8a863 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:48.040623 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f950a-12ab-406c-b646-5f20bae8a863 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:48.055554 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1f950a-12ab-406c-b646-5f20bae8a863 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:05:48.067127 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-df1f950a-12ab-406c-b646-5f20bae8a863 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 04 09:05:48.067127 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:48.067127 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:48.067127 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:48.067127 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:48.067127 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:48.067127 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:48.067127 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:48.067127 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:48.067127 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:48.067127 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:48.067127 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:48.067127 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:05:48.067127 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:05:48.067127 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:05:48.067127 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:05:48.068114 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:05:48.068114 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:05:48.068114 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:05:48.068114 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:05:48.068114 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:48.068114 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:48.068114 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:48.068114 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:48.068114 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:48.068114 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:48.068114 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:48.068114 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:48.068114 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:48.068114 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:48.068114 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:48.068114 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:48.068983 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:48.068983 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:48.068983 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:48.068983 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:48.068983 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:05:48.068983 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:05:48.068983 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:05:48.068983 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:05:48.068983 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:05:48.068983 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:05:48.068983 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 04 09:05:48.068983 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:48.072393 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 458/889] 10.222.0.42 () {56 vars in 1120 bytes} [Mon Jul 4 09:05:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:05:48.077758 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1f950a-12ab-406c-b646-5f20bae8a863 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:48.131362 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387107c2-811d-4be2-a10d-40468c08c957 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:48.135274 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:48.167750 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4040f3d3-a28e-455a-9003-e23b9ea87956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:48.168425 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4040f3d3-a28e-455a-9003-e23b9ea87956 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:48.168844 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4040f3d3-a28e-455a-9003-e23b9ea87956 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:48.169138 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4040f3d3-a28e-455a-9003-e23b9ea87956 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:48.170063 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4040f3d3-a28e-455a-9003-e23b9ea87956 None admin] RBAC: Adding query filter params (interface=public, service_id=7b781a0033e54a14bcadf7a7164b4f57, region_id=RegionOne) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:48.170371 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4040f3d3-a28e-455a-9003-e23b9ea87956 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:48.172385 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4040f3d3-a28e-455a-9003-e23b9ea87956 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:48.178896 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 432/890] 10.222.0.42 () {56 vars in 1251 bytes} [Mon Jul 4 09:05:48 2022] GET /identity/v3/endpoints?service_id=7b781a0033e54a14bcadf7a7164b4f57&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:05:48.184366 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4040f3d3-a28e-455a-9003-e23b9ea87956 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:48.191911 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1f950a-12ab-406c-b646-5f20bae8a863 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:48.219038 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:48.230059 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b002a2e-ebe1-496f-9332-30eb3515dfe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:48.231936 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b002a2e-ebe1-496f-9332-30eb3515dfe4 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:48.232470 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b002a2e-ebe1-496f-9332-30eb3515dfe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:48.232934 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b002a2e-ebe1-496f-9332-30eb3515dfe4 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:48.233876 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b002a2e-ebe1-496f-9332-30eb3515dfe4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:48.234373 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b002a2e-ebe1-496f-9332-30eb3515dfe4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:48.236849 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b002a2e-ebe1-496f-9332-30eb3515dfe4 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:48.253291 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 459/891] 10.222.0.42 () {56 vars in 1115 bytes} [Mon Jul 4 09:05:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:05:48.253816 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b002a2e-ebe1-496f-9332-30eb3515dfe4 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:48.311916 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4040f3d3-a28e-455a-9003-e23b9ea87956 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:48.354564 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6017c26e-031d-4c4b-82d1-139b0f7a8fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:48.355357 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6017c26e-031d-4c4b-82d1-139b0f7a8fa1 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:48.355710 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6017c26e-031d-4c4b-82d1-139b0f7a8fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:48.356096 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6017c26e-031d-4c4b-82d1-139b0f7a8fa1 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:48.356990 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6017c26e-031d-4c4b-82d1-139b0f7a8fa1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:48.358473 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6017c26e-031d-4c4b-82d1-139b0f7a8fa1 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:48.367990 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b002a2e-ebe1-496f-9332-30eb3515dfe4 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:48.372423 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 433/892] 10.222.0.42 () {56 vars in 1087 bytes} [Mon Jul 4 09:05:48 2022] GET /identity/v3/services => generated 1268 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:05:48.389648 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d05cf2-fb9a-455f-bade-491789cd636e None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:48.389927 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d05cf2-fb9a-455f-bade-491789cd636e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:48.390204 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d05cf2-fb9a-455f-bade-491789cd636e None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:48.395932 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 434/893] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:05:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:05:48.397754 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cdb619-5f74-45e8-ab67-3c2661e5366f None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:48.398046 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cdb619-5f74-45e8-ab67-3c2661e5366f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:48.398324 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cdb619-5f74-45e8-ab67-3c2661e5366f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:48.411157 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e806fb-b857-4955-9b8f-0a00d7778247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:48.412592 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e806fb-b857-4955-9b8f-0a00d7778247 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:48.413073 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e806fb-b857-4955-9b8f-0a00d7778247 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:48.413529 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e806fb-b857-4955-9b8f-0a00d7778247 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:48.416071 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-47cdb619-5f74-45e8-ab67-3c2661e5366f None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:05:48.417487 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-47cdb619-5f74-45e8-ab67-3c2661e5366f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:05:48.428977 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e806fb-b857-4955-9b8f-0a00d7778247 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:48.431363 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e806fb-b857-4955-9b8f-0a00d7778247 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:48.444259 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:48.455131 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-c5e806fb-b857-4955-9b8f-0a00d7778247 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:48.455131 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:48.455131 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:48.455131 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:48.455131 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:48.455131 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:48.455131 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:48.455131 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:48.455131 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:48.455131 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:48.455131 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:48.455131 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:48.455131 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:05:48.455131 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:05:48.455131 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:05:48.456121 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:05:48.456121 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:48.456121 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:48.456121 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:48.456121 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:48.456121 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:48.456121 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:48.456121 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:48.456121 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:48.456121 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:48.456121 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:48.456121 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:48.456121 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:48.456121 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:48.456121 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:48.456121 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:48.456121 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:48.457015 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:05:48.457015 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:05:48.457015 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:48.457015 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:48.465067 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 460/894] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:05:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:05:48.466343 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e806fb-b857-4955-9b8f-0a00d7778247 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:48.497853 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 435/895] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:05:48 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 09:05:48.520364 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:48.521022 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cdb619-5f74-45e8-ab67-3c2661e5366f None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:48.592648 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e806fb-b857-4955-9b8f-0a00d7778247 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:48.632547 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88afb93c-19aa-4dc9-b07e-6642249ab26b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:48.633215 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88afb93c-19aa-4dc9-b07e-6642249ab26b None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:48.633497 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88afb93c-19aa-4dc9-b07e-6642249ab26b None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:48.633772 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88afb93c-19aa-4dc9-b07e-6642249ab26b None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:48.634498 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88afb93c-19aa-4dc9-b07e-6642249ab26b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:48.634801 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88afb93c-19aa-4dc9-b07e-6642249ab26b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:48.636209 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88afb93c-19aa-4dc9-b07e-6642249ab26b None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:48.648563 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 461/896] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jul 4 09:05:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:48.653253 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cdb619-5f74-45e8-ab67-3c2661e5366f None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:48.653759 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88afb93c-19aa-4dc9-b07e-6642249ab26b None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:48.696793 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9655844-512d-409c-b9a8-f673bc86cc12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:48.697618 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9655844-512d-409c-b9a8-f673bc86cc12 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:48.697896 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9655844-512d-409c-b9a8-f673bc86cc12 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:48.698168 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9655844-512d-409c-b9a8-f673bc86cc12 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:48.698822 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9655844-512d-409c-b9a8-f673bc86cc12 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:48.700274 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9655844-512d-409c-b9a8-f673bc86cc12 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:48.716969 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-b9655844-512d-409c-b9a8-f673bc86cc12 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 04 09:05:48.716969 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:48.716969 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 09:05:48.716969 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 09:05:48.716969 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 09:05:48.716969 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 09:05:48.716969 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 09:05:48.716969 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:05:48.716969 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 04 09:05:48.716969 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:48.716969 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:05:48.716969 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:48.716969 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:48.716969 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:48.716969 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:48.716969 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:48.717980 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:48.717980 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:48.717980 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:48.717980 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:48.717980 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:48.717980 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:48.717980 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:48.717980 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 09:05:48.717980 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 09:05:48.717980 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 09:05:48.717980 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 09:05:48.717980 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:48.717980 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:48.717980 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:48.717980 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:48.717980 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:48.718863 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:48.718863 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:48.718863 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:48.718863 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:48.718863 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:48.718863 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:48.718863 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:48.718863 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:48.718863 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:48.718863 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:48.718863 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:48.718863 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 09:05:48.718863 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:05:48.718863 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 04 09:05:48.718863 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:48.718863 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 436/897] 10.222.0.42 () {56 vars in 1132 bytes} [Mon Jul 4 09:05:48 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:48.724284 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9655844-512d-409c-b9a8-f673bc86cc12 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:48.738049 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:48.784851 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88afb93c-19aa-4dc9-b07e-6642249ab26b None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:48.786458 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:48.823549 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65d38e6-242a-4783-b7ae-0218e5fdda65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:48.824448 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d38e6-242a-4783-b7ae-0218e5fdda65 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:48.824706 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d38e6-242a-4783-b7ae-0218e5fdda65 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:48.824979 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d38e6-242a-4783-b7ae-0218e5fdda65 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:48.832486 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65d38e6-242a-4783-b7ae-0218e5fdda65 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:48.834161 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65d38e6-242a-4783-b7ae-0218e5fdda65 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:48.847705 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9655844-512d-409c-b9a8-f673bc86cc12 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:48.849522 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-d65d38e6-242a-4783-b7ae-0218e5fdda65 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 04 09:05:48.849522 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:48.849522 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:48.849522 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:48.849522 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:48.849522 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:48.849522 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:48.849522 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:48.849522 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:48.849522 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:48.849522 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:48.849522 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:48.849522 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:05:48.849522 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:05:48.849522 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:05:48.849522 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:05:48.850648 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:48.850648 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:48.850648 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:05:48.850648 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:05:48.850648 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:05:48.850648 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:05:48.850648 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:48.850648 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:48.850648 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:48.850648 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:48.850648 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:48.850648 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:48.850648 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:48.850648 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:48.850648 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:48.850648 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:48.850648 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:48.850648 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:48.852083 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:48.852083 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:48.852083 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:05:48.852083 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:05:48.852083 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:05:48.852083 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:05:48.852083 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:05:48.852083 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:05:48.852083 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 04 09:05:48.852083 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:48.852083 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 462/898] 10.222.0.42 () {56 vars in 1117 bytes} [Mon Jul 4 09:05:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:48.856486 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65d38e6-242a-4783-b7ae-0218e5fdda65 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:48.898839 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50dbd99-b011-4230-aa26-f0fd0d9b098b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:48.899774 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50dbd99-b011-4230-aa26-f0fd0d9b098b None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:48.900229 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50dbd99-b011-4230-aa26-f0fd0d9b098b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:48.900681 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50dbd99-b011-4230-aa26-f0fd0d9b098b None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:48.901588 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50dbd99-b011-4230-aa26-f0fd0d9b098b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:48.902085 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50dbd99-b011-4230-aa26-f0fd0d9b098b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:48.903768 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50dbd99-b011-4230-aa26-f0fd0d9b098b None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:48.909686 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 437/899] 10.222.0.42 () {56 vars in 1126 bytes} [Mon Jul 4 09:05:48 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:48.917573 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50dbd99-b011-4230-aa26-f0fd0d9b098b None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:48.975686 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65d38e6-242a-4783-b7ae-0218e5fdda65 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:48.991550 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:49.012473 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9faf784-bbfe-4bdc-b358-a815a3835744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:49.013372 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9faf784-bbfe-4bdc-b358-a815a3835744 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:49.013744 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9faf784-bbfe-4bdc-b358-a815a3835744 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:49.014126 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9faf784-bbfe-4bdc-b358-a815a3835744 None admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:49.015060 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9faf784-bbfe-4bdc-b358-a815a3835744 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:49.015459 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9faf784-bbfe-4bdc-b358-a815a3835744 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:49.017005 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9faf784-bbfe-4bdc-b358-a815a3835744 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:49.034199 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50dbd99-b011-4230-aa26-f0fd0d9b098b None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:49.035250 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 463/900] 10.222.0.42 () {56 vars in 1149 bytes} [Mon Jul 4 09:05:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:49.040339 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9faf784-bbfe-4bdc-b358-a815a3835744 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:49.062086 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:49.080521 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17d2a26-195e-4584-b00f-4e8703a5f77b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:49.081189 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17d2a26-195e-4584-b00f-4e8703a5f77b None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:49.081470 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17d2a26-195e-4584-b00f-4e8703a5f77b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:49.081743 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17d2a26-195e-4584-b00f-4e8703a5f77b None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:49.082457 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17d2a26-195e-4584-b00f-4e8703a5f77b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:49.082761 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17d2a26-195e-4584-b00f-4e8703a5f77b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:49.084192 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17d2a26-195e-4584-b00f-4e8703a5f77b None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:49.091916 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 438/901] 10.222.0.42 () {56 vars in 1126 bytes} [Mon Jul 4 09:05:48 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:05:49.099246 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17d2a26-195e-4584-b00f-4e8703a5f77b None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:49.168675 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9faf784-bbfe-4bdc-b358-a815a3835744 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:49.214922 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ce17bf-f2ba-4b35-ba61-d024c97b0462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:49.216650 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce17bf-f2ba-4b35-ba61-d024c97b0462 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:49.217117 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce17bf-f2ba-4b35-ba61-d024c97b0462 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:49.217803 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce17bf-f2ba-4b35-ba61-d024c97b0462 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:49.224621 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17d2a26-195e-4584-b00f-4e8703a5f77b None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:49.254940 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:49.261603 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd0eb4f-a0a5-4b73-8fdd-ffd1543b61b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:49.262339 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd0eb4f-a0a5-4b73-8fdd-ffd1543b61b4 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:49.262801 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd0eb4f-a0a5-4b73-8fdd-ffd1543b61b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:49.263920 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd0eb4f-a0a5-4b73-8fdd-ffd1543b61b4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:49.264846 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd0eb4f-a0a5-4b73-8fdd-ffd1543b61b4 None admin] RBAC: Adding query filter params (interface=public, service_id=b0cf558a823b49fb976e78ce1cf38555, region_id=RegionOne) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:49.265252 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd0eb4f-a0a5-4b73-8fdd-ffd1543b61b4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:49.266885 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd0eb4f-a0a5-4b73-8fdd-ffd1543b61b4 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:49.276971 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 439/902] 10.222.0.42 () {56 vars in 1251 bytes} [Mon Jul 4 09:05:49 2022] GET /identity/v3/endpoints?service_id=b0cf558a823b49fb976e78ce1cf38555&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:05:49.278394 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd0eb4f-a0a5-4b73-8fdd-ffd1543b61b4 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:49.308186 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ce17bf-f2ba-4b35-ba61-d024c97b0462 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:49.309605 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ce17bf-f2ba-4b35-ba61-d024c97b0462 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:49.330960 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:49.391087 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd0eb4f-a0a5-4b73-8fdd-ffd1543b61b4 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:49.417708 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 464/903] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jul 4 09:05:49 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 04 09:05:49.419651 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d828c7d6-b2a7-4349-b697-e02e90bb4d78 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:49.419961 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d828c7d6-b2a7-4349-b697-e02e90bb4d78 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:49.420238 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d828c7d6-b2a7-4349-b697-e02e90bb4d78 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:49.424099 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 465/904] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:05:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:05:49.424926 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d828c7d6-b2a7-4349-b697-e02e90bb4d78 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:49.432522 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4af6c4-08c6-438d-a7b9-0bdd062881db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:49.433836 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4af6c4-08c6-438d-a7b9-0bdd062881db None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:49.434295 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4af6c4-08c6-438d-a7b9-0bdd062881db None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:49.434846 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4af6c4-08c6-438d-a7b9-0bdd062881db None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:49.436076 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4af6c4-08c6-438d-a7b9-0bdd062881db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:49.438272 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4af6c4-08c6-438d-a7b9-0bdd062881db None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:49.446136 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 440/905] 10.222.0.42 () {56 vars in 1087 bytes} [Mon Jul 4 09:05:49 2022] GET /identity/v3/services => generated 1268 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:05:49.447933 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b78065f-5a9b-4a18-898a-85b7ad3bbb35 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:49.448406 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b78065f-5a9b-4a18-898a-85b7ad3bbb35 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:49.449020 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b78065f-5a9b-4a18-898a-85b7ad3bbb35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:49.475430 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-8b78065f-5a9b-4a18-898a-85b7ad3bbb35 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:05:49.475430 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-8b78065f-5a9b-4a18-898a-85b7ad3bbb35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:05:49.551577 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:49.551842 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d828c7d6-b2a7-4349-b697-e02e90bb4d78 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:49.579982 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 441/906] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:05:49 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:05:49.583713 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:49.602860 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367bc885-54b4-4dc0-9ffa-4d586d3577e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:49.603670 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367bc885-54b4-4dc0-9ffa-4d586d3577e2 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:49.604074 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367bc885-54b4-4dc0-9ffa-4d586d3577e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:49.604357 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367bc885-54b4-4dc0-9ffa-4d586d3577e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:49.608956 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b78065f-5a9b-4a18-898a-85b7ad3bbb35 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:49.617139 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367bc885-54b4-4dc0-9ffa-4d586d3577e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:49.619031 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367bc885-54b4-4dc0-9ffa-4d586d3577e2 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:49.637215 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-367bc885-54b4-4dc0-9ffa-4d586d3577e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:49.637215 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:49.637215 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:49.637215 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:49.637215 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:49.637215 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:49.637215 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:49.637215 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:49.637215 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:49.637215 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:49.637215 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:49.637215 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:49.637215 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:05:49.637215 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:05:49.637215 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:05:49.638160 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:05:49.638160 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:49.638160 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:49.638160 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:49.638160 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:49.638160 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:49.638160 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:49.638160 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:49.638160 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:49.638160 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:49.638160 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:49.638160 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:49.638160 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:49.638160 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:49.638160 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:49.638160 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:49.638160 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:49.639047 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:05:49.639047 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:05:49.639047 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:49.639047 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:49.640965 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 466/907] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:05:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:49.646683 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367bc885-54b4-4dc0-9ffa-4d586d3577e2 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:49.719038 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b78065f-5a9b-4a18-898a-85b7ad3bbb35 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:49.758908 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5943ed-0acc-415e-a0a9-5b4e2194ee61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:49.759549 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5943ed-0acc-415e-a0a9-5b4e2194ee61 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:49.759837 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5943ed-0acc-415e-a0a9-5b4e2194ee61 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:49.760141 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5943ed-0acc-415e-a0a9-5b4e2194ee61 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:49.760912 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5943ed-0acc-415e-a0a9-5b4e2194ee61 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:49.762349 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5943ed-0acc-415e-a0a9-5b4e2194ee61 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:49.779273 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367bc885-54b4-4dc0-9ffa-4d586d3577e2 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:49.780873 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 442/908] 10.222.0.42 () {60 vars in 1141 bytes} [Mon Jul 4 09:05:49 2022] POST /identity/v3/services => generated 241 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:05:49.828010 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81957d2b-3afc-448c-be8e-2d884afc6337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:49.829071 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81957d2b-3afc-448c-be8e-2d884afc6337 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:49.829555 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81957d2b-3afc-448c-be8e-2d884afc6337 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:49.830092 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81957d2b-3afc-448c-be8e-2d884afc6337 None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:49.831077 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81957d2b-3afc-448c-be8e-2d884afc6337 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:49.831596 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81957d2b-3afc-448c-be8e-2d884afc6337 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:49.833395 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81957d2b-3afc-448c-be8e-2d884afc6337 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:49.847711 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 467/909] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jul 4 09:05:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:05:49.853035 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5943ed-0acc-415e-a0a9-5b4e2194ee61 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:49.910979 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:49.964463 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5943ed-0acc-415e-a0a9-5b4e2194ee61 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:50.000863 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98d518b-8ab5-4e14-a55f-c715ae085863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:50.001661 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d518b-8ab5-4e14-a55f-c715ae085863 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:50.001940 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d518b-8ab5-4e14-a55f-c715ae085863 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:50.002210 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d518b-8ab5-4e14-a55f-c715ae085863 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:50.009566 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98d518b-8ab5-4e14-a55f-c715ae085863 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:50.011034 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98d518b-8ab5-4e14-a55f-c715ae085863 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:50.026276 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-c98d518b-8ab5-4e14-a55f-c715ae085863 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:05:50.026276 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:50.026276 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:50.026276 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:50.026276 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:50.026276 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:50.026276 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:50.026276 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:50.026276 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:50.026276 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:50.026276 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:50.026276 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:50.026276 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:05:50.026276 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:05:50.026276 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:05:50.027233 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:05:50.027233 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:50.027233 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:50.027233 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:50.027233 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:50.027233 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:50.027233 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:50.027233 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:50.027233 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:50.027233 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:50.027233 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:50.027233 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:50.027233 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:50.027233 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:50.027233 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:50.027233 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:50.027233 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:50.028182 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:05:50.028182 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:05:50.028182 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:05:50.028182 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:05:50.028182 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:05:50.028182 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:05:50.028182 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:05:50.028182 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:50.028182 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 443/910] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jul 4 09:05:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:05:50.033224 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81957d2b-3afc-448c-be8e-2d884afc6337 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:50.064341 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:50.143677 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81957d2b-3afc-448c-be8e-2d884afc6337 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:50.177682 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfbd037-2b45-450b-98c9-8f2cc6e650d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:50.178345 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfbd037-2b45-450b-98c9-8f2cc6e650d4 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:50.178627 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfbd037-2b45-450b-98c9-8f2cc6e650d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:50.178900 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfbd037-2b45-450b-98c9-8f2cc6e650d4 None admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:50.179692 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfbd037-2b45-450b-98c9-8f2cc6e650d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:50.180027 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfbd037-2b45-450b-98c9-8f2cc6e650d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:50.181581 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfbd037-2b45-450b-98c9-8f2cc6e650d4 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:50.194797 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 468/911] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Jul 4 09:05:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:50.200703 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98d518b-8ab5-4e14-a55f-c715ae085863 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:50.306880 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98d518b-8ab5-4e14-a55f-c715ae085863 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:50.317870 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:50.349205 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcee8451-8792-4816-9f00-a2501c27f9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:50.349854 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee8451-8792-4816-9f00-a2501c27f9ec None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:50.350132 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee8451-8792-4816-9f00-a2501c27f9ec None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:50.350402 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee8451-8792-4816-9f00-a2501c27f9ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:50.351227 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcee8451-8792-4816-9f00-a2501c27f9ec None admin] RBAC: Adding query filter params (role.id=a0417473d97f454c914db70e2d6c9f94, scope.project.id=d015d4f3d9d4464983ff561e8e08523c, user.id=bd758d5b21684027b0d199021df0ad2f) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:50.351533 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcee8451-8792-4816-9f00-a2501c27f9ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:50.353008 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcee8451-8792-4816-9f00-a2501c27f9ec None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:50.359050 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 444/912] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Jul 4 09:05:50 2022] GET /identity/v3/role_assignments?user.id=bd758d5b21684027b0d199021df0ad2f&scope.project.id=d015d4f3d9d4464983ff561e8e08523c&role.id=a0417473d97f454c914db70e2d6c9f94 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:50.439418 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0397618-5e7f-411d-8e45-72e8836bb2dc None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:50.439763 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0397618-5e7f-411d-8e45-72e8836bb2dc None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:50.440024 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0397618-5e7f-411d-8e45-72e8836bb2dc None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:50.441765 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 469/913] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:05:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:05:50.447448 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deed7ea-ab7b-4e9d-b184-8332e809e43e None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:50.447736 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deed7ea-ab7b-4e9d-b184-8332e809e43e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:50.448041 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deed7ea-ab7b-4e9d-b184-8332e809e43e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:50.466225 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-0deed7ea-ab7b-4e9d-b184-8332e809e43e None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:05:50.468261 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0deed7ea-ab7b-4e9d-b184-8332e809e43e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:05:50.551840 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 445/914] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:05:50 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:05:50.574790 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0397618-5e7f-411d-8e45-72e8836bb2dc None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:50.665973 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:50.679154 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0397618-5e7f-411d-8e45-72e8836bb2dc None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:50.719269 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d08e4c6-f98c-49d1-a456-7f99d29aba59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:50.720025 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d08e4c6-f98c-49d1-a456-7f99d29aba59 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:50.720310 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d08e4c6-f98c-49d1-a456-7f99d29aba59 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:50.720584 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d08e4c6-f98c-49d1-a456-7f99d29aba59 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:50.721237 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d08e4c6-f98c-49d1-a456-7f99d29aba59 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:50.722628 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d08e4c6-f98c-49d1-a456-7f99d29aba59 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:50.735109 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-7d08e4c6-f98c-49d1-a456-7f99d29aba59 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 04 09:05:50.735109 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:50.735109 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 09:05:50.735109 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 09:05:50.735109 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 09:05:50.735109 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 09:05:50.735109 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 09:05:50.735109 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:05:50.735109 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 04 09:05:50.735109 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:50.735109 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:05:50.735109 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:50.735109 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:50.735109 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:50.735109 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:50.735109 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:50.735109 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:50.736165 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:50.736165 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:50.736165 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:50.736165 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:50.736165 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:50.736165 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:50.736165 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 09:05:50.736165 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 09:05:50.736165 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 09:05:50.736165 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 09:05:50.736165 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:50.736165 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:50.736165 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:50.736165 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:50.736165 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:50.736165 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:50.737017 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:50.737017 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:50.737017 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:50.737017 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:50.737017 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:50.737017 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:50.737017 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:50.737017 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:50.737017 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:50.737017 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:50.737017 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 09:05:50.737017 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:05:50.737017 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 04 09:05:50.737017 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:50.741240 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 470/915] 10.222.0.42 () {56 vars in 1114 bytes} [Mon Jul 4 09:05:50 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:50.742624 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deed7ea-ab7b-4e9d-b184-8332e809e43e None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:50.844537 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deed7ea-ab7b-4e9d-b184-8332e809e43e None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:50.848199 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:50.883693 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac7494b-9a2e-4650-b981-33fc1b343843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:50.884787 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac7494b-9a2e-4650-b981-33fc1b343843 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:50.885272 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac7494b-9a2e-4650-b981-33fc1b343843 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:50.885743 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac7494b-9a2e-4650-b981-33fc1b343843 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:50.886736 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac7494b-9a2e-4650-b981-33fc1b343843 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:50.887287 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac7494b-9a2e-4650-b981-33fc1b343843 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:50.888936 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac7494b-9a2e-4650-b981-33fc1b343843 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:50.895906 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 446/916] 10.222.0.42 () {56 vars in 1114 bytes} [Mon Jul 4 09:05:50 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:50.900942 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d08e4c6-f98c-49d1-a456-7f99d29aba59 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:51.006296 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d08e4c6-f98c-49d1-a456-7f99d29aba59 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:51.040486 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737fcc86-baa3-4955-a804-331ed89e5473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:51.042938 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737fcc86-baa3-4955-a804-331ed89e5473 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:51.043420 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737fcc86-baa3-4955-a804-331ed89e5473 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:51.043969 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737fcc86-baa3-4955-a804-331ed89e5473 None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:51.044940 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737fcc86-baa3-4955-a804-331ed89e5473 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:51.045442 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737fcc86-baa3-4955-a804-331ed89e5473 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:51.047062 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737fcc86-baa3-4955-a804-331ed89e5473 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:51.057229 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 471/917] 10.222.0.42 () {56 vars in 1114 bytes} [Mon Jul 4 09:05:50 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:51.058820 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac7494b-9a2e-4650-b981-33fc1b343843 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:51.164818 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac7494b-9a2e-4650-b981-33fc1b343843 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:51.199290 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70415ac-8260-4ff6-9d4c-58e5264fc420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:51.200107 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70415ac-8260-4ff6-9d4c-58e5264fc420 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:51.200318 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70415ac-8260-4ff6-9d4c-58e5264fc420 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:51.200576 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70415ac-8260-4ff6-9d4c-58e5264fc420 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:51.201326 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70415ac-8260-4ff6-9d4c-58e5264fc420 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:51.202714 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70415ac-8260-4ff6-9d4c-58e5264fc420 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:51.224083 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 447/918] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Jul 4 09:05:51 2022] POST /identity/v3/endpoints => generated 346 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:05:51.612473 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c38c5e-b9e8-4863-8411-c579772e91f6 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:51.612879 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c38c5e-b9e8-4863-8411-c579772e91f6 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:51.613057 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c38c5e-b9e8-4863-8411-c579772e91f6 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:51.614639 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 472/919] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:05:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:05:51.619682 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed1625d-4c1a-4e6e-bd69-d9f0061be58f None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:51.620148 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed1625d-4c1a-4e6e-bd69-d9f0061be58f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:51.620241 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed1625d-4c1a-4e6e-bd69-d9f0061be58f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:51.637359 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-fed1625d-4c1a-4e6e-bd69-d9f0061be58f None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:05:51.638560 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-fed1625d-4c1a-4e6e-bd69-d9f0061be58f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:05:51.655411 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:51.711953 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 448/920] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:05:51 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:05:51.734709 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c38c5e-b9e8-4863-8411-c579772e91f6 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:51.753684 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:51.836414 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c38c5e-b9e8-4863-8411-c579772e91f6 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:51.869896 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f3dc71-6e30-43ec-a65a-77dc0893ba68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:51.870624 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f3dc71-6e30-43ec-a65a-77dc0893ba68 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:51.870899 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f3dc71-6e30-43ec-a65a-77dc0893ba68 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:51.871169 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f3dc71-6e30-43ec-a65a-77dc0893ba68 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:51.872002 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f3dc71-6e30-43ec-a65a-77dc0893ba68 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:51.873327 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f3dc71-6e30-43ec-a65a-77dc0893ba68 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:51.886831 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-89f3dc71-6e30-43ec-a65a-77dc0893ba68 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 04 09:05:51.886831 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:51.886831 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 09:05:51.886831 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 09:05:51.886831 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 09:05:51.886831 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 09:05:51.886831 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 09:05:51.886831 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:05:51.886831 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 04 09:05:51.886831 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:51.886831 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:05:51.886831 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:51.886831 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:51.886831 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:51.886831 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:51.886831 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:51.888078 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:51.888078 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:51.888078 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:51.888078 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:51.888078 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:51.888078 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:51.888078 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:51.888078 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 09:05:51.888078 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 09:05:51.888078 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 09:05:51.888078 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 09:05:51.888078 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:51.888078 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:51.888078 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:51.888078 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:51.888078 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:51.889086 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:51.889086 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:51.889086 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:51.889086 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:51.889086 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:51.889086 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:51.889086 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:51.889086 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:51.889086 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:51.889086 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:51.889086 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:51.889086 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 09:05:51.889086 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:05:51.889086 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 04 09:05:51.889086 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:51.889086 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 473/921] 10.222.0.42 () {56 vars in 1132 bytes} [Mon Jul 4 09:05:51 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:51.893385 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed1625d-4c1a-4e6e-bd69-d9f0061be58f None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:51.919797 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e55505-bb4b-4b1c-a7c4-91af5f22e69b None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:51.920116 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e55505-bb4b-4b1c-a7c4-91af5f22e69b None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:51.920395 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e55505-bb4b-4b1c-a7c4-91af5f22e69b None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:51.921985 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 474/922] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:05:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:05:51.927141 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91d647-01c9-41ae-967e-c69e209d55f1 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:51.927422 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91d647-01c9-41ae-967e-c69e209d55f1 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:51.927684 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91d647-01c9-41ae-967e-c69e209d55f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:51.944820 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-6c91d647-01c9-41ae-967e-c69e209d55f1 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:05:51.946107 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-6c91d647-01c9-41ae-967e-c69e209d55f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:05:52.001820 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed1625d-4c1a-4e6e-bd69-d9f0061be58f None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:52.021823 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 475/923] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:05:51 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 09:05:52.037023 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e0e3e1-e4fe-40be-82e0-792382ac96ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:52.037683 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e0e3e1-e4fe-40be-82e0-792382ac96ca None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:52.037960 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e0e3e1-e4fe-40be-82e0-792382ac96ca None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:52.038229 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e0e3e1-e4fe-40be-82e0-792382ac96ca None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:52.038928 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e0e3e1-e4fe-40be-82e0-792382ac96ca None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:52.039226 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e0e3e1-e4fe-40be-82e0-792382ac96ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:52.040641 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e0e3e1-e4fe-40be-82e0-792382ac96ca None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:52.042974 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c91d647-01c9-41ae-967e-c69e209d55f1 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:52.046082 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 449/924] 10.222.0.42 () {56 vars in 1126 bytes} [Mon Jul 4 09:05:51 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:52.051513 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e0e3e1-e4fe-40be-82e0-792382ac96ca None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:52.057340 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:52.068011 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:52.148957 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c91d647-01c9-41ae-967e-c69e209d55f1 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:52.167395 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e0e3e1-e4fe-40be-82e0-792382ac96ca None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:52.187821 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853c50e9-80f3-493e-8990-c836e80efea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:52.188925 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c50e9-80f3-493e-8990-c836e80efea1 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:52.189479 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c50e9-80f3-493e-8990-c836e80efea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:52.189937 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c50e9-80f3-493e-8990-c836e80efea1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:52.190859 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853c50e9-80f3-493e-8990-c836e80efea1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:52.192535 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853c50e9-80f3-493e-8990-c836e80efea1 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:52.205630 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-853c50e9-80f3-493e-8990-c836e80efea1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 04 09:05:52.205630 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:52.205630 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 09:05:52.205630 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 09:05:52.205630 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 09:05:52.205630 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 09:05:52.205630 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 09:05:52.205630 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:05:52.205630 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 04 09:05:52.205630 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:52.205630 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:05:52.205630 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:52.205630 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:52.205630 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:52.205630 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:52.205630 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:52.205630 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:52.206655 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:52.206655 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:52.206655 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:52.206655 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:52.206655 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:52.206655 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:52.206655 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 09:05:52.206655 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 09:05:52.206655 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 09:05:52.206655 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 09:05:52.206655 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:52.206655 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:52.206655 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:52.206655 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:52.206655 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:52.206655 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:52.207506 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:52.207506 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:52.207506 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:52.207506 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:52.207506 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:52.207506 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:52.207506 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:52.207506 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:52.207506 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:52.207506 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:52.207506 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 09:05:52.207506 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:05:52.207506 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 04 09:05:52.207506 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:52.209601 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97340543-a2f4-4eaa-9f9f-181b39b6f712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:52.210328 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97340543-a2f4-4eaa-9f9f-181b39b6f712 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:52.210745 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 476/925] 10.222.0.42 () {56 vars in 1126 bytes} [Mon Jul 4 09:05:52 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:05:52.212043 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97340543-a2f4-4eaa-9f9f-181b39b6f712 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:52.212509 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97340543-a2f4-4eaa-9f9f-181b39b6f712 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:52.213376 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97340543-a2f4-4eaa-9f9f-181b39b6f712 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:52.213834 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97340543-a2f4-4eaa-9f9f-181b39b6f712 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:52.215440 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97340543-a2f4-4eaa-9f9f-181b39b6f712 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:52.216822 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853c50e9-80f3-493e-8990-c836e80efea1 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:52.225786 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 450/926] 10.222.0.42 () {56 vars in 1126 bytes} [Mon Jul 4 09:05:52 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:05:52.226936 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97340543-a2f4-4eaa-9f9f-181b39b6f712 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:52.306085 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:52.307788 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:52.333870 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97340543-a2f4-4eaa-9f9f-181b39b6f712 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:52.337588 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853c50e9-80f3-493e-8990-c836e80efea1 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:52.369958 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc43d078-580a-4993-a7b3-b78f7e20945b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:52.370632 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43d078-580a-4993-a7b3-b78f7e20945b None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:52.370911 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43d078-580a-4993-a7b3-b78f7e20945b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:52.371185 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43d078-580a-4993-a7b3-b78f7e20945b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:52.372046 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc43d078-580a-4993-a7b3-b78f7e20945b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:52.373474 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc43d078-580a-4993-a7b3-b78f7e20945b None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:52.374517 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc114dd2-7caa-48b2-a373-1e50b5e83f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:52.375267 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc114dd2-7caa-48b2-a373-1e50b5e83f4e None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:52.375725 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc114dd2-7caa-48b2-a373-1e50b5e83f4e None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:52.376154 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc114dd2-7caa-48b2-a373-1e50b5e83f4e None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:52.376949 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc114dd2-7caa-48b2-a373-1e50b5e83f4e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:52.377437 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc114dd2-7caa-48b2-a373-1e50b5e83f4e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:52.379028 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc114dd2-7caa-48b2-a373-1e50b5e83f4e None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:52.387962 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 477/927] 10.222.0.42 () {56 vars in 1122 bytes} [Mon Jul 4 09:05:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:52.392248 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc114dd2-7caa-48b2-a373-1e50b5e83f4e None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:52.398950 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 451/928] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Jul 4 09:05:52 2022] POST /identity/v3/endpoints => generated 347 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:05:52.502681 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e716a0-53d0-4108-8900-65741dfb61bd None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:52.502959 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e716a0-53d0-4108-8900-65741dfb61bd None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:52.503235 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e716a0-53d0-4108-8900-65741dfb61bd None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:52.504988 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 452/929] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:05:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:05:52.510464 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8545dba9-9aa0-4c84-8b59-aa003c26e767 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:52.510754 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8545dba9-9aa0-4c84-8b59-aa003c26e767 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:52.511037 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8545dba9-9aa0-4c84-8b59-aa003c26e767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:52.515463 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc114dd2-7caa-48b2-a373-1e50b5e83f4e None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:52.529668 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-8545dba9-9aa0-4c84-8b59-aa003c26e767 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:05:52.530895 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-8545dba9-9aa0-4c84-8b59-aa003c26e767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:05:52.569560 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e5b2f7-1817-4008-99d2-67c24306dad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:52.571531 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e5b2f7-1817-4008-99d2-67c24306dad0 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:52.571531 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e5b2f7-1817-4008-99d2-67c24306dad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:52.571703 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e5b2f7-1817-4008-99d2-67c24306dad0 None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:52.572469 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e5b2f7-1817-4008-99d2-67c24306dad0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:52.572776 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e5b2f7-1817-4008-99d2-67c24306dad0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:52.574143 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e5b2f7-1817-4008-99d2-67c24306dad0 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:52.577274 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:52.582550 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 478/930] 10.222.0.42 () {56 vars in 1122 bytes} [Mon Jul 4 09:05:52 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:52.588318 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e5b2f7-1817-4008-99d2-67c24306dad0 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:52.618287 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 453/931] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:05:52 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:05:52.641862 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8545dba9-9aa0-4c84-8b59-aa003c26e767 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:52.713189 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:52.713390 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e5b2f7-1817-4008-99d2-67c24306dad0 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:52.753848 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7a4313-5e28-4a21-8657-f6b89fadaa5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:52.754428 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a4313-5e28-4a21-8657-f6b89fadaa5a None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:52.754710 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a4313-5e28-4a21-8657-f6b89fadaa5a None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:52.754985 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a4313-5e28-4a21-8657-f6b89fadaa5a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:52.755782 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7a4313-5e28-4a21-8657-f6b89fadaa5a None admin] RBAC: Adding query filter params (interface=public, service_id=18454f7e6181491499d5792341611f1e, region_id=RegionOne) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:52.756122 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7a4313-5e28-4a21-8657-f6b89fadaa5a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:52.757738 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7a4313-5e28-4a21-8657-f6b89fadaa5a None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:52.760302 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8545dba9-9aa0-4c84-8b59-aa003c26e767 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:52.763825 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 479/932] 10.222.0.42 () {56 vars in 1251 bytes} [Mon Jul 4 09:05:52 2022] GET /identity/v3/endpoints?service_id=18454f7e6181491499d5792341611f1e&interface=public®ion_id=RegionOne => generated 194 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:05:52.769562 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7a4313-5e28-4a21-8657-f6b89fadaa5a None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:52.796585 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b305f2-c070-4bcf-b0e5-ab5a14585810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:52.797770 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b305f2-c070-4bcf-b0e5-ab5a14585810 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:52.798242 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b305f2-c070-4bcf-b0e5-ab5a14585810 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:52.798713 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b305f2-c070-4bcf-b0e5-ab5a14585810 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:52.809484 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b305f2-c070-4bcf-b0e5-ab5a14585810 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:05:52.817942 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-92b305f2-c070-4bcf-b0e5-ab5a14585810 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 04 09:05:52.817942 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:52.817942 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:52.817942 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:52.817942 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:52.817942 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:52.817942 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:52.817942 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:52.817942 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:52.817942 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:52.817942 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:52.817942 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:52.817942 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:05:52.817942 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:05:52.817942 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:05:52.817942 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:05:52.818867 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:05:52.818867 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:05:52.818867 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:05:52.818867 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:05:52.818867 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:52.818867 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:52.818867 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:52.818867 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:52.818867 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:52.818867 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:52.818867 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:52.818867 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:52.818867 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:52.818867 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:52.818867 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:52.818867 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:52.819693 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:52.819693 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:52.819693 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:52.819693 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:52.819693 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:05:52.819693 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:05:52.819693 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:05:52.819693 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:05:52.819693 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:05:52.819693 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:05:52.819693 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 04 09:05:52.819693 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:52.822420 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 454/933] 10.222.0.42 () {56 vars in 1120 bytes} [Mon Jul 4 09:05:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:05:52.829160 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b305f2-c070-4bcf-b0e5-ab5a14585810 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:52.843863 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:52.897616 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7a4313-5e28-4a21-8657-f6b89fadaa5a None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:52.938126 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc89c7e-f247-43b4-97cc-9e2ddca68e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:52.939358 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc89c7e-f247-43b4-97cc-9e2ddca68e24 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:52.939805 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc89c7e-f247-43b4-97cc-9e2ddca68e24 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:52.940512 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc89c7e-f247-43b4-97cc-9e2ddca68e24 None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:52.941627 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc89c7e-f247-43b4-97cc-9e2ddca68e24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:52.943323 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc89c7e-f247-43b4-97cc-9e2ddca68e24 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:52.952158 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 480/934] 10.222.0.42 () {56 vars in 1087 bytes} [Mon Jul 4 09:05:52 2022] GET /identity/v3/services => generated 1497 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:05:52.967842 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b305f2-c070-4bcf-b0e5-ab5a14585810 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:53.000641 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:53.007582 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a9b63f-bd7f-492d-84ec-41d60af102e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:53.008402 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a9b63f-bd7f-492d-84ec-41d60af102e1 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:53.008786 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a9b63f-bd7f-492d-84ec-41d60af102e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:53.009321 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a9b63f-bd7f-492d-84ec-41d60af102e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:53.010200 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a9b63f-bd7f-492d-84ec-41d60af102e1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:53.010575 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a9b63f-bd7f-492d-84ec-41d60af102e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:53.012256 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a9b63f-bd7f-492d-84ec-41d60af102e1 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:53.022452 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 455/935] 10.222.0.42 () {56 vars in 1115 bytes} [Mon Jul 4 09:05:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:05:53.027828 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc89c7e-f247-43b4-97cc-9e2ddca68e24 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:53.138121 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc89c7e-f247-43b4-97cc-9e2ddca68e24 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:53.164636 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:53.174062 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f14f1de-6765-4a8d-aef4-54f435c65316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:53.174858 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14f1de-6765-4a8d-aef4-54f435c65316 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:53.175135 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14f1de-6765-4a8d-aef4-54f435c65316 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:53.175405 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14f1de-6765-4a8d-aef4-54f435c65316 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:53.187051 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f14f1de-6765-4a8d-aef4-54f435c65316 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:53.188545 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f14f1de-6765-4a8d-aef4-54f435c65316 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:53.206113 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-1f14f1de-6765-4a8d-aef4-54f435c65316 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:53.206113 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:53.206113 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:53.206113 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:53.206113 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:53.206113 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:53.206113 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:53.206113 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:53.206113 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:53.206113 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:53.206113 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:53.206113 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:53.206113 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:05:53.206113 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:05:53.206113 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:05:53.207039 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:05:53.207039 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:53.207039 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:53.207039 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:53.207039 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:53.207039 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:53.207039 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:53.207039 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:53.207039 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:53.207039 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:53.207039 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:53.207039 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:53.207039 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:53.207039 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:53.207039 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:53.207039 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:53.207039 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:53.208046 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:05:53.208046 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:05:53.208046 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:53.208046 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:53.208046 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 481/936] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:05:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:05:53.214507 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a9b63f-bd7f-492d-84ec-41d60af102e1 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:53.321580 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a9b63f-bd7f-492d-84ec-41d60af102e1 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:53.333288 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bce1bd-d314-4215-8989-c033c8e2ba6b None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:53.333579 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bce1bd-d314-4215-8989-c033c8e2ba6b None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:53.333841 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bce1bd-d314-4215-8989-c033c8e2ba6b None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:53.335446 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 482/937] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:05:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:05:53.340162 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41906fdb-7808-4470-ac93-84b0b7220db3 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:53.340446 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41906fdb-7808-4470-ac93-84b0b7220db3 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:53.340914 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41906fdb-7808-4470-ac93-84b0b7220db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:53.356317 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfffc534-6f73-43c9-95b4-b860bda19bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:53.356982 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfffc534-6f73-43c9-95b4-b860bda19bcc None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:53.357264 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfffc534-6f73-43c9-95b4-b860bda19bcc None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:53.357544 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfffc534-6f73-43c9-95b4-b860bda19bcc None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:53.358264 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfffc534-6f73-43c9-95b4-b860bda19bcc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:53.358568 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfffc534-6f73-43c9-95b4-b860bda19bcc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:53.360308 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfffc534-6f73-43c9-95b4-b860bda19bcc None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:53.361239 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-41906fdb-7808-4470-ac93-84b0b7220db3 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:05:53.362643 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-41906fdb-7808-4470-ac93-84b0b7220db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:05:53.373081 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 456/938] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jul 4 09:05:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:53.379929 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfffc534-6f73-43c9-95b4-b860bda19bcc None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:53.427182 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:53.437977 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 483/939] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:05:53 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 09:05:53.461002 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41906fdb-7808-4470-ac93-84b0b7220db3 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:53.485430 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfffc534-6f73-43c9-95b4-b860bda19bcc None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:53.521949 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b31b99-d118-48c1-bf52-6e7662079cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:53.522753 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b31b99-d118-48c1-bf52-6e7662079cea None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:53.523037 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b31b99-d118-48c1-bf52-6e7662079cea None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:53.523309 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b31b99-d118-48c1-bf52-6e7662079cea None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:53.531976 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b31b99-d118-48c1-bf52-6e7662079cea None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:53.533992 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b31b99-d118-48c1-bf52-6e7662079cea None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:53.551974 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-b3b31b99-d118-48c1-bf52-6e7662079cea None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 04 09:05:53.551974 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:53.551974 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:53.551974 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:53.551974 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:53.551974 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:53.551974 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:53.551974 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:53.551974 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:53.551974 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:53.551974 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:53.551974 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:53.551974 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:05:53.551974 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:05:53.551974 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:05:53.551974 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:05:53.553183 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:53.553183 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:53.553183 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:05:53.553183 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:05:53.553183 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:05:53.553183 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:05:53.553183 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:53.553183 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:53.553183 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:53.553183 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:53.553183 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:53.553183 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:53.553183 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:53.553183 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:53.553183 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:53.553183 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:53.553183 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:53.553183 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:53.554325 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:53.554325 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:53.554325 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:05:53.554325 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:05:53.554325 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:05:53.554325 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:05:53.554325 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:05:53.554325 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:05:53.554325 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 04 09:05:53.554325 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:53.554325 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 457/940] 10.222.0.42 () {56 vars in 1117 bytes} [Mon Jul 4 09:05:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:05:53.561825 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b31b99-d118-48c1-bf52-6e7662079cea None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:53.579167 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41906fdb-7808-4470-ac93-84b0b7220db3 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:53.595163 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:53.616928 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d719b7bb-1409-4bfc-8533-0843250a30d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:53.617883 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719b7bb-1409-4bfc-8533-0843250a30d0 None admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:53.618166 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719b7bb-1409-4bfc-8533-0843250a30d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:53.618443 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719b7bb-1409-4bfc-8533-0843250a30d0 None admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:53.619152 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d719b7bb-1409-4bfc-8533-0843250a30d0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:53.620627 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d719b7bb-1409-4bfc-8533-0843250a30d0 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:53.622055 dv-cinder-844563-4-smb devstack@keystone.service[80182]: WARNING keystone.server.flask.common [None req-d719b7bb-1409-4bfc-8533-0843250a30d0 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 04 09:05:53.642009 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.sql.core [None req-d719b7bb-1409-4bfc-8533-0843250a30d0 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 04 09:05:53.642009 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 04 09:05:53.642009 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [parameters: {'id': '0f8f6276762d47b0bb2b7b2ffb50bcf2', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 04 09:05:53.642009 dv-cinder-844563-4-smb devstack@keystone.service[80182]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80182) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 04 09:05:53.652709 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-d719b7bb-1409-4bfc-8533-0843250a30d0 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0f8f6276762d47b0bb2b7b2ffb50bcf2.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0f8f6276762d47b0bb2b7b2ffb50bcf2. Jul 04 09:05:53.652709 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:53.652709 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 04 09:05:53.652709 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 04 09:05:53.652709 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 04 09:05:53.652709 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 04 09:05:53.652709 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 04 09:05:53.652709 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application result = self._query(query) Jul 04 09:05:53.652709 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 04 09:05:53.652709 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application conn.query(q) Jul 04 09:05:53.652709 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 04 09:05:53.652709 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 04 09:05:53.652709 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 04 09:05:53.653673 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application result.read() Jul 04 09:05:53.653673 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 04 09:05:53.653673 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 04 09:05:53.653673 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 04 09:05:53.653673 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 04 09:05:53.653673 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 04 09:05:53.653673 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 04 09:05:53.653673 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 04 09:05:53.653673 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 04 09:05:53.653673 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 04 09:05:53.653673 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:53.653673 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 04 09:05:53.653673 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:53.653673 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:53.653673 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 04 09:05:53.653673 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 04 09:05:53.653673 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 04 09:05:53.653673 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 04 09:05:53.655256 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 04 09:05:53.655256 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application next(self.gen) Jul 04 09:05:53.655256 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 04 09:05:53.655256 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application yield resource Jul 04 09:05:53.655256 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 04 09:05:53.655256 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application next(self.gen) Jul 04 09:05:53.655256 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 04 09:05:53.655256 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application self.session.rollback() Jul 04 09:05:53.655256 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 04 09:05:53.655256 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application self.force_reraise() Jul 04 09:05:53.655256 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 04 09:05:53.655256 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise self.value Jul 04 09:05:53.655256 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 04 09:05:53.655256 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 04 09:05:53.655256 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 04 09:05:53.655256 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application session.commit() Jul 04 09:05:53.655256 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 04 09:05:53.656251 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 04 09:05:53.656251 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 04 09:05:53.656251 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._prepare_impl() Jul 04 09:05:53.656251 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 04 09:05:53.656251 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application self.session.flush() Jul 04 09:05:53.656251 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 04 09:05:53.656251 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._flush(objects) Jul 04 09:05:53.656251 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 04 09:05:53.656251 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 04 09:05:53.656251 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 04 09:05:53.656251 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application compat.raise_( Jul 04 09:05:53.656251 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 04 09:05:53.656251 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception Jul 04 09:05:53.656251 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 04 09:05:53.656251 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application flush_context.execute() Jul 04 09:05:53.656251 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 04 09:05:53.656251 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rec.execute(self) Jul 04 09:05:53.657158 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 04 09:05:53.657158 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 04 09:05:53.657158 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 04 09:05:53.657158 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 04 09:05:53.657158 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 04 09:05:53.657158 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 04 09:05:53.657158 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 04 09:05:53.657158 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 04 09:05:53.657158 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 04 09:05:53.657158 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 04 09:05:53.657158 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 04 09:05:53.657158 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 04 09:05:53.657158 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 04 09:05:53.657158 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 04 09:05:53.657158 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 04 09:05:53.657948 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 04 09:05:53.657948 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 04 09:05:53.657948 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception Jul 04 09:05:53.657948 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 04 09:05:53.657948 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 04 09:05:53.657948 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 04 09:05:53.657948 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 04 09:05:53.657948 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 04 09:05:53.657948 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application result = self._query(query) Jul 04 09:05:53.657948 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 04 09:05:53.657948 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application conn.query(q) Jul 04 09:05:53.657948 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 04 09:05:53.657948 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 04 09:05:53.657948 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 04 09:05:53.657948 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application result.read() Jul 04 09:05:53.657948 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 04 09:05:53.657948 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 04 09:05:53.660104 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 04 09:05:53.660104 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 04 09:05:53.660104 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 04 09:05:53.660104 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 04 09:05:53.660104 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 04 09:05:53.660104 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 04 09:05:53.660104 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 04 09:05:53.660104 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 04 09:05:53.660104 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [parameters: {'id': '0f8f6276762d47b0bb2b7b2ffb50bcf2', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 04 09:05:53.660104 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 04 09:05:53.660104 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:53.660104 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:05:53.660104 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:53.660104 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:53.660104 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 04 09:05:53.661974 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 04 09:05:53.661974 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 04 09:05:53.661974 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 04 09:05:53.661974 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 04 09:05:53.661974 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:53.661974 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:05:53.661974 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:53.661974 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:53.661974 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:53.661974 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:53.661974 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:53.661974 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:53.661974 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:53.661974 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:53.661974 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:53.661974 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:53.661974 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:53.664550 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:53.664550 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 04 09:05:53.664550 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 04 09:05:53.664550 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:53.664550 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:53.664550 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 04 09:05:53.664550 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 04 09:05:53.664550 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0f8f6276762d47b0bb2b7b2ffb50bcf2. Jul 04 09:05:53.664550 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:53.664550 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 484/941] 10.222.0.42 () {60 vars in 1140 bytes} [Mon Jul 4 09:05:53 2022] POST /identity/v3/projects => generated 262 bytes in 194 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:05:53.664550 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d719b7bb-1409-4bfc-8533-0843250a30d0 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:53.704223 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b31b99-d118-48c1-bf52-6e7662079cea None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:53.707778 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:53.751307 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713f9889-c7a7-4791-a301-b4f78218c1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:53.752664 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f9889-c7a7-4791-a301-b4f78218c1b0 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:53.752955 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f9889-c7a7-4791-a301-b4f78218c1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:53.753231 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f9889-c7a7-4791-a301-b4f78218c1b0 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:53.754085 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713f9889-c7a7-4791-a301-b4f78218c1b0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:53.754397 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713f9889-c7a7-4791-a301-b4f78218c1b0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:53.755855 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713f9889-c7a7-4791-a301-b4f78218c1b0 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:53.782442 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 458/942] 10.222.0.42 () {56 vars in 1149 bytes} [Mon Jul 4 09:05:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:05:53.788211 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713f9889-c7a7-4791-a301-b4f78218c1b0 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:53.796876 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d719b7bb-1409-4bfc-8533-0843250a30d0 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:53.833362 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f86506d-11f8-4121-a420-829fc2ce13ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:53.834574 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86506d-11f8-4121-a420-829fc2ce13ef None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:53.835113 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86506d-11f8-4121-a420-829fc2ce13ef None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:53.835605 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86506d-11f8-4121-a420-829fc2ce13ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:53.844080 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f86506d-11f8-4121-a420-829fc2ce13ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:53.846003 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f86506d-11f8-4121-a420-829fc2ce13ef None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:53.862360 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-5f86506d-11f8-4121-a420-829fc2ce13ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:05:53.862360 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:53.862360 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:53.862360 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:53.862360 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:53.862360 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:53.862360 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:53.862360 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:53.862360 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:53.862360 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:53.862360 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:53.862360 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:53.862360 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:05:53.862360 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:05:53.862360 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:05:53.863246 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:05:53.863246 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:53.863246 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:53.863246 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:53.863246 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:53.863246 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:53.863246 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:53.863246 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:53.863246 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:53.863246 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:53.863246 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:53.863246 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:53.863246 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:53.863246 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:53.863246 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:53.863246 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:53.863246 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:53.864256 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:05:53.864256 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:05:53.864256 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:05:53.864256 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:05:53.864256 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:05:53.864256 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:05:53.864256 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:05:53.864256 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:53.867106 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 485/943] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jul 4 09:05:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:53.875455 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f86506d-11f8-4121-a420-829fc2ce13ef None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:53.892858 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713f9889-c7a7-4791-a301-b4f78218c1b0 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:53.914640 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:53.939730 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7e5dea-9577-4838-92bd-5dcdd0840e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:53.941217 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7e5dea-9577-4838-92bd-5dcdd0840e3e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:53.941644 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7e5dea-9577-4838-92bd-5dcdd0840e3e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:53.942065 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7e5dea-9577-4838-92bd-5dcdd0840e3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:53.956310 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7e5dea-9577-4838-92bd-5dcdd0840e3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:53.958967 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7e5dea-9577-4838-92bd-5dcdd0840e3e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:53.983575 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-ce7e5dea-9577-4838-92bd-5dcdd0840e3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:53.983575 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:53.983575 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:53.983575 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:53.983575 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:53.983575 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:53.983575 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:53.983575 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:53.983575 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:53.983575 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:53.983575 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:53.983575 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:53.983575 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:05:53.983575 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:05:53.983575 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:05:53.985026 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:05:53.985026 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:53.985026 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:53.985026 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:53.985026 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:53.985026 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:53.985026 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:53.985026 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:53.985026 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:53.985026 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:53.985026 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:53.985026 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:53.985026 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:53.985026 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:53.985026 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:53.985026 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:53.985026 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:53.986133 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:05:53.986133 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:05:53.986133 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:53.986133 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:53.987926 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 459/944] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:05:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:53.993231 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7e5dea-9577-4838-92bd-5dcdd0840e3e None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:54.007598 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f86506d-11f8-4121-a420-829fc2ce13ef None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:54.014697 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:54.053924 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd234ea5-6fed-47f3-8e55-83f86ab930a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:54.054583 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd234ea5-6fed-47f3-8e55-83f86ab930a1 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:54.054887 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd234ea5-6fed-47f3-8e55-83f86ab930a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:54.055391 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd234ea5-6fed-47f3-8e55-83f86ab930a1 None admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:54.056646 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd234ea5-6fed-47f3-8e55-83f86ab930a1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:54.056946 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd234ea5-6fed-47f3-8e55-83f86ab930a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:54.058652 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd234ea5-6fed-47f3-8e55-83f86ab930a1 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:54.084390 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 486/945] 10.222.0.42 () {56 vars in 1112 bytes} [Mon Jul 4 09:05:53 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:05:54.126800 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7e5dea-9577-4838-92bd-5dcdd0840e3e None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:54.166225 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165ea3f4-7e9a-4f69-b7c3-a1113a3c3dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:54.167167 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ea3f4-7e9a-4f69-b7c3-a1113a3c3dd8 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:54.167625 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ea3f4-7e9a-4f69-b7c3-a1113a3c3dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:54.168084 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ea3f4-7e9a-4f69-b7c3-a1113a3c3dd8 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:54.169043 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165ea3f4-7e9a-4f69-b7c3-a1113a3c3dd8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:54.169507 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165ea3f4-7e9a-4f69-b7c3-a1113a3c3dd8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:54.171080 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165ea3f4-7e9a-4f69-b7c3-a1113a3c3dd8 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:54.184621 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 460/946] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jul 4 09:05:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:05:54.190510 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd234ea5-6fed-47f3-8e55-83f86ab930a1 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:54.282094 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:54.299314 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd234ea5-6fed-47f3-8e55-83f86ab930a1 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:54.334632 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a94ac35-e769-4c67-8105-e48c89a6c26c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:54.335357 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a94ac35-e769-4c67-8105-e48c89a6c26c None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:54.335643 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a94ac35-e769-4c67-8105-e48c89a6c26c None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:54.335953 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a94ac35-e769-4c67-8105-e48c89a6c26c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:54.343103 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a94ac35-e769-4c67-8105-e48c89a6c26c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:54.344596 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a94ac35-e769-4c67-8105-e48c89a6c26c None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:54.358527 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-8a94ac35-e769-4c67-8105-e48c89a6c26c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:05:54.358527 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:54.358527 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:54.358527 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:54.358527 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:54.358527 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:54.358527 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:54.358527 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:54.358527 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:54.358527 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:54.358527 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:54.358527 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:54.358527 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:05:54.358527 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:05:54.358527 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:05:54.360353 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:05:54.360353 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:54.360353 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:54.360353 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:54.360353 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:54.360353 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:54.360353 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:54.360353 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:54.360353 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:54.360353 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:54.360353 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:54.360353 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:54.360353 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:54.360353 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:54.360353 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:54.360353 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:54.360353 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:54.361511 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:05:54.361511 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:05:54.361511 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:05:54.361511 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:05:54.361511 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:05:54.361511 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:05:54.361511 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:05:54.361511 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:54.361511 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 487/947] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jul 4 09:05:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:54.366228 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165ea3f4-7e9a-4f69-b7c3-a1113a3c3dd8 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:54.442882 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:54.469427 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165ea3f4-7e9a-4f69-b7c3-a1113a3c3dd8 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:54.504602 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa714589-93a2-44f3-ad43-2e10f3a81680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:54.505265 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa714589-93a2-44f3-ad43-2e10f3a81680 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:54.505549 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa714589-93a2-44f3-ad43-2e10f3a81680 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:54.505822 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa714589-93a2-44f3-ad43-2e10f3a81680 None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:54.506615 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa714589-93a2-44f3-ad43-2e10f3a81680 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:54.506925 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa714589-93a2-44f3-ad43-2e10f3a81680 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:54.508420 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa714589-93a2-44f3-ad43-2e10f3a81680 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:54.521362 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 461/948] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Jul 4 09:05:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:54.527200 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a94ac35-e769-4c67-8105-e48c89a6c26c None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:54.599362 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c01987-4476-4210-81b4-1d83ad5d2995 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:54.599362 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c01987-4476-4210-81b4-1d83ad5d2995 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:54.599362 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c01987-4476-4210-81b4-1d83ad5d2995 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:54.599362 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 462/949] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:05:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:05:54.605145 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574a7345-713f-4d2a-b927-f61c3ae2a223 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:54.605559 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574a7345-713f-4d2a-b927-f61c3ae2a223 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:54.605954 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574a7345-713f-4d2a-b927-f61c3ae2a223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:54.623296 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-574a7345-713f-4d2a-b927-f61c3ae2a223 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:05:54.624772 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-574a7345-713f-4d2a-b927-f61c3ae2a223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:05:54.637745 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a94ac35-e769-4c67-8105-e48c89a6c26c None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:54.684516 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b03030-9ac3-4ec2-982c-989d66b2ad61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:54.685669 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b03030-9ac3-4ec2-982c-989d66b2ad61 None admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:54.685961 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b03030-9ac3-4ec2-982c-989d66b2ad61 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:54.686639 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b03030-9ac3-4ec2-982c-989d66b2ad61 None admin] PATH_INFO: `/v3/projects/d015d4f3d9d4464983ff561e8e08523c/users/bd758d5b21684027b0d199021df0ad2f/roles/a0417473d97f454c914db70e2d6c9f94` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:54.689987 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b03030-9ac3-4ec2-982c-989d66b2ad61 None admin] RBAC: Authorizing `identity:create_grant(project_id=d015d4f3d9d4464983ff561e8e08523c, user_id=bd758d5b21684027b0d199021df0ad2f, role_id=a0417473d97f454c914db70e2d6c9f94)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:54.691969 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b03030-9ac3-4ec2-982c-989d66b2ad61 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:54.696780 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 463/950] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:05:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:05:54.710794 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 488/951] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Jul 4 09:05:54 2022] PUT /identity/v3/projects/d015d4f3d9d4464983ff561e8e08523c/users/bd758d5b21684027b0d199021df0ad2f/roles/a0417473d97f454c914db70e2d6c9f94 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:05:54.724446 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574a7345-713f-4d2a-b927-f61c3ae2a223 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:54.802190 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:54.845667 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574a7345-713f-4d2a-b927-f61c3ae2a223 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:54.890297 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7729bd-e3aa-4f3e-9996-72f82e018a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:54.890297 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7729bd-e3aa-4f3e-9996-72f82e018a6b None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:54.896794 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7729bd-e3aa-4f3e-9996-72f82e018a6b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:54.896794 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7729bd-e3aa-4f3e-9996-72f82e018a6b None admin] PATH_INFO: `/v3/services/compute` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:54.896794 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7729bd-e3aa-4f3e-9996-72f82e018a6b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:54.896794 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7729bd-e3aa-4f3e-9996-72f82e018a6b None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:54.907088 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-fd7729bd-e3aa-4f3e-9996-72f82e018a6b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 04 09:05:54.907088 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:54.907088 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 09:05:54.907088 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 09:05:54.907088 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 09:05:54.907088 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 09:05:54.907088 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 09:05:54.907088 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:05:54.907088 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 04 09:05:54.907088 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:54.907088 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:05:54.907088 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:54.907088 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:54.907088 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:54.907088 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:54.907088 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:54.907088 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:54.908370 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:54.908370 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:54.908370 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:54.908370 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:54.908370 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:54.908370 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:54.908370 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 09:05:54.908370 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 09:05:54.908370 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 09:05:54.908370 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 09:05:54.908370 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:54.908370 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:54.908370 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:54.908370 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:54.908370 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:54.908370 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:54.909376 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:54.909376 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:54.909376 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:54.909376 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:54.909376 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:54.909376 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:54.909376 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:54.909376 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:54.909376 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:54.909376 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:54.909376 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 09:05:54.909376 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:05:54.909376 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 04 09:05:54.909376 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:54.910177 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 464/952] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jul 4 09:05:54 2022] GET /identity/v3/services/compute => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:54.917225 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b03030-9ac3-4ec2-982c-989d66b2ad61 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:54.919574 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:55.019675 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b03030-9ac3-4ec2-982c-989d66b2ad61 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:55.034801 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d945b-f493-4992-9ea9-dc6e7c53297d None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:55.035115 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d945b-f493-4992-9ea9-dc6e7c53297d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:55.035356 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d945b-f493-4992-9ea9-dc6e7c53297d None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:55.037020 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 465/953] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:05:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:05:55.042128 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea511244-c34a-43cd-aa65-9150c909bec6 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:55.042407 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea511244-c34a-43cd-aa65-9150c909bec6 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:55.042677 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea511244-c34a-43cd-aa65-9150c909bec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:55.055544 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eb6d16-319a-4058-8790-ea1f0ff1afd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:55.056242 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb6d16-319a-4058-8790-ea1f0ff1afd0 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:55.057028 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb6d16-319a-4058-8790-ea1f0ff1afd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:55.057308 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb6d16-319a-4058-8790-ea1f0ff1afd0 None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:55.058290 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eb6d16-319a-4058-8790-ea1f0ff1afd0 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:55.058603 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eb6d16-319a-4058-8790-ea1f0ff1afd0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:55.060044 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eb6d16-319a-4058-8790-ea1f0ff1afd0 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:55.062615 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-ea511244-c34a-43cd-aa65-9150c909bec6 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:05:55.064158 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ea511244-c34a-43cd-aa65-9150c909bec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:05:55.067947 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 489/954] 10.222.0.42 () {56 vars in 1112 bytes} [Mon Jul 4 09:05:54 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:55.072139 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eb6d16-319a-4058-8790-ea1f0ff1afd0 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:55.159534 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 466/955] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:05:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 09:05:55.165330 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:55.180999 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea511244-c34a-43cd-aa65-9150c909bec6 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:55.205058 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eb6d16-319a-4058-8790-ea1f0ff1afd0 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:55.252879 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd55b8a8-8f0b-4bf4-aa1f-db0000338f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:55.254116 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55b8a8-8f0b-4bf4-aa1f-db0000338f20 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:55.254883 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:55.255233 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55b8a8-8f0b-4bf4-aa1f-db0000338f20 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:55.256079 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55b8a8-8f0b-4bf4-aa1f-db0000338f20 None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:55.256830 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd55b8a8-8f0b-4bf4-aa1f-db0000338f20 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:55.257170 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd55b8a8-8f0b-4bf4-aa1f-db0000338f20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:55.258662 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd55b8a8-8f0b-4bf4-aa1f-db0000338f20 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:55.271899 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 490/956] 10.222.0.42 () {56 vars in 1112 bytes} [Mon Jul 4 09:05:55 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:05:55.311028 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea511244-c34a-43cd-aa65-9150c909bec6 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:55.349767 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dc2028-25db-4a7a-8aa4-a880bae89b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:55.350597 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc2028-25db-4a7a-8aa4-a880bae89b73 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:55.350873 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc2028-25db-4a7a-8aa4-a880bae89b73 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:55.351148 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc2028-25db-4a7a-8aa4-a880bae89b73 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:55.351816 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dc2028-25db-4a7a-8aa4-a880bae89b73 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:55.353272 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dc2028-25db-4a7a-8aa4-a880bae89b73 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:55.366434 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-f1dc2028-25db-4a7a-8aa4-a880bae89b73 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 04 09:05:55.366434 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:55.366434 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 09:05:55.366434 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 09:05:55.366434 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 09:05:55.366434 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 09:05:55.366434 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 09:05:55.366434 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:05:55.366434 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 04 09:05:55.366434 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:55.366434 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:05:55.366434 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:55.366434 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:55.366434 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:55.366434 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:55.366434 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:55.366434 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:55.367548 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:55.367548 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:55.367548 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:55.367548 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:55.367548 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:55.367548 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:55.367548 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 09:05:55.367548 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 09:05:55.367548 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 09:05:55.367548 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 09:05:55.367548 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:55.367548 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:55.367548 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:55.367548 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:55.367548 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:55.367548 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:55.368831 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:55.368831 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:55.368831 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:55.368831 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:55.368831 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:55.368831 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:55.368831 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:55.368831 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:55.368831 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:55.368831 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:55.368831 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 09:05:55.368831 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:05:55.368831 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 04 09:05:55.368831 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:55.368831 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 467/957] 10.222.0.42 () {56 vars in 1126 bytes} [Mon Jul 4 09:05:55 2022] GET /identity/v3/services/object-store => generated 93 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:05:55.374285 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd55b8a8-8f0b-4bf4-aa1f-db0000338f20 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:55.480136 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd55b8a8-8f0b-4bf4-aa1f-db0000338f20 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:55.510487 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:55.515716 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140eea16-0e7b-4958-a786-4e767b86e6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:55.516609 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140eea16-0e7b-4958-a786-4e767b86e6d4 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:55.517072 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140eea16-0e7b-4958-a786-4e767b86e6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:55.517528 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140eea16-0e7b-4958-a786-4e767b86e6d4 None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:55.518237 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140eea16-0e7b-4958-a786-4e767b86e6d4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:55.518542 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140eea16-0e7b-4958-a786-4e767b86e6d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:55.519941 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140eea16-0e7b-4958-a786-4e767b86e6d4 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:55.525026 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 491/958] 10.222.0.42 () {56 vars in 1122 bytes} [Mon Jul 4 09:05:55 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:55.530773 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dc2028-25db-4a7a-8aa4-a880bae89b73 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:55.635445 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dc2028-25db-4a7a-8aa4-a880bae89b73 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:55.657630 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:55.670466 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc02c076-ee10-4c74-affb-8d93d07d365d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:55.671128 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc02c076-ee10-4c74-affb-8d93d07d365d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:55.671406 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc02c076-ee10-4c74-affb-8d93d07d365d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:55.671676 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc02c076-ee10-4c74-affb-8d93d07d365d None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:55.672412 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc02c076-ee10-4c74-affb-8d93d07d365d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:55.672712 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc02c076-ee10-4c74-affb-8d93d07d365d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:55.674101 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc02c076-ee10-4c74-affb-8d93d07d365d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:55.679507 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 468/959] 10.222.0.42 () {56 vars in 1122 bytes} [Mon Jul 4 09:05:55 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:55.685403 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140eea16-0e7b-4958-a786-4e767b86e6d4 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:55.784637 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140eea16-0e7b-4958-a786-4e767b86e6d4 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:55.819206 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5b38f0-fd46-4b38-9f27-9636dff221e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:55.820274 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b38f0-fd46-4b38-9f27-9636dff221e1 None admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:55.820776 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b38f0-fd46-4b38-9f27-9636dff221e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:55.821252 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b38f0-fd46-4b38-9f27-9636dff221e1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:55.822208 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5b38f0-fd46-4b38-9f27-9636dff221e1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:55.823803 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5b38f0-fd46-4b38-9f27-9636dff221e1 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:55.847011 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 492/960] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Jul 4 09:05:55 2022] POST /identity/v3/endpoints => generated 349 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:05:56.286236 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ba574-0133-48bd-8d41-2d9fb67bc85c None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:56.286774 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ba574-0133-48bd-8d41-2d9fb67bc85c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:56.286774 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ba574-0133-48bd-8d41-2d9fb67bc85c None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:56.288251 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 469/961] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:05:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:05:56.293662 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a884e6-9a21-4eaf-a8d7-e30c3eac7f42 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:56.294107 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a884e6-9a21-4eaf-a8d7-e30c3eac7f42 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:56.294288 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a884e6-9a21-4eaf-a8d7-e30c3eac7f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:56.311660 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-b4a884e6-9a21-4eaf-a8d7-e30c3eac7f42 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:05:56.314002 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-b4a884e6-9a21-4eaf-a8d7-e30c3eac7f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:05:56.362191 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:56.389496 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 493/962] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:05:56 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:05:56.413485 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51ba574-0133-48bd-8d41-2d9fb67bc85c None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:56.516263 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51ba574-0133-48bd-8d41-2d9fb67bc85c None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:56.550272 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09dc4f1-1b12-45bd-bb3f-3172cf6b90ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:56.550866 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09dc4f1-1b12-45bd-bb3f-3172cf6b90ac None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:56.551144 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09dc4f1-1b12-45bd-bb3f-3172cf6b90ac None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:56.551466 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09dc4f1-1b12-45bd-bb3f-3172cf6b90ac None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:56.552228 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09dc4f1-1b12-45bd-bb3f-3172cf6b90ac None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:56.553784 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09dc4f1-1b12-45bd-bb3f-3172cf6b90ac None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:56.555157 dv-cinder-844563-4-smb devstack@keystone.service[80181]: WARNING keystone.server.flask.common [None req-f09dc4f1-1b12-45bd-bb3f-3172cf6b90ac None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 04 09:05:56.574836 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.sql.core [None req-f09dc4f1-1b12-45bd-bb3f-3172cf6b90ac None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 04 09:05:56.574836 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 04 09:05:56.574836 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [parameters: {'user_id': 'c7c345666138468895d61220eec7a0f8', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 04 09:05:56.574836 dv-cinder-844563-4-smb devstack@keystone.service[80181]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80181) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 04 09:05:56.591377 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-f09dc4f1-1b12-45bd-bb3f-3172cf6b90ac None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 04 09:05:56.591377 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:56.591377 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 04 09:05:56.591377 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 04 09:05:56.591377 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 04 09:05:56.591377 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 04 09:05:56.591377 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 04 09:05:56.591377 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application result = self._query(query) Jul 04 09:05:56.591377 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 04 09:05:56.591377 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application conn.query(q) Jul 04 09:05:56.591377 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 04 09:05:56.591377 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 04 09:05:56.591377 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 04 09:05:56.591377 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application result.read() Jul 04 09:05:56.591377 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 04 09:05:56.592649 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 04 09:05:56.592649 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 04 09:05:56.592649 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 04 09:05:56.592649 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 04 09:05:56.592649 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 04 09:05:56.592649 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 04 09:05:56.592649 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 04 09:05:56.592649 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 04 09:05:56.592649 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:56.592649 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 04 09:05:56.592649 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:56.592649 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:56.592649 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 04 09:05:56.592649 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 04 09:05:56.592649 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 04 09:05:56.592649 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 04 09:05:56.592649 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 04 09:05:56.592649 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application next(self.gen) Jul 04 09:05:56.593906 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 04 09:05:56.593906 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application yield resource Jul 04 09:05:56.593906 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 04 09:05:56.593906 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application next(self.gen) Jul 04 09:05:56.593906 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 04 09:05:56.593906 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self.session.rollback() Jul 04 09:05:56.593906 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 04 09:05:56.593906 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self.force_reraise() Jul 04 09:05:56.593906 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 04 09:05:56.593906 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise self.value Jul 04 09:05:56.593906 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 04 09:05:56.593906 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 04 09:05:56.593906 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 04 09:05:56.593906 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application session.commit() Jul 04 09:05:56.593906 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 04 09:05:56.593906 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 04 09:05:56.593906 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 04 09:05:56.595080 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._prepare_impl() Jul 04 09:05:56.595080 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 04 09:05:56.595080 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self.session.flush() Jul 04 09:05:56.595080 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 04 09:05:56.595080 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._flush(objects) Jul 04 09:05:56.595080 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 04 09:05:56.595080 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 04 09:05:56.595080 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 04 09:05:56.595080 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application compat.raise_( Jul 04 09:05:56.595080 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 04 09:05:56.595080 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception Jul 04 09:05:56.595080 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 04 09:05:56.595080 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application flush_context.execute() Jul 04 09:05:56.595080 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 04 09:05:56.595080 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rec.execute(self) Jul 04 09:05:56.595080 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 04 09:05:56.595080 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 04 09:05:56.596273 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 04 09:05:56.596273 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 04 09:05:56.596273 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 04 09:05:56.596273 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 04 09:05:56.596273 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 04 09:05:56.596273 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 04 09:05:56.596273 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 04 09:05:56.596273 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 04 09:05:56.596273 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 04 09:05:56.596273 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 04 09:05:56.596273 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 04 09:05:56.596273 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 04 09:05:56.596273 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 04 09:05:56.596273 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 04 09:05:56.596273 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 04 09:05:56.596273 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception Jul 04 09:05:56.597145 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 04 09:05:56.597145 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 04 09:05:56.597145 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 04 09:05:56.597145 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 04 09:05:56.597145 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 04 09:05:56.597145 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application result = self._query(query) Jul 04 09:05:56.597145 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 04 09:05:56.597145 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application conn.query(q) Jul 04 09:05:56.597145 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 04 09:05:56.597145 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 04 09:05:56.597145 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 04 09:05:56.597145 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application result.read() Jul 04 09:05:56.597145 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 04 09:05:56.597145 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 04 09:05:56.597145 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 04 09:05:56.597145 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 04 09:05:56.598078 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 04 09:05:56.598078 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 04 09:05:56.598078 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 04 09:05:56.598078 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 04 09:05:56.598078 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 04 09:05:56.598078 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 04 09:05:56.598078 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [parameters: {'user_id': 'c7c345666138468895d61220eec7a0f8', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 04 09:05:56.598078 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 04 09:05:56.598078 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:56.598078 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:05:56.598078 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:56.598078 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:56.598078 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:56.598078 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:56.598078 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:56.599142 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:56.599142 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:56.599142 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:56.599142 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:56.599142 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:56.599142 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:56.599142 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:56.599142 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 04 09:05:56.599142 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 04 09:05:56.599142 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:56.599142 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:56.599142 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:05:56.599142 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:05:56.599142 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:05:56.599142 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:05:56.599142 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 04 09:05:56.599142 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 04 09:05:56.600241 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 04 09:05:56.600241 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 04 09:05:56.600241 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 04 09:05:56.600241 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 04 09:05:56.600241 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 04 09:05:56.600241 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:56.602567 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 470/963] 10.222.0.42 () {60 vars in 1131 bytes} [Mon Jul 4 09:05:56 2022] POST /identity/v3/users => generated 160 bytes in 189 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:56.608163 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a884e6-9a21-4eaf-a8d7-e30c3eac7f42 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:56.710777 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a884e6-9a21-4eaf-a8d7-e30c3eac7f42 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:56.745203 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f55deb-3827-45a7-be9c-0059c36da4fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:56.746224 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f55deb-3827-45a7-be9c-0059c36da4fd None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:56.746707 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f55deb-3827-45a7-be9c-0059c36da4fd None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:56.747209 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f55deb-3827-45a7-be9c-0059c36da4fd None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:56.757072 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f55deb-3827-45a7-be9c-0059c36da4fd None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:56.758729 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f55deb-3827-45a7-be9c-0059c36da4fd None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:56.773725 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-94f55deb-3827-45a7-be9c-0059c36da4fd None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 04 09:05:56.773725 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:56.773725 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:56.773725 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:56.773725 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:56.773725 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:56.773725 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:56.773725 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:56.773725 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:56.773725 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:56.773725 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:56.773725 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:56.773725 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:05:56.773725 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:05:56.773725 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:05:56.773725 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:05:56.774923 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:56.774923 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:56.774923 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:05:56.774923 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:05:56.774923 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:05:56.774923 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:05:56.774923 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:56.774923 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:56.774923 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:56.774923 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:56.774923 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:56.774923 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:56.774923 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:56.774923 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:56.774923 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:56.774923 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:56.774923 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:56.774923 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:56.776193 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:56.776193 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:56.776193 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:05:56.776193 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:05:56.776193 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:05:56.776193 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:05:56.776193 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:05:56.776193 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:05:56.776193 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 04 09:05:56.776193 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:56.778662 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 494/964] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jul 4 09:05:56 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:56.785224 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09dc4f1-1b12-45bd-bb3f-3172cf6b90ac None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:56.806899 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faface12-d4bb-4201-8429-8f80b5771bfa None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:56.807387 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faface12-d4bb-4201-8429-8f80b5771bfa None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:56.807809 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faface12-d4bb-4201-8429-8f80b5771bfa None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:56.809858 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 495/965] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:05:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:05:56.818326 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f5dc0-600c-4d32-a6be-b3ceab7d4ca5 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:56.818616 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f5dc0-600c-4d32-a6be-b3ceab7d4ca5 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:56.818895 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f5dc0-600c-4d32-a6be-b3ceab7d4ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:56.837155 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-341f5dc0-600c-4d32-a6be-b3ceab7d4ca5 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:05:56.838356 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-341f5dc0-600c-4d32-a6be-b3ceab7d4ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:05:56.844585 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:56.876378 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:56.909709 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09dc4f1-1b12-45bd-bb3f-3172cf6b90ac None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:56.932967 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 496/966] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:05:56 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 09:05:56.953680 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f4ccd-7eec-4d7e-92df-752248a8d1da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:56.954679 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f4ccd-7eec-4d7e-92df-752248a8d1da None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:56.955151 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f4ccd-7eec-4d7e-92df-752248a8d1da None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:56.955646 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f4ccd-7eec-4d7e-92df-752248a8d1da None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:56.956491 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2f4ccd-7eec-4d7e-92df-752248a8d1da None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:56.956797 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2f4ccd-7eec-4d7e-92df-752248a8d1da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:56.957412 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341f5dc0-600c-4d32-a6be-b3ceab7d4ca5 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:56.958583 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2f4ccd-7eec-4d7e-92df-752248a8d1da None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:57.000018 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 471/967] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Jul 4 09:05:56 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:57.069381 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341f5dc0-600c-4d32-a6be-b3ceab7d4ca5 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:57.108445 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac75ab67-9fa4-4c3f-adb7-fd4c930e67a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:57.109873 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac75ab67-9fa4-4c3f-adb7-fd4c930e67a3 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:57.110300 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac75ab67-9fa4-4c3f-adb7-fd4c930e67a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:57.110727 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac75ab67-9fa4-4c3f-adb7-fd4c930e67a3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:57.123070 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac75ab67-9fa4-4c3f-adb7-fd4c930e67a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:05:57.131680 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-ac75ab67-9fa4-4c3f-adb7-fd4c930e67a3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 04 09:05:57.131680 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:57.131680 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:57.131680 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:57.131680 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:57.131680 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:57.131680 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:57.131680 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:57.131680 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:57.131680 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:57.131680 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:57.131680 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:57.131680 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:05:57.131680 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:05:57.131680 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:05:57.131680 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:05:57.132957 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:05:57.132957 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:05:57.132957 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:05:57.132957 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:05:57.132957 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:57.132957 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:57.132957 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:57.132957 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:57.132957 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:57.132957 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:57.132957 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:57.132957 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:57.132957 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:57.132957 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:57.132957 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:57.132957 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:57.134021 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:57.134021 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:57.134021 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:57.134021 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:57.134021 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:05:57.134021 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:05:57.134021 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:05:57.134021 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:05:57.134021 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:05:57.134021 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:05:57.134021 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 04 09:05:57.134021 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:57.141292 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 497/968] 10.222.0.42 () {56 vars in 1120 bytes} [Mon Jul 4 09:05:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:57.142990 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f4ccd-7eec-4d7e-92df-752248a8d1da None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:57.249517 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f4ccd-7eec-4d7e-92df-752248a8d1da None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:57.257450 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:57.285208 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e46081-cc4b-4276-a023-a65130318bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:57.285883 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e46081-cc4b-4276-a023-a65130318bdd None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:57.286164 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e46081-cc4b-4276-a023-a65130318bdd None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:57.286437 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e46081-cc4b-4276-a023-a65130318bdd None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:57.287185 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e46081-cc4b-4276-a023-a65130318bdd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:57.287490 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e46081-cc4b-4276-a023-a65130318bdd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:57.288911 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e46081-cc4b-4276-a023-a65130318bdd None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:57.297705 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 472/969] 10.222.0.42 () {56 vars in 1115 bytes} [Mon Jul 4 09:05:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:57.303295 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac75ab67-9fa4-4c3f-adb7-fd4c930e67a3 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:57.332788 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:57.408532 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac75ab67-9fa4-4c3f-adb7-fd4c930e67a3 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:57.442266 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1679255d-7c85-4ed6-b358-151b6d0c4a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:57.443061 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1679255d-7c85-4ed6-b358-151b6d0c4a92 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:57.443345 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1679255d-7c85-4ed6-b358-151b6d0c4a92 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:57.443621 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1679255d-7c85-4ed6-b358-151b6d0c4a92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:57.454441 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1679255d-7c85-4ed6-b358-151b6d0c4a92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:57.455905 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1679255d-7c85-4ed6-b358-151b6d0c4a92 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:57.472877 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-1679255d-7c85-4ed6-b358-151b6d0c4a92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:57.472877 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:57.472877 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:57.472877 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:57.472877 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:57.472877 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:57.472877 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:57.472877 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:57.472877 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:57.472877 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:57.472877 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:57.472877 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:57.472877 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:05:57.472877 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:05:57.472877 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:05:57.473818 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:05:57.473818 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:57.473818 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:57.473818 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:57.473818 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:57.473818 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:57.473818 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:57.473818 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:57.473818 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:57.473818 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:57.473818 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:57.473818 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:57.473818 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:57.473818 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:57.473818 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:57.473818 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:57.473818 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:57.474708 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:05:57.474708 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:05:57.474708 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:57.474708 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:57.478710 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 498/970] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:05:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:05:57.480177 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e46081-cc4b-4276-a023-a65130318bdd None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:57.534319 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f2310-c244-40b4-8777-aa47b8423932 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:57.534644 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f2310-c244-40b4-8777-aa47b8423932 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:57.534922 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f2310-c244-40b4-8777-aa47b8423932 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:57.536313 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 499/971] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:05:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:05:57.541602 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee7f43-c325-4e3f-9cfc-11a0b6700b0f None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:57.541887 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee7f43-c325-4e3f-9cfc-11a0b6700b0f None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:57.542150 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee7f43-c325-4e3f-9cfc-11a0b6700b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:57.559129 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-75ee7f43-c325-4e3f-9cfc-11a0b6700b0f None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:05:57.560483 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-75ee7f43-c325-4e3f-9cfc-11a0b6700b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:05:57.595121 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e46081-cc4b-4276-a023-a65130318bdd None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:57.631644 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dffaa7-e018-436c-a1d7-5e2e6ec7000f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:57.632613 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dffaa7-e018-436c-a1d7-5e2e6ec7000f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:57.633103 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dffaa7-e018-436c-a1d7-5e2e6ec7000f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:57.633574 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dffaa7-e018-436c-a1d7-5e2e6ec7000f None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:57.634375 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dffaa7-e018-436c-a1d7-5e2e6ec7000f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:57.634755 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dffaa7-e018-436c-a1d7-5e2e6ec7000f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:57.636163 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dffaa7-e018-436c-a1d7-5e2e6ec7000f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:57.638404 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 500/972] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:05:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:05:57.653060 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 473/973] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jul 4 09:05:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:57.654590 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ee7f43-c325-4e3f-9cfc-11a0b6700b0f None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:57.661422 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dffaa7-e018-436c-a1d7-5e2e6ec7000f None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:57.667999 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:57.691458 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:57.759503 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ee7f43-c325-4e3f-9cfc-11a0b6700b0f None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:57.765444 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dffaa7-e018-436c-a1d7-5e2e6ec7000f None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:57.794743 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11521bb-684a-4a48-9c5a-03b96f42f530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:57.795542 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11521bb-684a-4a48-9c5a-03b96f42f530 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:57.795829 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11521bb-684a-4a48-9c5a-03b96f42f530 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:57.796143 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11521bb-684a-4a48-9c5a-03b96f42f530 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:57.800140 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b6c39f-790f-4194-9748-ea2707b2eb33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:57.800984 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6c39f-790f-4194-9748-ea2707b2eb33 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:57.801428 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6c39f-790f-4194-9748-ea2707b2eb33 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:57.801856 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6c39f-790f-4194-9748-ea2707b2eb33 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:57.802737 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b6c39f-790f-4194-9748-ea2707b2eb33 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:57.803452 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11521bb-684a-4a48-9c5a-03b96f42f530 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:57.804461 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b6c39f-790f-4194-9748-ea2707b2eb33 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:57.804933 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11521bb-684a-4a48-9c5a-03b96f42f530 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:57.820074 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 474/974] 10.222.0.42 () {60 vars in 1141 bytes} [Mon Jul 4 09:05:57 2022] POST /identity/v3/services => generated 242 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:05:57.820825 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-b11521bb-684a-4a48-9c5a-03b96f42f530 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 04 09:05:57.820825 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:57.820825 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:57.820825 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:57.820825 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:57.820825 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:57.820825 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:57.820825 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:57.820825 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:57.820825 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:57.820825 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:57.820825 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:57.820825 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:05:57.820825 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:05:57.820825 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:05:57.820825 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:05:57.821759 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:57.821759 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:57.821759 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:05:57.821759 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:05:57.821759 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:05:57.821759 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:05:57.821759 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:57.821759 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:57.821759 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:57.821759 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:57.821759 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:57.821759 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:57.821759 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:57.821759 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:57.821759 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:57.821759 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:57.821759 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:57.821759 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:57.822727 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:57.822727 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:57.822727 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:05:57.822727 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:05:57.822727 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:05:57.822727 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:05:57.822727 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:05:57.822727 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:05:57.822727 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 04 09:05:57.822727 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:57.822727 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 501/975] 10.222.0.42 () {56 vars in 1117 bytes} [Mon Jul 4 09:05:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:57.837873 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b6c39f-790f-4194-9748-ea2707b2eb33 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:57.900094 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6fc60-1331-481a-9e69-66e9364fd366 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:57.900400 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6fc60-1331-481a-9e69-66e9364fd366 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:57.900675 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6fc60-1331-481a-9e69-66e9364fd366 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:57.902083 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 502/976] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:05:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:05:57.907905 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b43b15-8707-431c-8d3f-89f24058496c None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:57.908227 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b43b15-8707-431c-8d3f-89f24058496c None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:57.908501 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b43b15-8707-431c-8d3f-89f24058496c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:57.930315 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-a4b43b15-8707-431c-8d3f-89f24058496c None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:05:57.932211 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-a4b43b15-8707-431c-8d3f-89f24058496c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:05:57.945468 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:57.969562 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b6c39f-790f-4194-9748-ea2707b2eb33 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:58.010791 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:58.015197 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6b021f-92a2-4ed6-b660-7f1e0dcc7f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:58.016015 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b021f-92a2-4ed6-b660-7f1e0dcc7f48 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:58.016340 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b021f-92a2-4ed6-b660-7f1e0dcc7f48 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:58.019918 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b021f-92a2-4ed6-b660-7f1e0dcc7f48 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:58.020074 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 503/977] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:05:57 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 09:05:58.020172 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6b021f-92a2-4ed6-b660-7f1e0dcc7f48 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:58.020172 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6b021f-92a2-4ed6-b660-7f1e0dcc7f48 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:58.020172 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6b021f-92a2-4ed6-b660-7f1e0dcc7f48 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:58.037237 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 475/978] 10.222.0.42 () {56 vars in 1149 bytes} [Mon Jul 4 09:05:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:05:58.039912 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b43b15-8707-431c-8d3f-89f24058496c None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:58.042606 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6b021f-92a2-4ed6-b660-7f1e0dcc7f48 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:58.143476 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b43b15-8707-431c-8d3f-89f24058496c None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:58.144533 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6b021f-92a2-4ed6-b660-7f1e0dcc7f48 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:58.178790 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5b7347-5b6b-42d9-a02c-d45f8feecda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:58.179167 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c70cfd7-2839-4255-b0a0-e2ca55aa66e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:58.179445 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b7347-5b6b-42d9-a02c-d45f8feecda0 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:58.179730 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b7347-5b6b-42d9-a02c-d45f8feecda0 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:58.180011 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c70cfd7-2839-4255-b0a0-e2ca55aa66e8 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:58.180109 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b7347-5b6b-42d9-a02c-d45f8feecda0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:58.180289 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c70cfd7-2839-4255-b0a0-e2ca55aa66e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:58.180558 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c70cfd7-2839-4255-b0a0-e2ca55aa66e8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:58.181289 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c70cfd7-2839-4255-b0a0-e2ca55aa66e8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:58.182763 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c70cfd7-2839-4255-b0a0-e2ca55aa66e8 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:58.192055 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:58.196283 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-8c70cfd7-2839-4255-b0a0-e2ca55aa66e8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 04 09:05:58.196283 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:58.196283 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 09:05:58.196283 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 09:05:58.196283 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 09:05:58.196283 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 09:05:58.196283 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 09:05:58.196283 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:05:58.196283 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 04 09:05:58.196283 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:58.196283 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:05:58.196283 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:58.196283 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:58.196283 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:58.196283 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:58.196283 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:58.196283 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:58.197313 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:58.197313 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:58.197313 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:58.197313 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:58.197313 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:58.197313 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:58.197313 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 09:05:58.197313 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 09:05:58.197313 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 09:05:58.197313 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 09:05:58.197313 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:58.197313 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:58.197313 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:58.197313 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:58.197313 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:58.197313 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:58.198190 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:58.198190 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:58.198190 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:58.198190 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:58.198190 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:58.198190 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:58.198190 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:58.198190 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:58.198190 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:58.198190 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:58.198190 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 09:05:58.198190 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:05:58.198190 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 04 09:05:58.198190 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:05:58.202549 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 504/979] 10.222.0.42 () {56 vars in 1126 bytes} [Mon Jul 4 09:05:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:05:58.203409 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c70cfd7-2839-4255-b0a0-e2ca55aa66e8 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:58.255254 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5b7347-5b6b-42d9-a02c-d45f8feecda0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:58.257355 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5b7347-5b6b-42d9-a02c-d45f8feecda0 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:58.270538 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:58.315134 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c70cfd7-2839-4255-b0a0-e2ca55aa66e8 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:58.350891 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf6df80-6e66-4502-b298-440447bc7c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:58.351737 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf6df80-6e66-4502-b298-440447bc7c7b None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:58.352058 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf6df80-6e66-4502-b298-440447bc7c7b None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:58.352333 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf6df80-6e66-4502-b298-440447bc7c7b None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:58.353046 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf6df80-6e66-4502-b298-440447bc7c7b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:58.353593 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf6df80-6e66-4502-b298-440447bc7c7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:58.354733 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf6df80-6e66-4502-b298-440447bc7c7b None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:58.360382 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 505/980] 10.222.0.42 () {56 vars in 1122 bytes} [Mon Jul 4 09:05:58 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:58.367838 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 476/981] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jul 4 09:05:58 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 04 09:05:58.368937 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf6df80-6e66-4502-b298-440447bc7c7b None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:58.369397 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5b7347-5b6b-42d9-a02c-d45f8feecda0 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:58.413599 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:58.472627 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf6df80-6e66-4502-b298-440447bc7c7b None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:58.477858 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5b7347-5b6b-42d9-a02c-d45f8feecda0 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:58.503050 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:58.512116 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d40ad6-8453-423e-84c7-b284e8ff3036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:58.512811 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d40ad6-8453-423e-84c7-b284e8ff3036 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:58.513109 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d40ad6-8453-423e-84c7-b284e8ff3036 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:58.513359 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d40ad6-8453-423e-84c7-b284e8ff3036 None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:58.514062 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d40ad6-8453-423e-84c7-b284e8ff3036 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:58.514368 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d40ad6-8453-423e-84c7-b284e8ff3036 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:58.514893 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320eab11-5f4b-473d-a24d-4b698934db3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:58.515746 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d40ad6-8453-423e-84c7-b284e8ff3036 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:58.516063 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320eab11-5f4b-473d-a24d-4b698934db3b None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:58.516483 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320eab11-5f4b-473d-a24d-4b698934db3b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:58.517058 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320eab11-5f4b-473d-a24d-4b698934db3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:58.525289 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 506/982] 10.222.0.42 () {56 vars in 1122 bytes} [Mon Jul 4 09:05:58 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:05:58.526706 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d40ad6-8453-423e-84c7-b284e8ff3036 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:58.531956 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320eab11-5f4b-473d-a24d-4b698934db3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:58.533444 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320eab11-5f4b-473d-a24d-4b698934db3b None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:58.550983 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-320eab11-5f4b-473d-a24d-4b698934db3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:58.550983 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:58.550983 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:58.550983 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:58.550983 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:58.550983 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:58.550983 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:58.550983 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:58.550983 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:58.550983 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:58.550983 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:58.550983 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:58.550983 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:05:58.550983 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:05:58.550983 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:05:58.552020 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:05:58.552020 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:58.552020 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:58.552020 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:58.552020 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:58.552020 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:58.552020 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:58.552020 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:58.552020 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:58.552020 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:58.552020 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:58.552020 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:58.552020 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:58.552020 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:58.552020 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:58.552020 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:58.552020 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:58.552923 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:05:58.552923 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:05:58.552923 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:05:58.552923 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:58.552923 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 477/983] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:05:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:05:58.557789 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320eab11-5f4b-473d-a24d-4b698934db3b None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:58.631431 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d40ad6-8453-423e-84c7-b284e8ff3036 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:58.662561 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:58.666132 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112fd77d-4aae-432f-8219-7f97687645ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:58.667352 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112fd77d-4aae-432f-8219-7f97687645ef None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:58.667643 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112fd77d-4aae-432f-8219-7f97687645ef None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:58.668091 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112fd77d-4aae-432f-8219-7f97687645ef None admin] PATH_INFO: `/v3/endpoints` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:58.668926 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112fd77d-4aae-432f-8219-7f97687645ef None admin] RBAC: Adding query filter params (interface=admin, service_id=18454f7e6181491499d5792341611f1e, region_id=RegionOne) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:58.669238 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112fd77d-4aae-432f-8219-7f97687645ef None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:58.669823 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320eab11-5f4b-473d-a24d-4b698934db3b None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:58.670612 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112fd77d-4aae-432f-8219-7f97687645ef None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:58.676035 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 507/984] 10.222.0.42 () {56 vars in 1249 bytes} [Mon Jul 4 09:05:58 2022] GET /identity/v3/endpoints?service_id=18454f7e6181491499d5792341611f1e&interface=admin®ion_id=RegionOne => generated 193 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:05:58.681502 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112fd77d-4aae-432f-8219-7f97687645ef None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:58.705296 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efd0a60-4fa3-4007-b3f1-d11f81769a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:58.705956 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd0a60-4fa3-4007-b3f1-d11f81769a68 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:58.706243 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd0a60-4fa3-4007-b3f1-d11f81769a68 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:58.706516 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd0a60-4fa3-4007-b3f1-d11f81769a68 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:58.707239 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efd0a60-4fa3-4007-b3f1-d11f81769a68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:58.707545 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efd0a60-4fa3-4007-b3f1-d11f81769a68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:58.708972 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efd0a60-4fa3-4007-b3f1-d11f81769a68 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:58.726251 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 478/985] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jul 4 09:05:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:05:58.727849 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efd0a60-4fa3-4007-b3f1-d11f81769a68 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:58.738660 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:58.789670 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112fd77d-4aae-432f-8219-7f97687645ef None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:58.825785 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce80122e-dffa-4dd4-ba11-65ca71e9368d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:58.826450 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce80122e-dffa-4dd4-ba11-65ca71e9368d None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:58.826739 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce80122e-dffa-4dd4-ba11-65ca71e9368d None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:58.827017 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce80122e-dffa-4dd4-ba11-65ca71e9368d None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:58.827703 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce80122e-dffa-4dd4-ba11-65ca71e9368d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:58.829167 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce80122e-dffa-4dd4-ba11-65ca71e9368d None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:58.834048 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efd0a60-4fa3-4007-b3f1-d11f81769a68 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:58.835685 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 508/986] 10.222.0.42 () {56 vars in 1087 bytes} [Mon Jul 4 09:05:58 2022] GET /identity/v3/services => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:05:58.888788 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1a2e49-e67d-4e3b-8e42-801849b84ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:58.889925 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a2e49-e67d-4e3b-8e42-801849b84ef6 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:58.890220 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a2e49-e67d-4e3b-8e42-801849b84ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:58.890491 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a2e49-e67d-4e3b-8e42-801849b84ef6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:58.898956 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1a2e49-e67d-4e3b-8e42-801849b84ef6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:58.900500 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1a2e49-e67d-4e3b-8e42-801849b84ef6 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:58.915839 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-dd1a2e49-e67d-4e3b-8e42-801849b84ef6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:05:58.915839 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:05:58.915839 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:05:58.915839 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:05:58.915839 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:05:58.915839 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:05:58.915839 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:05:58.915839 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:05:58.915839 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:05:58.915839 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:05:58.915839 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:05:58.915839 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:05:58.915839 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:05:58.915839 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:05:58.915839 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:05:58.916914 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:05:58.916914 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:05:58.916914 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:05:58.916914 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:05:58.916914 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:05:58.916914 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:05:58.916914 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:05:58.916914 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:05:58.916914 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:05:58.916914 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:05:58.916914 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:05:58.916914 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:05:58.916914 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:05:58.916914 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:05:58.916914 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:05:58.916914 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:05:58.916914 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:05:58.923015 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:05:58.923015 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:05:58.923015 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:05:58.923015 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:05:58.923015 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:05:58.923015 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:05:58.923015 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:05:58.923015 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:05:58.923015 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 479/987] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jul 4 09:05:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:05:58.925218 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce80122e-dffa-4dd4-ba11-65ca71e9368d None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:59.038769 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce80122e-dffa-4dd4-ba11-65ca71e9368d None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:59.058133 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:59.073495 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372c9b93-776d-4ce2-9971-6f50e0e69931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:59.074140 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372c9b93-776d-4ce2-9971-6f50e0e69931 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:59.074425 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372c9b93-776d-4ce2-9971-6f50e0e69931 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:59.074697 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372c9b93-776d-4ce2-9971-6f50e0e69931 None admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:59.075537 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372c9b93-776d-4ce2-9971-6f50e0e69931 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:59.075844 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372c9b93-776d-4ce2-9971-6f50e0e69931 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:59.077307 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372c9b93-776d-4ce2-9971-6f50e0e69931 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:59.089451 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 509/988] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Jul 4 09:05:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:59.095591 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1a2e49-e67d-4e3b-8e42-801849b84ef6 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:05:59.113708 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:05:59.200443 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1a2e49-e67d-4e3b-8e42-801849b84ef6 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:05:59.233682 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d00cd42-bacc-4992-8a9a-2a577f65bf21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:05:59.234646 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d00cd42-bacc-4992-8a9a-2a577f65bf21 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:59.234930 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d00cd42-bacc-4992-8a9a-2a577f65bf21 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:59.235205 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d00cd42-bacc-4992-8a9a-2a577f65bf21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:59.236064 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d00cd42-bacc-4992-8a9a-2a577f65bf21 None admin] RBAC: Adding query filter params (role.id=a0417473d97f454c914db70e2d6c9f94, scope.project.id=d015d4f3d9d4464983ff561e8e08523c, user.id=bd758d5b21684027b0d199021df0ad2f) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:05:59.236376 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d00cd42-bacc-4992-8a9a-2a577f65bf21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:05:59.237820 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d00cd42-bacc-4992-8a9a-2a577f65bf21 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:05:59.243916 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 480/989] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Jul 4 09:05:59 2022] GET /identity/v3/role_assignments?user.id=bd758d5b21684027b0d199021df0ad2f&scope.project.id=d015d4f3d9d4464983ff561e8e08523c&role.id=a0417473d97f454c914db70e2d6c9f94 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:05:59.882127 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc13260f-9758-4536-9e33-dd60bf5bfbd5 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:59.882127 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc13260f-9758-4536-9e33-dd60bf5bfbd5 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:59.882127 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc13260f-9758-4536-9e33-dd60bf5bfbd5 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:59.883028 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 510/990] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:05:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:05:59.890052 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c3075e-c446-423a-9259-b7f19d767e31 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:05:59.890052 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c3075e-c446-423a-9259-b7f19d767e31 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:05:59.890052 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c3075e-c446-423a-9259-b7f19d767e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:05:59.908110 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-d7c3075e-c446-423a-9259-b7f19d767e31 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:05:59.909796 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d7c3075e-c446-423a-9259-b7f19d767e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:05:59.987111 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 481/991] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:05:59 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:06:00.009836 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc13260f-9758-4536-9e33-dd60bf5bfbd5 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:00.113849 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc13260f-9758-4536-9e33-dd60bf5bfbd5 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:00.147608 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4d6ab3-1d7d-4e9c-80ef-5320696858dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:00.148352 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d6ab3-1d7d-4e9c-80ef-5320696858dc None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:00.148632 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d6ab3-1d7d-4e9c-80ef-5320696858dc None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:00.148903 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d6ab3-1d7d-4e9c-80ef-5320696858dc None admin] PATH_INFO: `/v3/services/compute` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:00.149544 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4d6ab3-1d7d-4e9c-80ef-5320696858dc None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:00.150912 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4d6ab3-1d7d-4e9c-80ef-5320696858dc None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:00.162373 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-cb4d6ab3-1d7d-4e9c-80ef-5320696858dc None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 04 09:06:00.162373 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:06:00.162373 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 09:06:00.162373 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 09:06:00.162373 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 09:06:00.162373 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 09:06:00.162373 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 09:06:00.162373 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:06:00.162373 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 04 09:06:00.162373 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:06:00.162373 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:06:00.162373 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:06:00.162373 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:06:00.162373 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:06:00.162373 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:06:00.162373 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:06:00.162373 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:06:00.163390 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:06:00.163390 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:06:00.163390 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:06:00.163390 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:06:00.163390 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:06:00.163390 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:06:00.163390 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 09:06:00.163390 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 09:06:00.163390 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 09:06:00.163390 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 09:06:00.163390 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:06:00.163390 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:06:00.163390 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:06:00.163390 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:06:00.163390 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:06:00.163390 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:06:00.164311 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:06:00.164311 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:06:00.164311 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:06:00.164311 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:06:00.164311 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:06:00.164311 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:06:00.164311 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:06:00.164311 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:06:00.164311 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:06:00.164311 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:06:00.164311 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 09:06:00.164311 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:06:00.164311 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 04 09:06:00.164311 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:06:00.164311 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 511/992] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jul 4 09:06:00 2022] GET /identity/v3/services/compute => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:06:00.171483 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c3075e-c446-423a-9259-b7f19d767e31 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:00.182615 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:00.276752 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c3075e-c446-423a-9259-b7f19d767e31 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:00.312064 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4922063d-54ec-422a-be9c-dfaf8d0e96e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:00.312727 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922063d-54ec-422a-be9c-dfaf8d0e96e1 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:00.313008 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922063d-54ec-422a-be9c-dfaf8d0e96e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:00.313280 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922063d-54ec-422a-be9c-dfaf8d0e96e1 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:00.314067 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4922063d-54ec-422a-be9c-dfaf8d0e96e1 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:06:00.314378 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4922063d-54ec-422a-be9c-dfaf8d0e96e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:00.315829 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4922063d-54ec-422a-be9c-dfaf8d0e96e1 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:00.321279 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 482/993] 10.222.0.42 () {56 vars in 1112 bytes} [Mon Jul 4 09:06:00 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:06:00.326956 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4d6ab3-1d7d-4e9c-80ef-5320696858dc None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:00.377596 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:00.436188 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4d6ab3-1d7d-4e9c-80ef-5320696858dc None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:00.471681 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3707cae-9037-4687-aa94-bee94c9da8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:00.472387 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3707cae-9037-4687-aa94-bee94c9da8ca None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:00.472670 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3707cae-9037-4687-aa94-bee94c9da8ca None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:00.472942 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3707cae-9037-4687-aa94-bee94c9da8ca None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:00.473638 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3707cae-9037-4687-aa94-bee94c9da8ca None admin] RBAC: Adding query filter params (type=compute) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:06:00.473943 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3707cae-9037-4687-aa94-bee94c9da8ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:00.475324 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3707cae-9037-4687-aa94-bee94c9da8ca None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:00.480575 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 512/994] 10.222.0.42 () {56 vars in 1112 bytes} [Mon Jul 4 09:06:00 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:06:00.486758 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4922063d-54ec-422a-be9c-dfaf8d0e96e1 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:00.556373 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:00.586813 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4922063d-54ec-422a-be9c-dfaf8d0e96e1 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:00.620644 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89973997-c945-4deb-b475-94369d4e48df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:00.621293 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89973997-c945-4deb-b475-94369d4e48df None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:00.621617 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89973997-c945-4deb-b475-94369d4e48df None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:00.621891 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89973997-c945-4deb-b475-94369d4e48df None admin] PATH_INFO: `/v3/endpoints` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:00.622670 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89973997-c945-4deb-b475-94369d4e48df None admin] RBAC: Adding query filter params (interface=public, service_id=26475e400a2840009656dd55375bb0b6, region_id=RegionOne) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:06:00.622978 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89973997-c945-4deb-b475-94369d4e48df None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:00.624395 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89973997-c945-4deb-b475-94369d4e48df None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:00.629569 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 483/995] 10.222.0.42 () {56 vars in 1251 bytes} [Mon Jul 4 09:06:00 2022] GET /identity/v3/endpoints?service_id=26475e400a2840009656dd55375bb0b6&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:06:00.635030 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3707cae-9037-4687-aa94-bee94c9da8ca None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:00.737242 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3707cae-9037-4687-aa94-bee94c9da8ca None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:00.746043 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:00.771689 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9285ba8-dd80-402c-b20e-bb460ebad6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:00.772375 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9285ba8-dd80-402c-b20e-bb460ebad6bc None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:00.772653 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9285ba8-dd80-402c-b20e-bb460ebad6bc None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:00.772922 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9285ba8-dd80-402c-b20e-bb460ebad6bc None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:00.773601 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9285ba8-dd80-402c-b20e-bb460ebad6bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:00.774966 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9285ba8-dd80-402c-b20e-bb460ebad6bc None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:00.783525 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 513/996] 10.222.0.42 () {56 vars in 1087 bytes} [Mon Jul 4 09:06:00 2022] GET /identity/v3/services => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:06:00.846053 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c4ad44-083f-4824-8476-dd735842dd33 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:00.846427 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c4ad44-083f-4824-8476-dd735842dd33 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:00.846592 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c4ad44-083f-4824-8476-dd735842dd33 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:00.848259 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 484/997] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:06:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:06:00.853824 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3ddba-86a7-41be-99bd-6b6bdeae8914 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:00.854127 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3ddba-86a7-41be-99bd-6b6bdeae8914 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:00.854402 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3ddba-86a7-41be-99bd-6b6bdeae8914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:00.873246 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-b2f3ddba-86a7-41be-99bd-6b6bdeae8914 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:06:00.874463 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-b2f3ddba-86a7-41be-99bd-6b6bdeae8914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:06:00.955616 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 514/998] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:06:00 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:06:00.979134 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c4ad44-083f-4824-8476-dd735842dd33 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:01.083309 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c4ad44-083f-4824-8476-dd735842dd33 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:01.117873 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac28c3-24be-45b3-af2b-94d97e3cf48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:01.118684 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac28c3-24be-45b3-af2b-94d97e3cf48f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:01.118964 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac28c3-24be-45b3-af2b-94d97e3cf48f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:01.119239 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac28c3-24be-45b3-af2b-94d97e3cf48f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:01.119898 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ac28c3-24be-45b3-af2b-94d97e3cf48f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:01.122913 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ac28c3-24be-45b3-af2b-94d97e3cf48f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:01.126103 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:01.137981 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-c4ac28c3-24be-45b3-af2b-94d97e3cf48f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 04 09:06:01.137981 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:06:01.137981 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 09:06:01.137981 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 09:06:01.137981 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 09:06:01.137981 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 09:06:01.137981 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 09:06:01.137981 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:06:01.137981 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 04 09:06:01.137981 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:06:01.137981 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:06:01.137981 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:06:01.137981 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:06:01.137981 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:06:01.137981 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:06:01.137981 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:06:01.137981 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:06:01.139018 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:06:01.139018 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:06:01.139018 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:06:01.139018 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:06:01.139018 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:06:01.139018 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:06:01.139018 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 09:06:01.139018 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 09:06:01.139018 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 09:06:01.139018 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 09:06:01.139018 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:06:01.139018 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:06:01.139018 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:06:01.139018 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:06:01.139018 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:06:01.139018 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:06:01.139892 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:06:01.139892 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:06:01.139892 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:06:01.139892 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:06:01.139892 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:06:01.139892 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:06:01.139892 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:06:01.139892 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:06:01.139892 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:06:01.139892 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:06:01.139892 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 09:06:01.139892 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:06:01.139892 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 04 09:06:01.139892 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:06:01.141311 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 485/999] 10.222.0.42 () {56 vars in 1126 bytes} [Mon Jul 4 09:06:00 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:06:01.145547 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f3ddba-86a7-41be-99bd-6b6bdeae8914 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:01.249032 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f3ddba-86a7-41be-99bd-6b6bdeae8914 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:01.250574 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:01.274859 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61169dae-ac2e-413b-b817-c0522ac94461 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:01.275383 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61169dae-ac2e-413b-b817-c0522ac94461 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:01.275834 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61169dae-ac2e-413b-b817-c0522ac94461 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:01.277767 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 486/1000] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:06:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:06:01.282493 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44779fa0-d46d-4d6b-9840-f757e7b1c57c None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:01.282777 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44779fa0-d46d-4d6b-9840-f757e7b1c57c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:01.283051 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44779fa0-d46d-4d6b-9840-f757e7b1c57c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:01.286709 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8191e78b-2c6e-4577-b978-c4fba9a37054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:01.287376 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8191e78b-2c6e-4577-b978-c4fba9a37054 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:01.287657 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8191e78b-2c6e-4577-b978-c4fba9a37054 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:01.287987 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8191e78b-2c6e-4577-b978-c4fba9a37054 None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:01.288682 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8191e78b-2c6e-4577-b978-c4fba9a37054 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:06:01.288990 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8191e78b-2c6e-4577-b978-c4fba9a37054 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:01.290357 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8191e78b-2c6e-4577-b978-c4fba9a37054 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:01.295396 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 515/1001] 10.222.0.42 () {56 vars in 1122 bytes} [Mon Jul 4 09:06:01 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:06:01.300900 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8191e78b-2c6e-4577-b978-c4fba9a37054 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:01.302186 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-44779fa0-d46d-4d6b-9840-f757e7b1c57c None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:06:01.303557 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-44779fa0-d46d-4d6b-9840-f757e7b1c57c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:06:01.375437 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 487/1002] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:06:01 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:06:01.397597 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44779fa0-d46d-4d6b-9840-f757e7b1c57c None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:01.401689 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8191e78b-2c6e-4577-b978-c4fba9a37054 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:01.439207 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f949be4-ac03-4d77-8222-466cbfddfd27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:01.439882 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f949be4-ac03-4d77-8222-466cbfddfd27 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:01.440170 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f949be4-ac03-4d77-8222-466cbfddfd27 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:01.440440 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f949be4-ac03-4d77-8222-466cbfddfd27 None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:01.441143 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f949be4-ac03-4d77-8222-466cbfddfd27 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:06:01.441452 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f949be4-ac03-4d77-8222-466cbfddfd27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:01.442821 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f949be4-ac03-4d77-8222-466cbfddfd27 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:01.452454 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 516/1003] 10.222.0.42 () {56 vars in 1122 bytes} [Mon Jul 4 09:06:01 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:06:01.453449 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f949be4-ac03-4d77-8222-466cbfddfd27 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:01.485449 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:01.510658 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44779fa0-d46d-4d6b-9840-f757e7b1c57c None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:01.540855 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:01.547538 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab81b351-a042-4c24-b095-0fd24ee92f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:01.548369 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab81b351-a042-4c24-b095-0fd24ee92f46 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:01.548648 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab81b351-a042-4c24-b095-0fd24ee92f46 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:01.548924 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab81b351-a042-4c24-b095-0fd24ee92f46 None admin] PATH_INFO: `/v3/services/image` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:01.549580 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab81b351-a042-4c24-b095-0fd24ee92f46 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:01.551109 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab81b351-a042-4c24-b095-0fd24ee92f46 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:01.562524 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-ab81b351-a042-4c24-b095-0fd24ee92f46 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 04 09:06:01.562524 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:06:01.562524 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 09:06:01.562524 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 09:06:01.562524 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 09:06:01.562524 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 09:06:01.562524 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 09:06:01.562524 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:06:01.562524 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 04 09:06:01.562524 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:06:01.562524 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:06:01.562524 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:06:01.562524 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:06:01.562524 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:06:01.562524 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:06:01.562524 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:06:01.562524 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:06:01.563501 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:06:01.563501 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:06:01.563501 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:06:01.563501 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:06:01.563501 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:06:01.563501 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:06:01.563501 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 09:06:01.563501 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 09:06:01.563501 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 09:06:01.563501 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 09:06:01.563501 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:06:01.563501 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:06:01.563501 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:06:01.563501 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:06:01.563501 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:06:01.563501 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:06:01.564415 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:06:01.564415 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:06:01.564415 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:06:01.564415 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:06:01.564415 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:06:01.564415 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:06:01.564415 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:06:01.564415 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:06:01.564415 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:06:01.564415 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:06:01.564415 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 09:06:01.564415 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:06:01.564415 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 04 09:06:01.564415 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:06:01.564415 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 488/1004] 10.222.0.42 () {56 vars in 1105 bytes} [Mon Jul 4 09:06:01 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:06:01.567932 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f949be4-ac03-4d77-8222-466cbfddfd27 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:01.569498 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab81b351-a042-4c24-b095-0fd24ee92f46 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:01.608389 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066226f2-208b-4c11-baa8-1eb11c17cf89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:01.609048 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066226f2-208b-4c11-baa8-1eb11c17cf89 None admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:01.609689 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066226f2-208b-4c11-baa8-1eb11c17cf89 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:01.610228 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066226f2-208b-4c11-baa8-1eb11c17cf89 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:01.610748 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066226f2-208b-4c11-baa8-1eb11c17cf89 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:01.612181 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066226f2-208b-4c11-baa8-1eb11c17cf89 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:01.635983 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 517/1005] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Jul 4 09:06:01 2022] POST /identity/v3/endpoints => generated 325 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:06:01.687334 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab81b351-a042-4c24-b095-0fd24ee92f46 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:01.733551 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d897dddc-a5a5-459d-bdf8-efe9046ab643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:01.734595 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d897dddc-a5a5-459d-bdf8-efe9046ab643 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:01.734925 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d897dddc-a5a5-459d-bdf8-efe9046ab643 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:01.735199 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d897dddc-a5a5-459d-bdf8-efe9046ab643 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:01.735921 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d897dddc-a5a5-459d-bdf8-efe9046ab643 None admin] RBAC: Adding query filter params (name=image) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:06:01.736244 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d897dddc-a5a5-459d-bdf8-efe9046ab643 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:01.737660 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d897dddc-a5a5-459d-bdf8-efe9046ab643 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:01.750185 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 489/1006] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:06:01 2022] GET /identity/v3/services?name=image => generated 122 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:06:01.750382 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066226f2-208b-4c11-baa8-1eb11c17cf89 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:01.845351 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:01.857008 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066226f2-208b-4c11-baa8-1eb11c17cf89 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:01.900361 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61505199-cfba-42e7-9956-641954a2f82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:01.901042 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61505199-cfba-42e7-9956-641954a2f82f None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:01.901327 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61505199-cfba-42e7-9956-641954a2f82f None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:01.901606 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61505199-cfba-42e7-9956-641954a2f82f None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:01.902346 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61505199-cfba-42e7-9956-641954a2f82f None admin] RBAC: Adding query filter params (type=image) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:06:01.902653 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61505199-cfba-42e7-9956-641954a2f82f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:01.904182 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61505199-cfba-42e7-9956-641954a2f82f None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:01.909128 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 518/1007] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:06:01 2022] GET /identity/v3/services?type=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:06:02.775817 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94472eb-a9ec-42d9-9fef-4e40320e7568 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:02.776365 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94472eb-a9ec-42d9-9fef-4e40320e7568 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:02.776442 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94472eb-a9ec-42d9-9fef-4e40320e7568 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:02.777923 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 490/1008] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:06:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:06:02.783240 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4066990f-7d15-4213-a567-3ac2103857fc None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:02.783658 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4066990f-7d15-4213-a567-3ac2103857fc None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:02.783760 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4066990f-7d15-4213-a567-3ac2103857fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:02.802304 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-4066990f-7d15-4213-a567-3ac2103857fc None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:06:02.803756 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-4066990f-7d15-4213-a567-3ac2103857fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:06:02.871566 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 519/1009] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:06:02 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:06:02.895378 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94472eb-a9ec-42d9-9fef-4e40320e7568 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:02.960356 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:03.009615 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94472eb-a9ec-42d9-9fef-4e40320e7568 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:03.044871 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcee3899-9c24-447b-aa66-4affd1c3aca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:03.045579 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee3899-9c24-447b-aa66-4affd1c3aca2 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:03.045854 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee3899-9c24-447b-aa66-4affd1c3aca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:03.046121 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee3899-9c24-447b-aa66-4affd1c3aca2 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:03.046761 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcee3899-9c24-447b-aa66-4affd1c3aca2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:03.048170 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcee3899-9c24-447b-aa66-4affd1c3aca2 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:03.059899 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-dcee3899-9c24-447b-aa66-4affd1c3aca2 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 04 09:06:03.059899 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:06:03.059899 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 09:06:03.059899 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 09:06:03.059899 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 09:06:03.059899 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 09:06:03.059899 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 09:06:03.059899 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:06:03.059899 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 04 09:06:03.059899 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:06:03.059899 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:06:03.059899 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:06:03.059899 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:06:03.059899 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:06:03.059899 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:06:03.059899 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:06:03.059899 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:06:03.060906 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:06:03.060906 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:06:03.060906 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:06:03.060906 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:06:03.060906 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:06:03.060906 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:06:03.060906 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 09:06:03.060906 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 09:06:03.060906 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 09:06:03.060906 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 09:06:03.060906 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:06:03.060906 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:06:03.060906 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:06:03.060906 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:06:03.060906 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:06:03.060906 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:06:03.061752 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:06:03.061752 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:06:03.061752 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:06:03.061752 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:06:03.061752 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:06:03.061752 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:06:03.061752 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:06:03.061752 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:06:03.061752 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:06:03.061752 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:06:03.061752 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 09:06:03.061752 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:06:03.061752 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 04 09:06:03.061752 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:06:03.064231 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 491/1010] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jul 4 09:06:02 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:06:03.067155 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4066990f-7d15-4213-a567-3ac2103857fc None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:03.155138 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:03.171825 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4066990f-7d15-4213-a567-3ac2103857fc None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:03.207182 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae0f806-b6a9-4f48-a7f2-e8ef494474c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:03.207842 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae0f806-b6a9-4f48-a7f2-e8ef494474c3 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:03.208168 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae0f806-b6a9-4f48-a7f2-e8ef494474c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:03.208433 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae0f806-b6a9-4f48-a7f2-e8ef494474c3 None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:03.209121 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae0f806-b6a9-4f48-a7f2-e8ef494474c3 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:06:03.209423 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae0f806-b6a9-4f48-a7f2-e8ef494474c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:03.210788 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae0f806-b6a9-4f48-a7f2-e8ef494474c3 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:03.215961 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 520/1011] 10.222.0.42 () {56 vars in 1112 bytes} [Mon Jul 4 09:06:03 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:06:03.221632 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcee3899-9c24-447b-aa66-4affd1c3aca2 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:03.328571 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcee3899-9c24-447b-aa66-4affd1c3aca2 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:03.345806 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:03.364115 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea583a8-cb58-48cd-a3b9-771305640b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:03.364773 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea583a8-cb58-48cd-a3b9-771305640b4e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:03.365049 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea583a8-cb58-48cd-a3b9-771305640b4e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:03.365318 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea583a8-cb58-48cd-a3b9-771305640b4e None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:03.366017 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea583a8-cb58-48cd-a3b9-771305640b4e None admin] RBAC: Adding query filter params (type=compute) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:06:03.366317 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea583a8-cb58-48cd-a3b9-771305640b4e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:03.367700 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea583a8-cb58-48cd-a3b9-771305640b4e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:03.372849 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 492/1012] 10.222.0.42 () {56 vars in 1112 bytes} [Mon Jul 4 09:06:03 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:06:03.378582 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae0f806-b6a9-4f48-a7f2-e8ef494474c3 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:03.481050 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae0f806-b6a9-4f48-a7f2-e8ef494474c3 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:03.515789 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744ea54a-f8cf-424d-abe9-4fdefe501821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:03.516471 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ea54a-f8cf-424d-abe9-4fdefe501821 None admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:03.516751 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ea54a-f8cf-424d-abe9-4fdefe501821 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:03.517024 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ea54a-f8cf-424d-abe9-4fdefe501821 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:03.517771 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744ea54a-f8cf-424d-abe9-4fdefe501821 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:03.519171 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744ea54a-f8cf-424d-abe9-4fdefe501821 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:03.539307 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 521/1013] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Jul 4 09:06:03 2022] POST /identity/v3/endpoints => generated 334 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:06:03.673276 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6417d3-a569-4f87-8c49-43a3f5ffc9c4 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:03.673640 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6417d3-a569-4f87-8c49-43a3f5ffc9c4 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:03.673829 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6417d3-a569-4f87-8c49-43a3f5ffc9c4 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:03.675471 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 493/1014] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:06:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:06:03.680902 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352055c0-b8a4-4525-867d-54395272fbdc None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:03.681185 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352055c0-b8a4-4525-867d-54395272fbdc None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:03.681439 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352055c0-b8a4-4525-867d-54395272fbdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:03.688494 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:03.700220 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-352055c0-b8a4-4525-867d-54395272fbdc None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:06:03.701410 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-352055c0-b8a4-4525-867d-54395272fbdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:06:03.774361 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 522/1015] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:06:03 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:06:03.798493 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6417d3-a569-4f87-8c49-43a3f5ffc9c4 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:03.910379 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6417d3-a569-4f87-8c49-43a3f5ffc9c4 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:03.915588 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46040266-c37b-477a-806e-c0072f3a2e16 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:03.916080 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46040266-c37b-477a-806e-c0072f3a2e16 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:03.916179 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46040266-c37b-477a-806e-c0072f3a2e16 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:03.917700 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 523/1016] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:06:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:06:03.922399 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19ab21-8251-4221-92b7-ff142fa806f0 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:03.922658 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19ab21-8251-4221-92b7-ff142fa806f0 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:03.922937 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19ab21-8251-4221-92b7-ff142fa806f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:03.939979 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-2a19ab21-8251-4221-92b7-ff142fa806f0 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:06:03.941291 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-2a19ab21-8251-4221-92b7-ff142fa806f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:06:03.948075 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf19509-7fce-4d47-8f26-f6735c93e1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:03.949270 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf19509-7fce-4d47-8f26-f6735c93e1ab None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:03.949634 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf19509-7fce-4d47-8f26-f6735c93e1ab None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:03.949915 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf19509-7fce-4d47-8f26-f6735c93e1ab None admin] PATH_INFO: `/v3/domains/default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:03.951469 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf19509-7fce-4d47-8f26-f6735c93e1ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:03.953446 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf19509-7fce-4d47-8f26-f6735c93e1ab None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:03.959956 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 494/1017] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:06:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:06:03.961356 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf19509-7fce-4d47-8f26-f6735c93e1ab None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:04.009950 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 524/1018] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:06:03 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 09:06:04.020713 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:04.032775 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a19ab21-8251-4221-92b7-ff142fa806f0 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:04.073914 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf19509-7fce-4d47-8f26-f6735c93e1ab None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:04.092220 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:04.109529 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21eae36-eec5-4163-bf03-39298dec7852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:04.110189 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21eae36-eec5-4163-bf03-39298dec7852 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:04.110524 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21eae36-eec5-4163-bf03-39298dec7852 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:04.110808 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21eae36-eec5-4163-bf03-39298dec7852 None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:04.111518 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21eae36-eec5-4163-bf03-39298dec7852 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:04.113012 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21eae36-eec5-4163-bf03-39298dec7852 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:04.136240 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a19ab21-8251-4221-92b7-ff142fa806f0 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:04.139279 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 495/1019] 10.222.0.42 () {60 vars in 1141 bytes} [Mon Jul 4 09:06:03 2022] POST /identity/v3/projects => generated 311 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:06:04.176399 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5554bd-59b4-4f10-9ec9-3e1d7293604d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:04.177090 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5554bd-59b4-4f10-9ec9-3e1d7293604d None admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:04.177381 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5554bd-59b4-4f10-9ec9-3e1d7293604d None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:04.177661 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5554bd-59b4-4f10-9ec9-3e1d7293604d None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:04.178398 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5554bd-59b4-4f10-9ec9-3e1d7293604d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:04.179994 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5554bd-59b4-4f10-9ec9-3e1d7293604d None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:04.197650 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 525/1020] 10.222.0.42 () {60 vars in 1141 bytes} [Mon Jul 4 09:06:04 2022] POST /identity/v3/services => generated 242 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:06:05.664172 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a491f-9402-4538-b540-804e5e1a9e6c None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:05.664719 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a491f-9402-4538-b540-804e5e1a9e6c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:05.664719 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a491f-9402-4538-b540-804e5e1a9e6c None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:05.666299 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 496/1021] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:06:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:06:05.671352 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e6fad-84d3-4ce0-ae67-71f170898282 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:05.671766 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e6fad-84d3-4ce0-ae67-71f170898282 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:05.671963 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e6fad-84d3-4ce0-ae67-71f170898282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:05.688874 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-765e6fad-84d3-4ce0-ae67-71f170898282 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:06:05.690061 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-765e6fad-84d3-4ce0-ae67-71f170898282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:06:05.767786 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 526/1022] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:06:05 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:06:05.791117 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a491f-9402-4538-b540-804e5e1a9e6c None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:05.898492 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a491f-9402-4538-b540-804e5e1a9e6c None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:05.900213 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:05.936713 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1493896-fb30-4610-bd66-7524afd77242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:05.937444 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1493896-fb30-4610-bd66-7524afd77242 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:05.937724 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1493896-fb30-4610-bd66-7524afd77242 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:05.937996 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1493896-fb30-4610-bd66-7524afd77242 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:05.948456 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1493896-fb30-4610-bd66-7524afd77242 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:06:05.956573 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-c1493896-fb30-4610-bd66-7524afd77242 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 04 09:06:05.956573 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:06:05.956573 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:06:05.956573 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:06:05.956573 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:06:05.956573 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:06:05.956573 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:06:05.956573 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:06:05.956573 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:06:05.956573 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:06:05.956573 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:06:05.956573 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:06:05.956573 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:06:05.956573 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:06:05.956573 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:06:05.956573 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:06:05.957488 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:06:05.957488 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:06:05.957488 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:06:05.957488 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:06:05.957488 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:06:05.957488 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:06:05.957488 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:06:05.957488 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:06:05.957488 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:06:05.957488 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:06:05.957488 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:06:05.957488 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:06:05.957488 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:06:05.957488 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:06:05.957488 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:06:05.957488 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:06:05.963214 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:06:05.963214 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:06:05.963214 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:06:05.963214 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:06:05.963214 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:06:05.963214 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:06:05.963214 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:06:05.963214 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:06:05.963214 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:06:05.963214 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:06:05.963214 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 04 09:06:05.963214 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:06:05.963214 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 497/1023] 10.222.0.42 () {56 vars in 1120 bytes} [Mon Jul 4 09:06:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:06:05.964036 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765e6fad-84d3-4ce0-ae67-71f170898282 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:06.016403 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:06.071824 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765e6fad-84d3-4ce0-ae67-71f170898282 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:06.105705 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67870dd1-9096-4971-a43b-5aef51671603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:06.106405 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67870dd1-9096-4971-a43b-5aef51671603 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:06.106686 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67870dd1-9096-4971-a43b-5aef51671603 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:06.106958 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67870dd1-9096-4971-a43b-5aef51671603 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:06.107706 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67870dd1-9096-4971-a43b-5aef51671603 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:06:06.108043 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67870dd1-9096-4971-a43b-5aef51671603 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:06.109727 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67870dd1-9096-4971-a43b-5aef51671603 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:06.122629 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 527/1024] 10.222.0.42 () {56 vars in 1115 bytes} [Mon Jul 4 09:06:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:06:06.123823 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1493896-fb30-4610-bd66-7524afd77242 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:06.190531 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698dbca0-57ab-49f9-8c59-3acf8c91af6f None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:06.190742 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698dbca0-57ab-49f9-8c59-3acf8c91af6f None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:06.191022 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698dbca0-57ab-49f9-8c59-3acf8c91af6f None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:06.192667 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 528/1025] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:06:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:06:06.197626 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2d98b-5334-4ef8-87cf-a313a7453ec3 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:06.197916 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2d98b-5334-4ef8-87cf-a313a7453ec3 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:06.198195 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2d98b-5334-4ef8-87cf-a313a7453ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:06.216115 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-a9e2d98b-5334-4ef8-87cf-a313a7453ec3 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:06:06.217319 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-a9e2d98b-5334-4ef8-87cf-a313a7453ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:06:06.227028 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1493896-fb30-4610-bd66-7524afd77242 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:06.264125 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bc9c2a-8d48-4908-845d-ce77ecd3e152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:06.264912 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc9c2a-8d48-4908-845d-ce77ecd3e152 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:06.265196 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc9c2a-8d48-4908-845d-ce77ecd3e152 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:06.265467 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc9c2a-8d48-4908-845d-ce77ecd3e152 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:06.277986 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bc9c2a-8d48-4908-845d-ce77ecd3e152 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:06.280229 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bc9c2a-8d48-4908-845d-ce77ecd3e152 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:06.291342 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 529/1026] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:06:06 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:06:06.292690 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d4892-0e23-4955-862f-d9f33933581f None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:06.292974 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d4892-0e23-4955-862f-d9f33933581f None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:06.293350 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d4892-0e23-4955-862f-d9f33933581f None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:06.294782 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 530/1027] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:06:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:06:06.299754 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5026bafd-871a-49d6-9e9e-87de73ff6d9a None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:06.300071 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5026bafd-871a-49d6-9e9e-87de73ff6d9a None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:06.300348 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5026bafd-871a-49d6-9e9e-87de73ff6d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:06.301502 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-72bc9c2a-8d48-4908-845d-ce77ecd3e152 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:06:06.301502 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:06:06.301502 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:06:06.301502 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:06:06.301502 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:06:06.301502 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:06:06.301502 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:06:06.301502 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:06:06.301502 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:06:06.301502 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:06:06.301502 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:06:06.301502 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:06:06.301502 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:06:06.301502 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:06:06.301502 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:06:06.302545 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:06:06.302545 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:06:06.302545 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:06:06.302545 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:06:06.302545 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:06:06.302545 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:06:06.302545 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:06:06.302545 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:06:06.302545 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:06:06.302545 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:06:06.302545 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:06:06.302545 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:06:06.302545 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:06:06.302545 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:06:06.302545 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:06:06.302545 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:06:06.302545 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:06:06.304034 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:06:06.304034 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:06:06.304034 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:06:06.304034 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:06:06.304034 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 498/1028] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:06:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:06:06.308253 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bc9c2a-8d48-4908-845d-ce77ecd3e152 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:06.319423 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-5026bafd-871a-49d6-9e9e-87de73ff6d9a None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:06:06.320638 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-5026bafd-871a-49d6-9e9e-87de73ff6d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:06:06.329757 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:06.351173 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:06.388081 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 531/1029] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:06:06 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:06:06.388910 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5026bafd-871a-49d6-9e9e-87de73ff6d9a None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:06.420327 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bc9c2a-8d48-4908-845d-ce77ecd3e152 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:06.452798 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e171ed-7c78-4a0b-b053-6553865bd6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:06.453391 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e171ed-7c78-4a0b-b053-6553865bd6f1 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:06.453670 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e171ed-7c78-4a0b-b053-6553865bd6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:06.453940 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e171ed-7c78-4a0b-b053-6553865bd6f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:06.454647 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e171ed-7c78-4a0b-b053-6553865bd6f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:06:06.454937 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e171ed-7c78-4a0b-b053-6553865bd6f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:06.456417 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e171ed-7c78-4a0b-b053-6553865bd6f1 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:06.467980 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 499/1030] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jul 4 09:06:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:06:06.468768 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e171ed-7c78-4a0b-b053-6553865bd6f1 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:06.496425 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5026bafd-871a-49d6-9e9e-87de73ff6d9a None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:06.530425 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b0a2d0-5d87-4999-b56b-90f9160f82d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:06.531211 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b0a2d0-5d87-4999-b56b-90f9160f82d8 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:06.531490 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b0a2d0-5d87-4999-b56b-90f9160f82d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:06.531762 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b0a2d0-5d87-4999-b56b-90f9160f82d8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:06.532933 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b0a2d0-5d87-4999-b56b-90f9160f82d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:06.534412 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b0a2d0-5d87-4999-b56b-90f9160f82d8 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:06.536195 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 532/1031] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:06:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:06:06.536784 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b0a2d0-5d87-4999-b56b-90f9160f82d8 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:06.547420 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:06.570116 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:06.572881 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e171ed-7c78-4a0b-b053-6553865bd6f1 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:06.610230 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c42dbde-0bd0-455a-b897-5d8574e9bdda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:06.611027 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c42dbde-0bd0-455a-b897-5d8574e9bdda None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:06.611312 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c42dbde-0bd0-455a-b897-5d8574e9bdda None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:06.611585 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c42dbde-0bd0-455a-b897-5d8574e9bdda None admin] PATH_INFO: `/v3/services/image` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:06.612272 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c42dbde-0bd0-455a-b897-5d8574e9bdda None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:06.613677 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c42dbde-0bd0-455a-b897-5d8574e9bdda None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:06.625772 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-9c42dbde-0bd0-455a-b897-5d8574e9bdda None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 04 09:06:06.625772 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:06:06.625772 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 09:06:06.625772 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 09:06:06.625772 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 09:06:06.625772 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 09:06:06.625772 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 09:06:06.625772 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:06:06.625772 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 04 09:06:06.625772 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:06:06.625772 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:06:06.625772 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:06:06.625772 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:06:06.625772 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:06:06.625772 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:06:06.625772 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:06:06.625772 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:06:06.626879 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:06:06.626879 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:06:06.626879 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:06:06.626879 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:06:06.626879 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:06:06.626879 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:06:06.626879 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 09:06:06.626879 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 09:06:06.626879 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 09:06:06.626879 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 09:06:06.626879 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:06:06.626879 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:06:06.626879 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:06:06.626879 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:06:06.626879 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:06:06.626879 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:06:06.628383 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:06:06.628383 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:06:06.628383 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:06:06.628383 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:06:06.628383 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:06:06.628383 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:06:06.628383 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:06:06.628383 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:06:06.628383 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:06:06.628383 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:06:06.628383 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 09:06:06.628383 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:06:06.628383 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 04 09:06:06.628383 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:06:06.628383 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 500/1032] 10.222.0.42 () {56 vars in 1105 bytes} [Mon Jul 4 09:06:06 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:06:06.629197 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c42dbde-0bd0-455a-b897-5d8574e9bdda None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:06.641333 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b0a2d0-5d87-4999-b56b-90f9160f82d8 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:06.674842 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7768055d-02e5-48e4-a083-50cdd06078ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:06.675772 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768055d-02e5-48e4-a083-50cdd06078ad None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:06.676085 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768055d-02e5-48e4-a083-50cdd06078ad None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:06.676362 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768055d-02e5-48e4-a083-50cdd06078ad None admin] PATH_INFO: `/v3/users/nova` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:06.683279 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7768055d-02e5-48e4-a083-50cdd06078ad None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:06.684805 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7768055d-02e5-48e4-a083-50cdd06078ad None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:06.698822 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-7768055d-02e5-48e4-a083-50cdd06078ad None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 04 09:06:06.698822 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:06:06.698822 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:06:06.698822 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:06:06.698822 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:06:06.698822 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:06:06.698822 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:06:06.698822 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:06:06.698822 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:06:06.698822 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:06:06.698822 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:06:06.698822 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:06:06.698822 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:06:06.698822 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:06:06.698822 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:06:06.698822 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:06:06.699794 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:06:06.699794 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:06:06.699794 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:06:06.699794 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:06:06.699794 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:06:06.699794 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:06:06.699794 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:06:06.699794 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:06:06.699794 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:06:06.699794 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:06:06.699794 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:06:06.699794 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:06:06.699794 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:06:06.699794 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:06:06.699794 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:06:06.699794 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:06:06.699794 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:06:06.699794 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:06:06.700783 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:06:06.700783 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:06:06.700783 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:06:06.700783 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:06:06.700783 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:06:06.700783 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:06:06.700783 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:06:06.700783 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:06:06.700783 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 04 09:06:06.700783 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:06:06.700783 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 533/1033] 10.222.0.42 () {56 vars in 1093 bytes} [Mon Jul 4 09:06:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:06:06.700783 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7768055d-02e5-48e4-a083-50cdd06078ad None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:06.725738 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c42dbde-0bd0-455a-b897-5d8574e9bdda None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:06.759160 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e7306b-aa31-48ea-8139-cb46a2763b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:06.759829 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7306b-aa31-48ea-8139-cb46a2763b01 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:06.760143 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7306b-aa31-48ea-8139-cb46a2763b01 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:06.760420 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7306b-aa31-48ea-8139-cb46a2763b01 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:06.761145 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e7306b-aa31-48ea-8139-cb46a2763b01 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:06.762632 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e7306b-aa31-48ea-8139-cb46a2763b01 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:06.771239 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:06.785035 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 501/1034] 10.222.0.42 () {60 vars in 1132 bytes} [Mon Jul 4 09:06:06 2022] POST /identity/v3/users => generated 285 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:06:06.785744 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e7306b-aa31-48ea-8139-cb46a2763b01 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:06.801878 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:06.809447 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7768055d-02e5-48e4-a083-50cdd06078ad None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:06.852621 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af9c1e-a8a9-4fff-a386-f254c6eee0f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:06.853308 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af9c1e-a8a9-4fff-a386-f254c6eee0f0 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:06.853591 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af9c1e-a8a9-4fff-a386-f254c6eee0f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:06.853865 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af9c1e-a8a9-4fff-a386-f254c6eee0f0 None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:06.854584 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5af9c1e-a8a9-4fff-a386-f254c6eee0f0 None admin] RBAC: Adding query filter params (name=image) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:06:06.854887 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5af9c1e-a8a9-4fff-a386-f254c6eee0f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:06.856382 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5af9c1e-a8a9-4fff-a386-f254c6eee0f0 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:06.862232 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 534/1035] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:06:06 2022] GET /identity/v3/services?name=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:06:06.868273 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af9c1e-a8a9-4fff-a386-f254c6eee0f0 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:06.912375 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e7306b-aa31-48ea-8139-cb46a2763b01 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:06.951485 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf6a6de-862a-4183-906d-8d4975d96d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:06.952252 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6a6de-862a-4183-906d-8d4975d96d05 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:06.952538 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6a6de-862a-4183-906d-8d4975d96d05 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:06.952807 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6a6de-862a-4183-906d-8d4975d96d05 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:06.953670 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf6a6de-862a-4183-906d-8d4975d96d05 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:06:06.953978 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf6a6de-862a-4183-906d-8d4975d96d05 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:06.955896 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf6a6de-862a-4183-906d-8d4975d96d05 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:06.977660 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 502/1036] 10.222.0.42 () {56 vars in 1133 bytes} [Mon Jul 4 09:06:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:06:06.983071 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af9c1e-a8a9-4fff-a386-f254c6eee0f0 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:06.984621 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf6a6de-862a-4183-906d-8d4975d96d05 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:07.025459 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeb61c8-d1fc-4989-9b16-264e6ab4cef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:07.026161 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb61c8-d1fc-4989-9b16-264e6ab4cef8 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:07.026445 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb61c8-d1fc-4989-9b16-264e6ab4cef8 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:07.026719 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb61c8-d1fc-4989-9b16-264e6ab4cef8 None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:07.027433 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeb61c8-d1fc-4989-9b16-264e6ab4cef8 None admin] RBAC: Adding query filter params (type=image) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:06:07.027783 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeb61c8-d1fc-4989-9b16-264e6ab4cef8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:07.029223 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeb61c8-d1fc-4989-9b16-264e6ab4cef8 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:07.034605 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 535/1037] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:06:06 2022] GET /identity/v3/services?type=image => generated 350 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:06:07.039989 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeb61c8-d1fc-4989-9b16-264e6ab4cef8 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:07.044238 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:07.065612 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:07.092169 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf6a6de-862a-4183-906d-8d4975d96d05 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:07.127685 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d87a15c-38af-41df-859b-45e4d6335164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:07.128362 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d87a15c-38af-41df-859b-45e4d6335164 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:07.128642 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d87a15c-38af-41df-859b-45e4d6335164 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:07.128914 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d87a15c-38af-41df-859b-45e4d6335164 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:07.146968 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeb61c8-d1fc-4989-9b16-264e6ab4cef8 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:07.185231 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e4a02a-1604-4440-b707-ff597dc5197d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:07.185939 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e4a02a-1604-4440-b707-ff597dc5197d None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:07.186224 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e4a02a-1604-4440-b707-ff597dc5197d None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:07.186499 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e4a02a-1604-4440-b707-ff597dc5197d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:07.187290 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e4a02a-1604-4440-b707-ff597dc5197d None admin] RBAC: Adding query filter params (interface=public, service_id=6d530a1ee3f140cfb82b11da7bf04bef, region_id=RegionOne) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:06:07.187599 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e4a02a-1604-4440-b707-ff597dc5197d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:07.189023 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e4a02a-1604-4440-b707-ff597dc5197d None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:07.198928 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 536/1038] 10.222.0.42 () {56 vars in 1251 bytes} [Mon Jul 4 09:06:07 2022] GET /identity/v3/endpoints?service_id=6d530a1ee3f140cfb82b11da7bf04bef&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:06:07.199893 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e4a02a-1604-4440-b707-ff597dc5197d None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:07.200350 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d87a15c-38af-41df-859b-45e4d6335164 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:07.201851 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d87a15c-38af-41df-859b-45e4d6335164 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:07.255935 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:07.293082 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:07.311923 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 503/1039] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jul 4 09:06:06 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 04 09:06:07.312133 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e4a02a-1604-4440-b707-ff597dc5197d None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:07.312945 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d87a15c-38af-41df-859b-45e4d6335164 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:07.346130 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e806fc-4723-473c-9ecd-7dc9b01e9073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:07.346800 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e806fc-4723-473c-9ecd-7dc9b01e9073 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:07.347076 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e806fc-4723-473c-9ecd-7dc9b01e9073 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:07.347349 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e806fc-4723-473c-9ecd-7dc9b01e9073 None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:07.348058 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e806fc-4723-473c-9ecd-7dc9b01e9073 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:07.349438 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e806fc-4723-473c-9ecd-7dc9b01e9073 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:07.359912 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 537/1040] 10.222.0.42 () {56 vars in 1087 bytes} [Mon Jul 4 09:06:07 2022] GET /identity/v3/services => generated 1957 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:06:07.421925 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d87a15c-38af-41df-859b-45e4d6335164 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:07.458538 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d728d87-9bcf-4543-bee9-19f6491f996f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:07.459336 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d728d87-9bcf-4543-bee9-19f6491f996f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:07.459611 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d728d87-9bcf-4543-bee9-19f6491f996f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:07.459896 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d728d87-9bcf-4543-bee9-19f6491f996f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:07.472240 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d728d87-9bcf-4543-bee9-19f6491f996f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:07.473735 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d728d87-9bcf-4543-bee9-19f6491f996f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:07.492770 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-2d728d87-9bcf-4543-bee9-19f6491f996f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:06:07.492770 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:06:07.492770 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:06:07.492770 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:06:07.492770 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:06:07.492770 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:06:07.492770 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:06:07.492770 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:06:07.492770 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:06:07.492770 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:06:07.492770 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:06:07.492770 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:06:07.492770 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:06:07.492770 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:06:07.492770 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:06:07.493822 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:06:07.493822 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:06:07.493822 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:06:07.493822 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:06:07.493822 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:06:07.493822 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:06:07.493822 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:06:07.493822 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:06:07.493822 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:06:07.493822 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:06:07.493822 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:06:07.493822 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:06:07.493822 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:06:07.493822 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:06:07.493822 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:06:07.493822 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:06:07.493822 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:06:07.499787 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:06:07.499787 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:06:07.499787 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:06:07.499787 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:06:07.499787 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 504/1041] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:06:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:06:07.501697 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e806fc-4723-473c-9ecd-7dc9b01e9073 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:07.605159 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e806fc-4723-473c-9ecd-7dc9b01e9073 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:07.638896 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb11c5f-9298-4f1b-b20d-9f5f137c6564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:07.639556 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb11c5f-9298-4f1b-b20d-9f5f137c6564 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:07.639829 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb11c5f-9298-4f1b-b20d-9f5f137c6564 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:07.640126 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb11c5f-9298-4f1b-b20d-9f5f137c6564 None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:07.640850 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb11c5f-9298-4f1b-b20d-9f5f137c6564 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:06:07.641148 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb11c5f-9298-4f1b-b20d-9f5f137c6564 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:07.642510 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb11c5f-9298-4f1b-b20d-9f5f137c6564 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:07.653932 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 538/1042] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jul 4 09:06:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:06:07.659383 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d728d87-9bcf-4543-bee9-19f6491f996f None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:07.663366 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:07.765381 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d728d87-9bcf-4543-bee9-19f6491f996f None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:07.799140 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2551fbf4-0c14-434b-9036-ebdeefa6363d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:07.799962 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551fbf4-0c14-434b-9036-ebdeefa6363d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:07.800249 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551fbf4-0c14-434b-9036-ebdeefa6363d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:07.800527 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551fbf4-0c14-434b-9036-ebdeefa6363d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:07.807277 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2551fbf4-0c14-434b-9036-ebdeefa6363d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:07.808812 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2551fbf4-0c14-434b-9036-ebdeefa6363d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:07.822559 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-2551fbf4-0c14-434b-9036-ebdeefa6363d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:06:07.822559 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:06:07.822559 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:06:07.822559 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:06:07.822559 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:06:07.822559 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:06:07.822559 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:06:07.822559 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:06:07.822559 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:06:07.822559 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:06:07.822559 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:06:07.822559 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:06:07.822559 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:06:07.822559 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:06:07.822559 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:06:07.823473 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:06:07.823473 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:06:07.823473 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:06:07.823473 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:06:07.823473 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:06:07.823473 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:06:07.823473 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:06:07.823473 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:06:07.823473 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:06:07.823473 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:06:07.823473 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:06:07.823473 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:06:07.823473 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:06:07.823473 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:06:07.823473 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:06:07.823473 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:06:07.823473 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:06:07.829731 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:06:07.829731 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:06:07.829731 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:06:07.829731 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:06:07.829731 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:06:07.829731 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:06:07.829731 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:06:07.829731 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:06:07.829731 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 505/1043] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jul 4 09:06:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:06:07.830238 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb11c5f-9298-4f1b-b20d-9f5f137c6564 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:07.846995 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:07.937731 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb11c5f-9298-4f1b-b20d-9f5f137c6564 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:07.975326 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37d5c23-77f8-4b45-afb4-a5b51b7b1a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:07.976021 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d5c23-77f8-4b45-afb4-a5b51b7b1a0e None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:07.976291 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d5c23-77f8-4b45-afb4-a5b51b7b1a0e None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:07.976585 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d5c23-77f8-4b45-afb4-a5b51b7b1a0e None admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:07.977372 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37d5c23-77f8-4b45-afb4-a5b51b7b1a0e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:06:07.977669 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37d5c23-77f8-4b45-afb4-a5b51b7b1a0e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:07.979111 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37d5c23-77f8-4b45-afb4-a5b51b7b1a0e None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:07.992493 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 539/1044] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Jul 4 09:06:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:06:07.998428 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2551fbf4-0c14-434b-9036-ebdeefa6363d None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:08.060633 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:08.099643 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2551fbf4-0c14-434b-9036-ebdeefa6363d None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:08.134001 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19c331a-8097-4be9-aa39-87be17826b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:08.134649 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19c331a-8097-4be9-aa39-87be17826b40 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:08.134930 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19c331a-8097-4be9-aa39-87be17826b40 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:08.135203 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19c331a-8097-4be9-aa39-87be17826b40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:08.136064 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19c331a-8097-4be9-aa39-87be17826b40 None admin] RBAC: Adding query filter params (role.id=a0417473d97f454c914db70e2d6c9f94, scope.project.id=d015d4f3d9d4464983ff561e8e08523c, user.id=af3b6e252a8c434a99432bcece6493b3) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:06:08.136377 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19c331a-8097-4be9-aa39-87be17826b40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:08.137856 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19c331a-8097-4be9-aa39-87be17826b40 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:08.148336 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 506/1045] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Jul 4 09:06:07 2022] GET /identity/v3/role_assignments?user.id=af3b6e252a8c434a99432bcece6493b3&scope.project.id=d015d4f3d9d4464983ff561e8e08523c&role.id=a0417473d97f454c914db70e2d6c9f94 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:06:08.861424 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fa1f4e-350a-4af5-a4b9-ba138a2a8fa0 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:08.861978 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fa1f4e-350a-4af5-a4b9-ba138a2a8fa0 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:08.861978 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fa1f4e-350a-4af5-a4b9-ba138a2a8fa0 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:08.863387 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 540/1046] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:06:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:06:08.868883 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7305318-e285-401a-ac22-df407ab29f32 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:08.869320 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7305318-e285-401a-ac22-df407ab29f32 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:08.869399 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7305318-e285-401a-ac22-df407ab29f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:08.887611 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-d7305318-e285-401a-ac22-df407ab29f32 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:06:08.888828 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d7305318-e285-401a-ac22-df407ab29f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:06:08.953456 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 507/1047] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:06:08 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:06:08.976829 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fa1f4e-350a-4af5-a4b9-ba138a2a8fa0 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:09.050451 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:09.087626 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fa1f4e-350a-4af5-a4b9-ba138a2a8fa0 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:09.125121 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47e52e1-2d66-44a5-9c43-2b907857fdee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:09.125834 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e52e1-2d66-44a5-9c43-2b907857fdee None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:09.126115 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e52e1-2d66-44a5-9c43-2b907857fdee None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:09.126386 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e52e1-2d66-44a5-9c43-2b907857fdee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:09.136693 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47e52e1-2d66-44a5-9c43-2b907857fdee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:06:09.144330 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-c47e52e1-2d66-44a5-9c43-2b907857fdee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:06:09.144330 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:06:09.144330 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:06:09.144330 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:06:09.144330 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:06:09.144330 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:06:09.144330 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:06:09.144330 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:06:09.144330 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:06:09.144330 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:06:09.144330 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:06:09.144330 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:06:09.144330 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:06:09.144330 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:06:09.144330 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:06:09.144330 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:06:09.145253 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:06:09.145253 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:06:09.145253 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:06:09.145253 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:06:09.145253 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:06:09.145253 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:06:09.145253 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:06:09.145253 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:06:09.145253 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:06:09.145253 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:06:09.145253 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:06:09.145253 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:06:09.145253 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:06:09.145253 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:06:09.145253 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:06:09.145253 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:06:09.146116 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:06:09.146116 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:06:09.146116 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:06:09.146116 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:06:09.146116 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:06:09.146116 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:06:09.146116 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:06:09.146116 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:06:09.146116 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:06:09.146116 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:06:09.146116 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:06:09.146116 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:06:09.148200 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 541/1048] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Jul 4 09:06:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:06:09.151608 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7305318-e285-401a-ac22-df407ab29f32 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:09.214820 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:09.259829 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7305318-e285-401a-ac22-df407ab29f32 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:09.295206 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708b98d4-abd9-4aba-93a3-7c24a721ade9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:09.295892 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b98d4-abd9-4aba-93a3-7c24a721ade9 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:09.296185 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b98d4-abd9-4aba-93a3-7c24a721ade9 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:09.296456 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b98d4-abd9-4aba-93a3-7c24a721ade9 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:09.297199 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708b98d4-abd9-4aba-93a3-7c24a721ade9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:06:09.297497 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708b98d4-abd9-4aba-93a3-7c24a721ade9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:09.298883 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708b98d4-abd9-4aba-93a3-7c24a721ade9 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:09.307328 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 508/1049] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jul 4 09:06:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:06:09.312910 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47e52e1-2d66-44a5-9c43-2b907857fdee None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:09.418972 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47e52e1-2d66-44a5-9c43-2b907857fdee None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:09.421158 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2641a018-cb68-4304-bd8c-203a1a6312f9 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:09.421450 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2641a018-cb68-4304-bd8c-203a1a6312f9 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:09.421721 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2641a018-cb68-4304-bd8c-203a1a6312f9 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:09.423098 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 509/1050] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:06:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:06:09.428001 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2f45f-a10b-4b1e-bdd6-6a71beaf6653 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:09.428289 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2f45f-a10b-4b1e-bdd6-6a71beaf6653 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:09.428565 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2f45f-a10b-4b1e-bdd6-6a71beaf6653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:09.446844 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-69f2f45f-a10b-4b1e-bdd6-6a71beaf6653 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:06:09.448209 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:09.448896 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-69f2f45f-a10b-4b1e-bdd6-6a71beaf6653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:06:09.454072 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c8749-4877-4f48-a940-4ff69b344c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:09.455096 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c8749-4877-4f48-a940-4ff69b344c9e None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:09.455374 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c8749-4877-4f48-a940-4ff69b344c9e None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:09.455643 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c8749-4877-4f48-a940-4ff69b344c9e None admin] PATH_INFO: `/v3/users/52915813ef9a4a248b607d00aa141523` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:09.469304 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6c8749-4877-4f48-a940-4ff69b344c9e None admin] RBAC: Authorizing `identity:get_user(user_id=52915813ef9a4a248b607d00aa141523)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:09.470732 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6c8749-4877-4f48-a940-4ff69b344c9e None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:09.472418 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 542/1051] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Jul 4 09:06:09 2022] GET /identity/v3/users/52915813ef9a4a248b607d00aa141523 => generated 285 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:06:09.477994 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c8749-4877-4f48-a940-4ff69b344c9e None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:09.518727 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 510/1052] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:06:09 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 09:06:09.541878 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f2f45f-a10b-4b1e-bdd6-6a71beaf6653 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:09.576623 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c8749-4877-4f48-a940-4ff69b344c9e None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:09.592589 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:09.615468 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d66726-a635-41dc-8b19-6a4b30598159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:09.616440 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d66726-a635-41dc-8b19-6a4b30598159 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:09.616901 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d66726-a635-41dc-8b19-6a4b30598159 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:09.617555 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d66726-a635-41dc-8b19-6a4b30598159 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:09.647407 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f2f45f-a10b-4b1e-bdd6-6a71beaf6653 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:09.681209 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dbb4a7-a745-4e2d-8f0b-b968c0e29dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:09.681859 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:09.681974 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dbb4a7-a745-4e2d-8f0b-b968c0e29dd4 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:09.682192 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dbb4a7-a745-4e2d-8f0b-b968c0e29dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:09.682446 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dbb4a7-a745-4e2d-8f0b-b968c0e29dd4 None admin] PATH_INFO: `/v3/services/image` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:09.683116 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dbb4a7-a745-4e2d-8f0b-b968c0e29dd4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:09.685012 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dbb4a7-a745-4e2d-8f0b-b968c0e29dd4 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:09.693726 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d66726-a635-41dc-8b19-6a4b30598159 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:09.695173 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d66726-a635-41dc-8b19-6a4b30598159 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:09.696774 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-c4dbb4a7-a745-4e2d-8f0b-b968c0e29dd4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 04 09:06:09.696774 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:06:09.696774 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 09:06:09.696774 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 09:06:09.696774 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 09:06:09.696774 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 09:06:09.696774 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 09:06:09.696774 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:06:09.696774 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 04 09:06:09.696774 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:06:09.696774 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:06:09.696774 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:06:09.696774 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:06:09.696774 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:06:09.696774 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:06:09.696774 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:06:09.696774 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:06:09.697740 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:06:09.697740 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:06:09.697740 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:06:09.697740 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:06:09.697740 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:06:09.697740 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:06:09.697740 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 09:06:09.697740 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 09:06:09.697740 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 09:06:09.697740 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 09:06:09.697740 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:06:09.697740 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:06:09.697740 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:06:09.697740 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:06:09.697740 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:06:09.697740 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:06:09.698598 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:06:09.698598 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:06:09.698598 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:06:09.698598 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:06:09.698598 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:06:09.698598 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:06:09.698598 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:06:09.698598 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:06:09.698598 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:06:09.698598 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:06:09.698598 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 09:06:09.698598 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:06:09.698598 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 04 09:06:09.698598 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:06:09.698598 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 511/1053] 10.222.0.42 () {56 vars in 1105 bytes} [Mon Jul 4 09:06:09 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:06:09.704070 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dbb4a7-a745-4e2d-8f0b-b968c0e29dd4 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:09.804967 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dbb4a7-a745-4e2d-8f0b-b968c0e29dd4 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:09.808062 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 543/1054] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jul 4 09:06:09 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 04 09:06:09.812343 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d66726-a635-41dc-8b19-6a4b30598159 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:09.824332 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:09.850294 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea4d110-05e2-41b3-b873-f9f29b92ede8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:09.850968 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea4d110-05e2-41b3-b873-f9f29b92ede8 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:09.851289 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea4d110-05e2-41b3-b873-f9f29b92ede8 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:09.851571 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea4d110-05e2-41b3-b873-f9f29b92ede8 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:09.852311 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea4d110-05e2-41b3-b873-f9f29b92ede8 None admin] RBAC: Adding query filter params (name=image) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:06:09.852621 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea4d110-05e2-41b3-b873-f9f29b92ede8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:09.854013 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea4d110-05e2-41b3-b873-f9f29b92ede8 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:09.860500 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 512/1055] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:06:09 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:06:09.866280 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea4d110-05e2-41b3-b873-f9f29b92ede8 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:09.911054 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:09.922926 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d66726-a635-41dc-8b19-6a4b30598159 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:09.957076 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903df93a-cdb8-4164-a98e-7b92335f7a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:09.957863 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903df93a-cdb8-4164-a98e-7b92335f7a4f None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:09.958148 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903df93a-cdb8-4164-a98e-7b92335f7a4f None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:09.958430 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903df93a-cdb8-4164-a98e-7b92335f7a4f None admin] PATH_INFO: `/v3/projects/2dc218fe405e466788e5c7321d1151fe` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:09.959613 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903df93a-cdb8-4164-a98e-7b92335f7a4f None admin] RBAC: Authorizing `identity:get_project(project_id=2dc218fe405e466788e5c7321d1151fe)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:09.961105 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903df93a-cdb8-4164-a98e-7b92335f7a4f None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:09.962822 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 544/1056] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jul 4 09:06:09 2022] GET /identity/v3/projects/2dc218fe405e466788e5c7321d1151fe => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:06:09.968791 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903df93a-cdb8-4164-a98e-7b92335f7a4f None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:09.982855 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea4d110-05e2-41b3-b873-f9f29b92ede8 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:10.017323 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef6ca47-a88b-4117-b728-89385205af68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:10.017973 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6ca47-a88b-4117-b728-89385205af68 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:10.018255 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6ca47-a88b-4117-b728-89385205af68 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:10.018530 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6ca47-a88b-4117-b728-89385205af68 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:10.019242 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef6ca47-a88b-4117-b728-89385205af68 None admin] RBAC: Adding query filter params (type=image) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:06:10.019550 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef6ca47-a88b-4117-b728-89385205af68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:10.020978 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef6ca47-a88b-4117-b728-89385205af68 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:10.025961 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 513/1057] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:06:09 2022] GET /identity/v3/services?type=image => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:06:10.031740 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef6ca47-a88b-4117-b728-89385205af68 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:10.076475 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:10.083187 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903df93a-cdb8-4164-a98e-7b92335f7a4f None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:10.118600 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff9e115-2296-46ce-93bc-46abc7624da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:10.119266 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff9e115-2296-46ce-93bc-46abc7624da6 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:10.119550 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff9e115-2296-46ce-93bc-46abc7624da6 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:10.119824 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff9e115-2296-46ce-93bc-46abc7624da6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:10.120690 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff9e115-2296-46ce-93bc-46abc7624da6 None admin] RBAC: Adding query filter params (role.id=965049e7ce6144aaad23c15f3a5e37c3, scope.project.id=2dc218fe405e466788e5c7321d1151fe, user.id=52915813ef9a4a248b607d00aa141523) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:06:10.121006 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff9e115-2296-46ce-93bc-46abc7624da6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:10.122504 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff9e115-2296-46ce-93bc-46abc7624da6 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:10.128647 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 545/1058] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Jul 4 09:06:09 2022] GET /identity/v3/role_assignments?user.id=52915813ef9a4a248b607d00aa141523&scope.project.id=2dc218fe405e466788e5c7321d1151fe&role.id=965049e7ce6144aaad23c15f3a5e37c3 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:06:10.136236 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef6ca47-a88b-4117-b728-89385205af68 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:10.141040 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf63263-394e-44b8-95d5-d056d659c7dd None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:10.141385 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf63263-394e-44b8-95d5-d056d659c7dd None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:10.141589 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf63263-394e-44b8-95d5-d056d659c7dd None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:10.143237 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 546/1059] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:06:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:06:10.149176 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4835db0-2e0f-4a9b-87d7-c2a6c8cb3d6b None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:10.149176 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4835db0-2e0f-4a9b-87d7-c2a6c8cb3d6b None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:10.149479 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4835db0-2e0f-4a9b-87d7-c2a6c8cb3d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:10.166891 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-a4835db0-2e0f-4a9b-87d7-c2a6c8cb3d6b None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:06:10.168198 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-a4835db0-2e0f-4a9b-87d7-c2a6c8cb3d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:06:10.177705 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f9005e-31db-42bc-9bc3-7f24eb5a2bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:10.178380 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9005e-31db-42bc-9bc3-7f24eb5a2bb6 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:10.178660 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9005e-31db-42bc-9bc3-7f24eb5a2bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:10.178929 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9005e-31db-42bc-9bc3-7f24eb5a2bb6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:10.180029 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f9005e-31db-42bc-9bc3-7f24eb5a2bb6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:10.181153 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f9005e-31db-42bc-9bc3-7f24eb5a2bb6 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:10.188671 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:10.204453 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 514/1060] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Jul 4 09:06:10 2022] POST /identity/v3/endpoints => generated 327 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:06:10.258964 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 547/1061] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:06:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 09:06:10.281941 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f9005e-31db-42bc-9bc3-7f24eb5a2bb6 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:10.393188 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:10.398134 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f9005e-31db-42bc-9bc3-7f24eb5a2bb6 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:10.434585 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2935ef73-c951-4fe9-a296-64fb67cbe65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:10.435400 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935ef73-c951-4fe9-a296-64fb67cbe65c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:10.435675 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935ef73-c951-4fe9-a296-64fb67cbe65c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:10.435966 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935ef73-c951-4fe9-a296-64fb67cbe65c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:10.446289 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2935ef73-c951-4fe9-a296-64fb67cbe65c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:06:10.454383 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-2935ef73-c951-4fe9-a296-64fb67cbe65c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 04 09:06:10.454383 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:06:10.454383 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:06:10.454383 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:06:10.454383 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:06:10.454383 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:06:10.454383 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:06:10.454383 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:06:10.454383 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:06:10.454383 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:06:10.454383 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:06:10.454383 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:06:10.454383 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:06:10.454383 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:06:10.454383 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:06:10.454383 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:06:10.455314 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:06:10.455314 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:06:10.455314 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:06:10.455314 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:06:10.455314 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:06:10.455314 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:06:10.455314 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:06:10.455314 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:06:10.455314 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:06:10.455314 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:06:10.455314 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:06:10.455314 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:06:10.455314 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:06:10.455314 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:06:10.455314 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:06:10.455314 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:06:10.461660 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:06:10.461660 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:06:10.461660 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:06:10.461660 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:06:10.461660 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:06:10.461660 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:06:10.461660 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:06:10.461660 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:06:10.461660 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:06:10.461660 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:06:10.461660 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 04 09:06:10.461660 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:06:10.461660 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 515/1062] 10.222.0.42 () {56 vars in 1120 bytes} [Mon Jul 4 09:06:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:06:10.462354 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4835db0-2e0f-4a9b-87d7-c2a6c8cb3d6b None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:10.558757 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4835db0-2e0f-4a9b-87d7-c2a6c8cb3d6b None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:10.599497 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762abef3-29df-468e-bbe2-71867be77a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:10.600212 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762abef3-29df-468e-bbe2-71867be77a3b None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:10.600495 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762abef3-29df-468e-bbe2-71867be77a3b None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:10.600774 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762abef3-29df-468e-bbe2-71867be77a3b None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:10.601525 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762abef3-29df-468e-bbe2-71867be77a3b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:06:10.601832 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762abef3-29df-468e-bbe2-71867be77a3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:10.603209 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762abef3-29df-468e-bbe2-71867be77a3b None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:10.617234 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 548/1063] 10.222.0.42 () {56 vars in 1115 bytes} [Mon Jul 4 09:06:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:06:10.618569 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2935ef73-c951-4fe9-a296-64fb67cbe65c None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:10.722588 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2935ef73-c951-4fe9-a296-64fb67cbe65c None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:10.756668 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a097c-535e-4e9e-a67d-924f1289ea60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:10.757467 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a097c-535e-4e9e-a67d-924f1289ea60 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:10.757752 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a097c-535e-4e9e-a67d-924f1289ea60 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:10.758025 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a097c-535e-4e9e-a67d-924f1289ea60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:10.776713 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164a097c-535e-4e9e-a67d-924f1289ea60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:10.778229 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164a097c-535e-4e9e-a67d-924f1289ea60 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:10.795773 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-164a097c-535e-4e9e-a67d-924f1289ea60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:06:10.795773 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:06:10.795773 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:06:10.795773 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:06:10.795773 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:06:10.795773 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:06:10.795773 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:06:10.795773 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:06:10.795773 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:06:10.795773 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:06:10.795773 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:06:10.795773 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:06:10.795773 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:06:10.795773 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:06:10.795773 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:06:10.796701 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:06:10.796701 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:06:10.796701 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:06:10.796701 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:06:10.796701 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:06:10.796701 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:06:10.796701 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:06:10.796701 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:06:10.796701 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:06:10.796701 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:06:10.796701 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:06:10.796701 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:06:10.796701 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:06:10.796701 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:06:10.796701 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:06:10.796701 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:06:10.796701 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:06:10.797604 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:06:10.797604 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:06:10.797604 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:06:10.797604 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:06:10.800269 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 516/1064] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:06:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:06:10.802792 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762abef3-29df-468e-bbe2-71867be77a3b None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:10.816987 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:10.923245 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762abef3-29df-468e-bbe2-71867be77a3b None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:10.957728 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbb08fe-56c9-41ec-90f2-27896959377c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:10.958394 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb08fe-56c9-41ec-90f2-27896959377c None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:10.958679 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb08fe-56c9-41ec-90f2-27896959377c None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:10.958958 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb08fe-56c9-41ec-90f2-27896959377c None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:10.959681 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbb08fe-56c9-41ec-90f2-27896959377c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:06:10.960019 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbb08fe-56c9-41ec-90f2-27896959377c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:10.961405 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbb08fe-56c9-41ec-90f2-27896959377c None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:10.977821 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 549/1065] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jul 4 09:06:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:06:10.979530 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a097c-535e-4e9e-a67d-924f1289ea60 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:10.993595 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:11.093972 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a097c-535e-4e9e-a67d-924f1289ea60 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:11.127687 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f3af13-20c8-435a-a054-7e37687caa0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:11.128505 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f3af13-20c8-435a-a054-7e37687caa0a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:11.128787 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f3af13-20c8-435a-a054-7e37687caa0a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:11.129064 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f3af13-20c8-435a-a054-7e37687caa0a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:11.136546 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f3af13-20c8-435a-a054-7e37687caa0a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:11.138052 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f3af13-20c8-435a-a054-7e37687caa0a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:11.151838 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-19f3af13-20c8-435a-a054-7e37687caa0a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 04 09:06:11.151838 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:06:11.151838 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:06:11.151838 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:06:11.151838 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:06:11.151838 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:06:11.151838 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:06:11.151838 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:06:11.151838 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:06:11.151838 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:06:11.151838 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:06:11.151838 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:06:11.151838 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:06:11.151838 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:06:11.151838 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:06:11.151838 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:06:11.152890 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:06:11.152890 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:06:11.152890 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:06:11.152890 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:06:11.152890 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:06:11.152890 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:06:11.152890 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:06:11.152890 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:06:11.152890 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:06:11.152890 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:06:11.152890 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:06:11.152890 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:06:11.152890 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:06:11.152890 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:06:11.152890 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:06:11.152890 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:06:11.152890 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:06:11.152890 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:06:11.158638 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:06:11.158638 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:06:11.158638 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:06:11.158638 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:06:11.158638 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:06:11.158638 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:06:11.158638 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:06:11.158638 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:06:11.158638 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 04 09:06:11.158638 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:06:11.158638 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 517/1066] 10.222.0.42 () {56 vars in 1093 bytes} [Mon Jul 4 09:06:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:06:11.160738 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbb08fe-56c9-41ec-90f2-27896959377c None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:11.235940 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:11.267973 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbb08fe-56c9-41ec-90f2-27896959377c None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:11.302285 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf20ed4c-cd7e-4a87-acad-c86cd2838874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:11.302956 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf20ed4c-cd7e-4a87-acad-c86cd2838874 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:11.303239 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf20ed4c-cd7e-4a87-acad-c86cd2838874 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:11.303510 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf20ed4c-cd7e-4a87-acad-c86cd2838874 None admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:11.304386 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf20ed4c-cd7e-4a87-acad-c86cd2838874 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:06:11.304695 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf20ed4c-cd7e-4a87-acad-c86cd2838874 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:11.306128 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf20ed4c-cd7e-4a87-acad-c86cd2838874 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:11.323805 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 550/1067] 10.222.0.42 () {56 vars in 1133 bytes} [Mon Jul 4 09:06:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:06:11.329528 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f3af13-20c8-435a-a054-7e37687caa0a None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:11.401691 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:11.435680 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f3af13-20c8-435a-a054-7e37687caa0a None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:11.470672 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daab6bc5-996c-49ad-868b-02a84dda7b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:11.471465 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab6bc5-996c-49ad-868b-02a84dda7b6c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:11.471740 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab6bc5-996c-49ad-868b-02a84dda7b6c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:11.472037 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab6bc5-996c-49ad-868b-02a84dda7b6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:11.482774 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daab6bc5-996c-49ad-868b-02a84dda7b6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:11.484575 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daab6bc5-996c-49ad-868b-02a84dda7b6c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:11.501398 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-daab6bc5-996c-49ad-868b-02a84dda7b6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:06:11.501398 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:06:11.501398 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:06:11.501398 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:06:11.501398 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:06:11.501398 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:06:11.501398 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:06:11.501398 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:06:11.501398 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:06:11.501398 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:06:11.501398 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:06:11.501398 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:06:11.501398 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:06:11.501398 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:06:11.501398 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:06:11.502284 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:06:11.502284 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:06:11.502284 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:06:11.502284 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:06:11.502284 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:06:11.502284 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:06:11.502284 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:06:11.502284 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:06:11.502284 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:06:11.502284 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:06:11.502284 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:06:11.502284 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:06:11.502284 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:06:11.502284 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:06:11.502284 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:06:11.502284 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:06:11.502284 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:06:11.503186 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:06:11.503186 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:06:11.503186 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:06:11.503186 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:06:11.504219 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 518/1068] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:06:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:06:11.508515 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf20ed4c-cd7e-4a87-acad-c86cd2838874 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:11.614196 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf20ed4c-cd7e-4a87-acad-c86cd2838874 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:11.642145 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:11.651503 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f23f14d-3987-4e8c-be1f-807129837f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:11.652360 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f23f14d-3987-4e8c-be1f-807129837f16 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:11.652621 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f23f14d-3987-4e8c-be1f-807129837f16 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:11.652898 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f23f14d-3987-4e8c-be1f-807129837f16 None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:11.653632 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f23f14d-3987-4e8c-be1f-807129837f16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:06:11.653940 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f23f14d-3987-4e8c-be1f-807129837f16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:11.655325 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f23f14d-3987-4e8c-be1f-807129837f16 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:11.667005 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 551/1069] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jul 4 09:06:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:06:11.672590 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daab6bc5-996c-49ad-868b-02a84dda7b6c None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:11.777402 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daab6bc5-996c-49ad-868b-02a84dda7b6c None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:11.800539 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:11.813822 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6928360a-6949-4e52-9ff5-1fa2508d6446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:11.814758 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928360a-6949-4e52-9ff5-1fa2508d6446 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:11.815136 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928360a-6949-4e52-9ff5-1fa2508d6446 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:11.815501 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928360a-6949-4e52-9ff5-1fa2508d6446 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:11.822468 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6928360a-6949-4e52-9ff5-1fa2508d6446 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:11.824058 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6928360a-6949-4e52-9ff5-1fa2508d6446 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:11.838300 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-6928360a-6949-4e52-9ff5-1fa2508d6446 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:06:11.838300 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:06:11.838300 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:06:11.838300 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:06:11.838300 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:06:11.838300 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:06:11.838300 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:06:11.838300 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:06:11.838300 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:06:11.838300 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:06:11.838300 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:06:11.838300 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:06:11.838300 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:06:11.838300 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:06:11.838300 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:06:11.839421 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:06:11.839421 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:06:11.839421 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:06:11.839421 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:06:11.839421 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:06:11.839421 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:06:11.839421 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:06:11.839421 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:06:11.839421 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:06:11.839421 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:06:11.839421 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:06:11.839421 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:06:11.839421 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:06:11.839421 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:06:11.839421 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:06:11.839421 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:06:11.839421 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:06:11.840695 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:06:11.840695 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:06:11.840695 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:06:11.840695 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:06:11.840695 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:06:11.840695 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:06:11.840695 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:06:11.840695 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:06:11.842224 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 519/1070] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jul 4 09:06:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:06:11.848132 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f23f14d-3987-4e8c-be1f-807129837f16 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:11.965839 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f23f14d-3987-4e8c-be1f-807129837f16 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:12.001007 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06c84b5-739f-420c-b58e-0572a94cc216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:12.001674 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c84b5-739f-420c-b58e-0572a94cc216 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:12.001926 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c84b5-739f-420c-b58e-0572a94cc216 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:12.002225 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c84b5-739f-420c-b58e-0572a94cc216 None admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:12.003009 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06c84b5-739f-420c-b58e-0572a94cc216 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:06:12.003311 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06c84b5-739f-420c-b58e-0572a94cc216 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:12.004774 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06c84b5-739f-420c-b58e-0572a94cc216 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:12.017855 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 552/1071] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Jul 4 09:06:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:06:12.023691 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6928360a-6949-4e52-9ff5-1fa2508d6446 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:12.128626 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6928360a-6949-4e52-9ff5-1fa2508d6446 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:12.151814 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d128307-6dc5-4efb-bd2d-c7e9649977e4 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:12.152160 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d128307-6dc5-4efb-bd2d-c7e9649977e4 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:12.152479 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d128307-6dc5-4efb-bd2d-c7e9649977e4 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:12.154085 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 553/1072] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:06:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:06:12.158823 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af03f40-be2d-491c-8bd9-4eabca02c43d None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:12.159118 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af03f40-be2d-491c-8bd9-4eabca02c43d None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:12.159405 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af03f40-be2d-491c-8bd9-4eabca02c43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:12.164480 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdb4510-69ce-4ad8-b356-80186aabd01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:12.166221 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb4510-69ce-4ad8-b356-80186aabd01e None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:12.166501 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb4510-69ce-4ad8-b356-80186aabd01e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:12.166778 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb4510-69ce-4ad8-b356-80186aabd01e None admin] PATH_INFO: `/v3/projects/d015d4f3d9d4464983ff561e8e08523c/users/af3b6e252a8c434a99432bcece6493b3/roles/a0417473d97f454c914db70e2d6c9f94` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:12.169037 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdb4510-69ce-4ad8-b356-80186aabd01e None admin] RBAC: Authorizing `identity:create_grant(project_id=d015d4f3d9d4464983ff561e8e08523c, user_id=af3b6e252a8c434a99432bcece6493b3, role_id=a0417473d97f454c914db70e2d6c9f94)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:12.170928 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdb4510-69ce-4ad8-b356-80186aabd01e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:12.175697 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-9af03f40-be2d-491c-8bd9-4eabca02c43d None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:06:12.177149 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-9af03f40-be2d-491c-8bd9-4eabca02c43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:06:12.191892 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 520/1073] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Jul 4 09:06:12 2022] PUT /identity/v3/projects/d015d4f3d9d4464983ff561e8e08523c/users/af3b6e252a8c434a99432bcece6493b3/roles/a0417473d97f454c914db70e2d6c9f94 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:06:12.226640 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:12.253336 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 554/1074] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:06:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 09:06:12.260790 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c0660-1b99-4f6a-bf79-624a6c121c25 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:12.261078 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c0660-1b99-4f6a-bf79-624a6c121c25 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:12.261354 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c0660-1b99-4f6a-bf79-624a6c121c25 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:12.262892 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 521/1075] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:06:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:06:12.269770 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1415e55-a057-4874-9146-701221044446 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:12.270107 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1415e55-a057-4874-9146-701221044446 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:12.270344 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1415e55-a057-4874-9146-701221044446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:12.277809 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694c0660-1b99-4f6a-bf79-624a6c121c25 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:12.288639 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-c1415e55-a057-4874-9146-701221044446 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:06:12.289906 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-c1415e55-a057-4874-9146-701221044446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:06:12.327906 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:12.364592 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 555/1076] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:06:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:06:12.386620 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1415e55-a057-4874-9146-701221044446 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:12.396864 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694c0660-1b99-4f6a-bf79-624a6c121c25 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:12.435028 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52394b6-a397-4afb-bf28-56a3560efa33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:12.435831 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52394b6-a397-4afb-bf28-56a3560efa33 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:12.436247 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52394b6-a397-4afb-bf28-56a3560efa33 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:12.436522 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52394b6-a397-4afb-bf28-56a3560efa33 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:12.446581 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52394b6-a397-4afb-bf28-56a3560efa33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:06:12.454230 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-c52394b6-a397-4afb-bf28-56a3560efa33 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:06:12.454230 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:06:12.454230 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:06:12.454230 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:06:12.454230 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:06:12.454230 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:06:12.454230 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:06:12.454230 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:06:12.454230 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:06:12.454230 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:06:12.454230 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:06:12.454230 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:06:12.454230 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:06:12.454230 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:06:12.454230 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:06:12.454230 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:06:12.455344 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:06:12.455344 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:06:12.455344 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:06:12.455344 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:06:12.455344 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:06:12.455344 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:06:12.455344 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:06:12.455344 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:06:12.455344 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:06:12.455344 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:06:12.455344 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:06:12.455344 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:06:12.455344 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:06:12.455344 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:06:12.455344 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:06:12.455344 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:06:12.456347 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:06:12.456347 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:06:12.456347 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:06:12.456347 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:06:12.456347 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:06:12.456347 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:06:12.456347 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:06:12.456347 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:06:12.456347 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:06:12.456347 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:06:12.456347 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:06:12.456347 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:06:12.456347 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 522/1077] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Jul 4 09:06:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:06:12.461555 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52394b6-a397-4afb-bf28-56a3560efa33 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:12.494805 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1415e55-a057-4874-9146-701221044446 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:12.504386 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:12.532285 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5391e39-9ea1-47ab-bfdc-70f2ae4d204e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:12.532940 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5391e39-9ea1-47ab-bfdc-70f2ae4d204e None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:12.533223 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5391e39-9ea1-47ab-bfdc-70f2ae4d204e None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:12.533500 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5391e39-9ea1-47ab-bfdc-70f2ae4d204e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:12.568982 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52394b6-a397-4afb-bf28-56a3560efa33 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:12.570710 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:12.605195 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed193d5a-f141-475d-b93d-fea36d2d252f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:12.605904 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed193d5a-f141-475d-b93d-fea36d2d252f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:12.606185 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed193d5a-f141-475d-b93d-fea36d2d252f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:12.606456 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed193d5a-f141-475d-b93d-fea36d2d252f None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:12.607205 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed193d5a-f141-475d-b93d-fea36d2d252f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:06:12.607512 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed193d5a-f141-475d-b93d-fea36d2d252f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:12.608927 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed193d5a-f141-475d-b93d-fea36d2d252f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:12.609834 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5391e39-9ea1-47ab-bfdc-70f2ae4d204e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:12.611382 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5391e39-9ea1-47ab-bfdc-70f2ae4d204e None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:12.618689 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 523/1078] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jul 4 09:06:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:06:12.624683 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed193d5a-f141-475d-b93d-fea36d2d252f None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:12.717569 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 556/1079] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jul 4 09:06:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 04 09:06:12.723699 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5391e39-9ea1-47ab-bfdc-70f2ae4d204e None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:12.729826 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed193d5a-f141-475d-b93d-fea36d2d252f None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:12.733864 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:12.765382 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79df9c4-2828-4492-858a-1a44b95a37ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:12.766169 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79df9c4-2828-4492-858a-1a44b95a37ca None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:12.766447 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79df9c4-2828-4492-858a-1a44b95a37ca None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:12.766717 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79df9c4-2828-4492-858a-1a44b95a37ca None admin] PATH_INFO: `/v3/users/52915813ef9a4a248b607d00aa141523` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:12.767919 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79df9c4-2828-4492-858a-1a44b95a37ca None admin] RBAC: Authorizing `identity:get_user(user_id=52915813ef9a4a248b607d00aa141523)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:12.769368 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79df9c4-2828-4492-858a-1a44b95a37ca None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:12.771915 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 524/1080] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Jul 4 09:06:12 2022] GET /identity/v3/users/52915813ef9a4a248b607d00aa141523 => generated 285 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:06:12.776766 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79df9c4-2828-4492-858a-1a44b95a37ca None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:12.807514 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:12.832778 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5391e39-9ea1-47ab-bfdc-70f2ae4d204e None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:12.870074 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437719ce-c44e-4cf3-b6bc-491f3d91cf53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:12.870961 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437719ce-c44e-4cf3-b6bc-491f3d91cf53 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:12.871294 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437719ce-c44e-4cf3-b6bc-491f3d91cf53 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:12.871566 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437719ce-c44e-4cf3-b6bc-491f3d91cf53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:12.876616 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79df9c4-2828-4492-858a-1a44b95a37ca None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:12.886228 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437719ce-c44e-4cf3-b6bc-491f3d91cf53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:12.886228 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437719ce-c44e-4cf3-b6bc-491f3d91cf53 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:12.909218 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-437719ce-c44e-4cf3-b6bc-491f3d91cf53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:06:12.909218 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:06:12.909218 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:06:12.909218 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:06:12.909218 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:06:12.909218 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:06:12.909218 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:06:12.909218 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:06:12.909218 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:06:12.909218 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:06:12.909218 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:06:12.909218 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:06:12.909218 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:06:12.909218 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:06:12.909218 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:06:12.910170 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:06:12.910170 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:06:12.910170 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:06:12.910170 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:06:12.910170 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:06:12.910170 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:06:12.910170 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:06:12.910170 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:06:12.910170 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:06:12.910170 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:06:12.910170 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:06:12.910170 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:06:12.910170 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:06:12.910170 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:06:12.910170 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:06:12.910170 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:06:12.910170 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:06:12.911083 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:06:12.911083 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:06:12.911083 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:06:12.911083 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:06:12.911083 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 557/1081] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:06:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:06:12.916258 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437719ce-c44e-4cf3-b6bc-491f3d91cf53 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:12.926322 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d8058c-4045-498a-a909-11a97868dcda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:12.927184 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d8058c-4045-498a-a909-11a97868dcda None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:12.927807 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d8058c-4045-498a-a909-11a97868dcda None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:12.928113 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d8058c-4045-498a-a909-11a97868dcda None admin] PATH_INFO: `/v3/projects/2dc218fe405e466788e5c7321d1151fe` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:12.929577 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d8058c-4045-498a-a909-11a97868dcda None admin] RBAC: Authorizing `identity:get_project(project_id=2dc218fe405e466788e5c7321d1151fe)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:12.931017 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d8058c-4045-498a-a909-11a97868dcda None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:12.932842 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 525/1082] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jul 4 09:06:12 2022] GET /identity/v3/projects/2dc218fe405e466788e5c7321d1151fe => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:06:12.938640 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d8058c-4045-498a-a909-11a97868dcda None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:12.981658 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:13.024111 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437719ce-c44e-4cf3-b6bc-491f3d91cf53 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:13.037710 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:13.041189 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d8058c-4045-498a-a909-11a97868dcda None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:13.059490 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58ef459-e5c5-4f50-8ef1-897cd3537390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:13.060186 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ef459-e5c5-4f50-8ef1-897cd3537390 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:13.060471 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ef459-e5c5-4f50-8ef1-897cd3537390 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:13.060751 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ef459-e5c5-4f50-8ef1-897cd3537390 None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:13.061472 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58ef459-e5c5-4f50-8ef1-897cd3537390 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:06:13.061778 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58ef459-e5c5-4f50-8ef1-897cd3537390 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:13.063168 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58ef459-e5c5-4f50-8ef1-897cd3537390 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:13.076367 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 558/1083] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jul 4 09:06:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:06:13.079241 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2ee680-8769-43c6-9d36-a68ba68e9722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:13.080415 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2ee680-8769-43c6-9d36-a68ba68e9722 None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:13.080872 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2ee680-8769-43c6-9d36-a68ba68e9722 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:13.081332 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2ee680-8769-43c6-9d36-a68ba68e9722 None admin] PATH_INFO: `/v3/projects/2dc218fe405e466788e5c7321d1151fe/users/52915813ef9a4a248b607d00aa141523/roles/965049e7ce6144aaad23c15f3a5e37c3` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:13.083537 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2ee680-8769-43c6-9d36-a68ba68e9722 None admin] RBAC: Authorizing `identity:create_grant(project_id=2dc218fe405e466788e5c7321d1151fe, user_id=52915813ef9a4a248b607d00aa141523, role_id=965049e7ce6144aaad23c15f3a5e37c3)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:13.085244 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2ee680-8769-43c6-9d36-a68ba68e9722 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:13.102045 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 526/1084] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Jul 4 09:06:12 2022] PUT /identity/v3/projects/2dc218fe405e466788e5c7321d1151fe/users/52915813ef9a4a248b607d00aa141523/roles/965049e7ce6144aaad23c15f3a5e37c3 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:06:14.216168 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4114a55a-7de8-405a-9805-1c43161b1e95 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:14.216744 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4114a55a-7de8-405a-9805-1c43161b1e95 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:14.216744 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4114a55a-7de8-405a-9805-1c43161b1e95 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:14.218108 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 559/1085] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:06:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:06:14.223999 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3481b9-c53f-4f84-8b80-50a39e9098c6 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:14.224524 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3481b9-c53f-4f84-8b80-50a39e9098c6 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:14.224524 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3481b9-c53f-4f84-8b80-50a39e9098c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:14.242450 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-3a3481b9-c53f-4f84-8b80-50a39e9098c6 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:06:14.243642 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3a3481b9-c53f-4f84-8b80-50a39e9098c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:06:14.312622 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 527/1086] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:06:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:06:14.336189 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4114a55a-7de8-405a-9805-1c43161b1e95 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:14.442924 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4114a55a-7de8-405a-9805-1c43161b1e95 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:14.463002 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:14.481406 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdc7af9-278d-43bc-9062-36ff8f7dec3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:14.482149 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc7af9-278d-43bc-9062-36ff8f7dec3b None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:14.482434 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc7af9-278d-43bc-9062-36ff8f7dec3b None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:14.482708 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc7af9-278d-43bc-9062-36ff8f7dec3b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:14.493624 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdc7af9-278d-43bc-9062-36ff8f7dec3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:06:14.501622 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-dbdc7af9-278d-43bc-9062-36ff8f7dec3b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 04 09:06:14.501622 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:06:14.501622 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:06:14.501622 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:06:14.501622 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:06:14.501622 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:06:14.501622 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:06:14.501622 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:06:14.501622 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:06:14.501622 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:06:14.501622 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:06:14.501622 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:06:14.501622 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:06:14.501622 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:06:14.501622 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:06:14.501622 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:06:14.502715 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:06:14.502715 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:06:14.502715 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:06:14.502715 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:06:14.502715 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:06:14.502715 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:06:14.502715 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:06:14.502715 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:06:14.502715 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:06:14.502715 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:06:14.502715 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:06:14.502715 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:06:14.502715 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:06:14.502715 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:06:14.502715 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:06:14.502715 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:06:14.503565 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:06:14.503565 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:06:14.503565 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:06:14.503565 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:06:14.503565 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:06:14.503565 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:06:14.503565 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:06:14.503565 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:06:14.503565 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:06:14.503565 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:06:14.503565 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 04 09:06:14.503565 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:06:14.503565 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 560/1087] 10.222.0.42 () {56 vars in 1120 bytes} [Mon Jul 4 09:06:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:06:14.508881 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3481b9-c53f-4f84-8b80-50a39e9098c6 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:14.600347 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:14.611757 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3481b9-c53f-4f84-8b80-50a39e9098c6 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:14.645389 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33186b1-07d2-455b-b137-4faeb84beb21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:14.646060 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33186b1-07d2-455b-b137-4faeb84beb21 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:14.646343 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33186b1-07d2-455b-b137-4faeb84beb21 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:14.646618 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33186b1-07d2-455b-b137-4faeb84beb21 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:14.647360 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33186b1-07d2-455b-b137-4faeb84beb21 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:06:14.647667 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33186b1-07d2-455b-b137-4faeb84beb21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:14.649104 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33186b1-07d2-455b-b137-4faeb84beb21 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:14.657318 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 528/1088] 10.222.0.42 () {56 vars in 1115 bytes} [Mon Jul 4 09:06:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:06:14.663072 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdc7af9-278d-43bc-9062-36ff8f7dec3b None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:14.764478 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdc7af9-278d-43bc-9062-36ff8f7dec3b None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:14.799255 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ab42f8-3048-44aa-9403-3a7817ce9a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:14.800072 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab42f8-3048-44aa-9403-3a7817ce9a07 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:14.800353 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab42f8-3048-44aa-9403-3a7817ce9a07 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:14.800623 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab42f8-3048-44aa-9403-3a7817ce9a07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:14.810995 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ab42f8-3048-44aa-9403-3a7817ce9a07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:14.812508 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ab42f8-3048-44aa-9403-3a7817ce9a07 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:14.830047 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-b0ab42f8-3048-44aa-9403-3a7817ce9a07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:06:14.830047 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:06:14.830047 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:06:14.830047 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:06:14.830047 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:06:14.830047 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:06:14.830047 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:06:14.830047 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:06:14.830047 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:06:14.830047 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:06:14.830047 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:06:14.830047 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:06:14.830047 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:06:14.830047 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:06:14.830047 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:06:14.830983 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:06:14.830983 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:06:14.830983 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:06:14.830983 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:06:14.830983 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:06:14.830983 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:06:14.830983 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:06:14.830983 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:06:14.830983 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:06:14.830983 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:06:14.830983 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:06:14.830983 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:06:14.830983 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:06:14.830983 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:06:14.830983 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:06:14.830983 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:06:14.830983 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:06:14.831913 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:06:14.831913 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:06:14.831913 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:06:14.831913 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:06:14.831913 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 561/1089] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:06:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:06:14.837077 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33186b1-07d2-455b-b137-4faeb84beb21 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:14.947605 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33186b1-07d2-455b-b137-4faeb84beb21 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:14.986374 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a13e45-1c96-46b9-a10e-9c04e5bd09ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:14.987053 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a13e45-1c96-46b9-a10e-9c04e5bd09ab None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:14.987307 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a13e45-1c96-46b9-a10e-9c04e5bd09ab None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:14.987583 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a13e45-1c96-46b9-a10e-9c04e5bd09ab None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:14.988332 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a13e45-1c96-46b9-a10e-9c04e5bd09ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:06:14.988642 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a13e45-1c96-46b9-a10e-9c04e5bd09ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:14.990039 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a13e45-1c96-46b9-a10e-9c04e5bd09ab None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:15.002686 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 529/1090] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jul 4 09:06:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:06:15.008357 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ab42f8-3048-44aa-9403-3a7817ce9a07 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:15.040932 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:15.119426 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ab42f8-3048-44aa-9403-3a7817ce9a07 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:15.154583 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432845ce-f70b-40ee-b27b-bb0eebdc819c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:15.155370 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432845ce-f70b-40ee-b27b-bb0eebdc819c None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:15.155652 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432845ce-f70b-40ee-b27b-bb0eebdc819c None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:15.155934 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432845ce-f70b-40ee-b27b-bb0eebdc819c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:15.160778 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde8f3f-3349-48f7-ba4c-7fa3147e82c6 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:15.161070 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde8f3f-3349-48f7-ba4c-7fa3147e82c6 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:15.161345 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde8f3f-3349-48f7-ba4c-7fa3147e82c6 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:15.162732 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 530/1091] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:06:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:06:15.165199 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432845ce-f70b-40ee-b27b-bb0eebdc819c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:15.166744 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432845ce-f70b-40ee-b27b-bb0eebdc819c None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:15.167545 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41077322-67ce-41c9-a423-499156169b77 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:15.167836 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41077322-67ce-41c9-a423-499156169b77 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:15.168153 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41077322-67ce-41c9-a423-499156169b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:15.180586 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-432845ce-f70b-40ee-b27b-bb0eebdc819c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 04 09:06:15.180586 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:06:15.180586 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:06:15.180586 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:06:15.180586 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:06:15.180586 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:06:15.180586 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:06:15.180586 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:06:15.180586 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:06:15.180586 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:06:15.180586 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:06:15.180586 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:06:15.180586 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:06:15.180586 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:06:15.180586 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:06:15.180586 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:06:15.181600 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:06:15.181600 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:06:15.181600 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:06:15.181600 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:06:15.181600 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:06:15.181600 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:06:15.181600 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:06:15.181600 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:06:15.181600 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:06:15.181600 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:06:15.181600 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:06:15.181600 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:06:15.181600 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:06:15.181600 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:06:15.181600 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:06:15.181600 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:06:15.181600 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:06:15.181600 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:06:15.182539 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:06:15.182539 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:06:15.182539 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:06:15.182539 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:06:15.182539 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:06:15.182539 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:06:15.182539 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:06:15.182539 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:06:15.182539 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 04 09:06:15.182539 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:06:15.182539 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 562/1092] 10.222.0.42 () {56 vars in 1093 bytes} [Mon Jul 4 09:06:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:06:15.186783 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-41077322-67ce-41c9-a423-499156169b77 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:06:15.187575 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432845ce-f70b-40ee-b27b-bb0eebdc819c None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:15.188001 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-41077322-67ce-41c9-a423-499156169b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:06:15.197184 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:15.258385 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 531/1093] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:06:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:06:15.278901 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:15.281968 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41077322-67ce-41c9-a423-499156169b77 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:15.287965 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432845ce-f70b-40ee-b27b-bb0eebdc819c None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:15.321172 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d4bcd7-2a33-4d59-b08e-efa0a33a4802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:15.321785 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4bcd7-2a33-4d59-b08e-efa0a33a4802 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:15.322056 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4bcd7-2a33-4d59-b08e-efa0a33a4802 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:15.322326 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4bcd7-2a33-4d59-b08e-efa0a33a4802 None admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:15.323152 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d4bcd7-2a33-4d59-b08e-efa0a33a4802 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:06:15.323463 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d4bcd7-2a33-4d59-b08e-efa0a33a4802 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:15.324997 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d4bcd7-2a33-4d59-b08e-efa0a33a4802 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:15.342959 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 563/1094] 10.222.0.42 () {56 vars in 1133 bytes} [Mon Jul 4 09:06:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:06:15.348697 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d4bcd7-2a33-4d59-b08e-efa0a33a4802 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:15.380012 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41077322-67ce-41c9-a423-499156169b77 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:15.413579 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7525044f-3aa7-4de7-a920-615ebac7c595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:15.414367 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7525044f-3aa7-4de7-a920-615ebac7c595 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:15.414647 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7525044f-3aa7-4de7-a920-615ebac7c595 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:15.414918 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7525044f-3aa7-4de7-a920-615ebac7c595 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:15.425092 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7525044f-3aa7-4de7-a920-615ebac7c595 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:06:15.432657 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-7525044f-3aa7-4de7-a920-615ebac7c595 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:06:15.432657 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:06:15.432657 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:06:15.432657 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:06:15.432657 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:06:15.432657 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:06:15.432657 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:06:15.432657 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:06:15.432657 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:06:15.432657 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:06:15.432657 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:06:15.432657 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:06:15.432657 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:06:15.432657 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:06:15.432657 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:06:15.432657 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:06:15.433657 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:06:15.433657 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:06:15.433657 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:06:15.433657 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:06:15.433657 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:06:15.433657 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:06:15.433657 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:06:15.433657 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:06:15.433657 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:06:15.433657 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:06:15.433657 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:06:15.433657 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:06:15.433657 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:06:15.433657 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:06:15.433657 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:06:15.433657 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:06:15.434500 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:06:15.434500 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:06:15.434500 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:06:15.434500 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:06:15.434500 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:06:15.434500 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:06:15.434500 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:06:15.434500 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:06:15.434500 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:06:15.434500 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:06:15.434500 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:06:15.434500 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:06:15.436045 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 532/1095] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Jul 4 09:06:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:06:15.439729 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7525044f-3aa7-4de7-a920-615ebac7c595 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:15.442497 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:15.445418 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d4bcd7-2a33-4d59-b08e-efa0a33a4802 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:15.479683 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b932f34-ceca-4bfd-88d0-4e107f94a829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:15.480411 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b932f34-ceca-4bfd-88d0-4e107f94a829 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:15.480700 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b932f34-ceca-4bfd-88d0-4e107f94a829 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:15.480975 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b932f34-ceca-4bfd-88d0-4e107f94a829 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:15.499862 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:15.538073 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7525044f-3aa7-4de7-a920-615ebac7c595 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:15.553653 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b932f34-ceca-4bfd-88d0-4e107f94a829 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:15.555163 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b932f34-ceca-4bfd-88d0-4e107f94a829 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:15.573326 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e845cbc8-ca68-49f6-930e-fbaefb282b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:15.573925 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e845cbc8-ca68-49f6-930e-fbaefb282b59 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:15.574284 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e845cbc8-ca68-49f6-930e-fbaefb282b59 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:15.574561 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e845cbc8-ca68-49f6-930e-fbaefb282b59 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:15.575307 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e845cbc8-ca68-49f6-930e-fbaefb282b59 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:06:15.575656 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e845cbc8-ca68-49f6-930e-fbaefb282b59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:15.577039 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e845cbc8-ca68-49f6-930e-fbaefb282b59 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:15.585341 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 533/1096] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jul 4 09:06:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:06:15.591299 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e845cbc8-ca68-49f6-930e-fbaefb282b59 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:15.650803 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:15.656115 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 564/1097] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jul 4 09:06:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 04 09:06:15.657235 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b932f34-ceca-4bfd-88d0-4e107f94a829 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:15.689037 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e845cbc8-ca68-49f6-930e-fbaefb282b59 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:15.704706 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:15.721051 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6834faa5-4fba-4e56-b1f9-c87f1a9e055f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:15.721914 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6834faa5-4fba-4e56-b1f9-c87f1a9e055f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:15.722197 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6834faa5-4fba-4e56-b1f9-c87f1a9e055f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:15.722466 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6834faa5-4fba-4e56-b1f9-c87f1a9e055f None admin] PATH_INFO: `/v3/users/52915813ef9a4a248b607d00aa141523` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:15.723645 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6834faa5-4fba-4e56-b1f9-c87f1a9e055f None admin] RBAC: Authorizing `identity:get_user(user_id=52915813ef9a4a248b607d00aa141523)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:15.725124 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6834faa5-4fba-4e56-b1f9-c87f1a9e055f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:15.726754 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 534/1098] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Jul 4 09:06:15 2022] GET /identity/v3/users/52915813ef9a4a248b607d00aa141523 => generated 285 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:06:15.732423 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6834faa5-4fba-4e56-b1f9-c87f1a9e055f None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:15.756844 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b932f34-ceca-4bfd-88d0-4e107f94a829 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:15.790144 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07520be9-6407-4b90-8563-5e41cd46dd5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:15.791149 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07520be9-6407-4b90-8563-5e41cd46dd5e None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:15.791426 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07520be9-6407-4b90-8563-5e41cd46dd5e None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:15.791694 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07520be9-6407-4b90-8563-5e41cd46dd5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:15.801623 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07520be9-6407-4b90-8563-5e41cd46dd5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:15.803085 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07520be9-6407-4b90-8563-5e41cd46dd5e None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:15.819962 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-07520be9-6407-4b90-8563-5e41cd46dd5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:06:15.819962 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:06:15.819962 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:06:15.819962 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:06:15.819962 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:06:15.819962 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:06:15.819962 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:06:15.819962 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:06:15.819962 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:06:15.819962 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:06:15.819962 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:06:15.819962 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:06:15.819962 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:06:15.819962 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:06:15.819962 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:06:15.820908 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:06:15.820908 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:06:15.820908 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:06:15.820908 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:06:15.820908 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:06:15.820908 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:06:15.820908 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:06:15.820908 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:06:15.820908 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:06:15.820908 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:06:15.820908 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:06:15.820908 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:06:15.820908 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:06:15.820908 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:06:15.820908 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:06:15.820908 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:06:15.820908 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:06:15.821812 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:06:15.821812 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:06:15.821812 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:06:15.821812 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:06:15.821812 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 565/1099] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:06:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:06:15.826692 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07520be9-6407-4b90-8563-5e41cd46dd5e None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:15.831848 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6834faa5-4fba-4e56-b1f9-c87f1a9e055f None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:15.860072 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:15.865244 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0308eb70-a7fb-45eb-a811-6ac856742d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:15.865881 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308eb70-a7fb-45eb-a811-6ac856742d22 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:15.866159 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308eb70-a7fb-45eb-a811-6ac856742d22 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:15.866428 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308eb70-a7fb-45eb-a811-6ac856742d22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:15.927991 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07520be9-6407-4b90-8563-5e41cd46dd5e None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:15.929496 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:15.934751 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0308eb70-a7fb-45eb-a811-6ac856742d22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:15.936269 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0308eb70-a7fb-45eb-a811-6ac856742d22 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:15.962155 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d1e86e-c415-42f9-92ac-505a5f0cecb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:15.962819 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d1e86e-c415-42f9-92ac-505a5f0cecb3 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:15.963334 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d1e86e-c415-42f9-92ac-505a5f0cecb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:15.963455 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d1e86e-c415-42f9-92ac-505a5f0cecb3 None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:15.964123 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d1e86e-c415-42f9-92ac-505a5f0cecb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:06:15.964445 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d1e86e-c415-42f9-92ac-505a5f0cecb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:15.965862 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d1e86e-c415-42f9-92ac-505a5f0cecb3 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:15.977292 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 566/1100] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jul 4 09:06:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:06:15.982866 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d1e86e-c415-42f9-92ac-505a5f0cecb3 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:16.032667 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 535/1101] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jul 4 09:06:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 04 09:06:16.038487 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0308eb70-a7fb-45eb-a811-6ac856742d22 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:16.066883 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:16.082073 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d1e86e-c415-42f9-92ac-505a5f0cecb3 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:16.114953 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9fbd66-f500-4c4d-b015-ab5de1e9eb91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:16.115751 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9fbd66-f500-4c4d-b015-ab5de1e9eb91 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:16.116058 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9fbd66-f500-4c4d-b015-ab5de1e9eb91 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:16.116335 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9fbd66-f500-4c4d-b015-ab5de1e9eb91 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:16.123204 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9fbd66-f500-4c4d-b015-ab5de1e9eb91 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:16.124652 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9fbd66-f500-4c4d-b015-ab5de1e9eb91 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:16.133203 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0308eb70-a7fb-45eb-a811-6ac856742d22 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:16.139079 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-bc9fbd66-f500-4c4d-b015-ab5de1e9eb91 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:06:16.139079 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:06:16.139079 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:06:16.139079 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:06:16.139079 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:06:16.139079 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:06:16.139079 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:06:16.139079 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:06:16.139079 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:06:16.139079 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:06:16.139079 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:06:16.139079 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:06:16.139079 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:06:16.139079 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:06:16.139079 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:06:16.139969 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:06:16.139969 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:06:16.139969 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:06:16.139969 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:06:16.139969 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:06:16.139969 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:06:16.139969 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:06:16.139969 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:06:16.139969 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:06:16.139969 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:06:16.139969 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:06:16.139969 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:06:16.139969 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:06:16.139969 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:06:16.139969 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:06:16.139969 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:06:16.139969 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:06:16.140867 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:06:16.140867 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:06:16.140867 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:06:16.140867 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:06:16.140867 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:06:16.140867 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:06:16.140867 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:06:16.140867 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:06:16.140867 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 567/1102] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jul 4 09:06:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:06:16.146213 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9fbd66-f500-4c4d-b015-ab5de1e9eb91 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:16.168348 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5770a71-2d68-48a0-b085-87aa072686a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:16.169193 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5770a71-2d68-48a0-b085-87aa072686a0 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:16.169477 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5770a71-2d68-48a0-b085-87aa072686a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:16.169747 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5770a71-2d68-48a0-b085-87aa072686a0 None admin] PATH_INFO: `/v3/projects/2dc218fe405e466788e5c7321d1151fe` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:16.170937 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5770a71-2d68-48a0-b085-87aa072686a0 None admin] RBAC: Authorizing `identity:get_project(project_id=2dc218fe405e466788e5c7321d1151fe)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:16.172195 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:16.172413 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5770a71-2d68-48a0-b085-87aa072686a0 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:16.174124 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 536/1103] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jul 4 09:06:16 2022] GET /identity/v3/projects/2dc218fe405e466788e5c7321d1151fe => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:06:16.180283 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5770a71-2d68-48a0-b085-87aa072686a0 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:16.247411 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9fbd66-f500-4c4d-b015-ab5de1e9eb91 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:16.278244 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:16.281535 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5770a71-2d68-48a0-b085-87aa072686a0 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:16.281973 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77510f0c-d419-4efc-afd6-94fee1f673be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:16.282638 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77510f0c-d419-4efc-afd6-94fee1f673be None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:16.282934 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77510f0c-d419-4efc-afd6-94fee1f673be None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:16.283211 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77510f0c-d419-4efc-afd6-94fee1f673be None admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:16.284046 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77510f0c-d419-4efc-afd6-94fee1f673be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:06:16.284360 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77510f0c-d419-4efc-afd6-94fee1f673be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:16.285810 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77510f0c-d419-4efc-afd6-94fee1f673be None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:16.297382 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 568/1104] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Jul 4 09:06:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:06:16.303510 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77510f0c-d419-4efc-afd6-94fee1f673be None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:16.316409 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab32f3db-61c7-409a-88da-0a57ad36d7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:16.317055 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab32f3db-61c7-409a-88da-0a57ad36d7c8 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:16.317312 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab32f3db-61c7-409a-88da-0a57ad36d7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:16.317622 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab32f3db-61c7-409a-88da-0a57ad36d7c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:16.318450 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab32f3db-61c7-409a-88da-0a57ad36d7c8 None admin] RBAC: Adding query filter params (role.id=965049e7ce6144aaad23c15f3a5e37c3, scope.project.id=2dc218fe405e466788e5c7321d1151fe, user.id=52915813ef9a4a248b607d00aa141523) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:06:16.318744 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab32f3db-61c7-409a-88da-0a57ad36d7c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:16.320218 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab32f3db-61c7-409a-88da-0a57ad36d7c8 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:16.326067 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 537/1105] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Jul 4 09:06:16 2022] GET /identity/v3/role_assignments?user.id=52915813ef9a4a248b607d00aa141523&scope.project.id=2dc218fe405e466788e5c7321d1151fe&role.id=965049e7ce6144aaad23c15f3a5e37c3 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:06:16.388854 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:16.409557 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77510f0c-d419-4efc-afd6-94fee1f673be None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:16.443902 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59ff018-5f7b-42a5-b9ea-d50c81526c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:16.444579 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ff018-5f7b-42a5-b9ea-d50c81526c58 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:16.444865 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ff018-5f7b-42a5-b9ea-d50c81526c58 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:16.445140 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ff018-5f7b-42a5-b9ea-d50c81526c58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:16.445988 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59ff018-5f7b-42a5-b9ea-d50c81526c58 None admin] RBAC: Adding query filter params (role.id=a0417473d97f454c914db70e2d6c9f94, scope.project.id=d015d4f3d9d4464983ff561e8e08523c, user.id=af3b6e252a8c434a99432bcece6493b3) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:06:16.446305 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59ff018-5f7b-42a5-b9ea-d50c81526c58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:16.447767 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59ff018-5f7b-42a5-b9ea-d50c81526c58 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:16.454192 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 569/1106] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Jul 4 09:06:16 2022] GET /identity/v3/role_assignments?user.id=af3b6e252a8c434a99432bcece6493b3&scope.project.id=d015d4f3d9d4464983ff561e8e08523c&role.id=a0417473d97f454c914db70e2d6c9f94 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:06:18.341263 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2ec99-ebed-4447-b9ae-abf7d88c7308 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:18.341847 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2ec99-ebed-4447-b9ae-abf7d88c7308 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:18.341847 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2ec99-ebed-4447-b9ae-abf7d88c7308 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:18.343205 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 538/1107] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:06:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:06:18.349599 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf3a024-073d-42f8-b50f-650f0cf5130d None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:18.350362 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf3a024-073d-42f8-b50f-650f0cf5130d None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:18.350510 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf3a024-073d-42f8-b50f-650f0cf5130d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:18.371489 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-ebf3a024-073d-42f8-b50f-650f0cf5130d None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:06:18.373496 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-ebf3a024-073d-42f8-b50f-650f0cf5130d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:06:18.448402 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 570/1108] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:06:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:06:18.486060 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f2ec99-ebed-4447-b9ae-abf7d88c7308 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:18.597024 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f2ec99-ebed-4447-b9ae-abf7d88c7308 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:18.635235 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb540114-ccc7-4a7b-81d7-bf33fbb539e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:18.636039 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb540114-ccc7-4a7b-81d7-bf33fbb539e6 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:18.636311 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb540114-ccc7-4a7b-81d7-bf33fbb539e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:18.636613 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb540114-ccc7-4a7b-81d7-bf33fbb539e6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:18.637802 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb540114-ccc7-4a7b-81d7-bf33fbb539e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:18.639262 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb540114-ccc7-4a7b-81d7-bf33fbb539e6 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:18.640878 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 539/1109] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:06:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:06:18.646780 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf3a024-073d-42f8-b50f-650f0cf5130d None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:18.745613 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:18.775734 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf3a024-073d-42f8-b50f-650f0cf5130d None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:18.811802 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327101d8-bb76-44e1-8dad-cfc02c95e5f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:18.812489 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327101d8-bb76-44e1-8dad-cfc02c95e5f7 None admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:18.812763 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327101d8-bb76-44e1-8dad-cfc02c95e5f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:18.813042 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327101d8-bb76-44e1-8dad-cfc02c95e5f7 None admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:18.813745 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327101d8-bb76-44e1-8dad-cfc02c95e5f7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:18.815229 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327101d8-bb76-44e1-8dad-cfc02c95e5f7 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:18.838143 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 571/1110] 10.222.0.42 () {60 vars in 1132 bytes} [Mon Jul 4 09:06:18 2022] POST /identity/v3/users => generated 286 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:06:20.886660 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ba3c1-f080-4c09-92c5-6c46dd823f74 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:20.887235 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ba3c1-f080-4c09-92c5-6c46dd823f74 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:20.887235 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ba3c1-f080-4c09-92c5-6c46dd823f74 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:20.888618 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 540/1111] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:06:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:06:20.894811 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2978d979-1cf3-4d6a-8dc6-8eb9c9f9eb13 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:20.895492 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2978d979-1cf3-4d6a-8dc6-8eb9c9f9eb13 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:20.895751 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2978d979-1cf3-4d6a-8dc6-8eb9c9f9eb13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:20.916262 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-2978d979-1cf3-4d6a-8dc6-8eb9c9f9eb13 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:06:20.917466 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-2978d979-1cf3-4d6a-8dc6-8eb9c9f9eb13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:06:20.988300 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 572/1112] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:06:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:06:21.015423 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878ba3c1-f080-4c09-92c5-6c46dd823f74 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:21.055204 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:21.134576 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878ba3c1-f080-4c09-92c5-6c46dd823f74 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:21.172011 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496e5077-f60d-4449-8158-f1ea9cc50e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:21.172890 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e5077-f60d-4449-8158-f1ea9cc50e9d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:21.173175 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e5077-f60d-4449-8158-f1ea9cc50e9d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:21.173449 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e5077-f60d-4449-8158-f1ea9cc50e9d None admin] PATH_INFO: `/v3/roles/157d1a80161e43a3ad84446eeca98e0b` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:21.175009 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496e5077-f60d-4449-8158-f1ea9cc50e9d None admin] RBAC: Authorizing `identity:get_role(role_id=157d1a80161e43a3ad84446eeca98e0b)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:21.176682 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496e5077-f60d-4449-8158-f1ea9cc50e9d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:21.178248 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 541/1113] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Jul 4 09:06:21 2022] GET /identity/v3/roles/157d1a80161e43a3ad84446eeca98e0b => generated 223 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:06:21.185069 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2978d979-1cf3-4d6a-8dc6-8eb9c9f9eb13 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:21.250155 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:21.294216 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2978d979-1cf3-4d6a-8dc6-8eb9c9f9eb13 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:21.332767 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e185e722-47a3-4f4d-b28f-7bdc07368391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:21.333619 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e185e722-47a3-4f4d-b28f-7bdc07368391 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:21.333906 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e185e722-47a3-4f4d-b28f-7bdc07368391 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:21.334180 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e185e722-47a3-4f4d-b28f-7bdc07368391 None admin] PATH_INFO: `/v3/users/8b88f907a7764f05b00073076807d8f3` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:21.349102 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e185e722-47a3-4f4d-b28f-7bdc07368391 None admin] RBAC: Authorizing `identity:get_user(user_id=8b88f907a7764f05b00073076807d8f3)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:21.350568 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e185e722-47a3-4f4d-b28f-7bdc07368391 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:21.352266 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 573/1114] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Jul 4 09:06:21 2022] GET /identity/v3/users/8b88f907a7764f05b00073076807d8f3 => generated 286 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:06:21.358556 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496e5077-f60d-4449-8158-f1ea9cc50e9d None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:21.464532 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:21.468018 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496e5077-f60d-4449-8158-f1ea9cc50e9d None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:21.509898 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791d320f-7011-4f61-aa3f-6d207aa87ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:21.510539 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d320f-7011-4f61-aa3f-6d207aa87ea5 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:21.510820 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d320f-7011-4f61-aa3f-6d207aa87ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:21.511088 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d320f-7011-4f61-aa3f-6d207aa87ea5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:21.579949 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791d320f-7011-4f61-aa3f-6d207aa87ea5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:21.581426 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791d320f-7011-4f61-aa3f-6d207aa87ea5 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:21.680600 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:21.684556 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 542/1115] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jul 4 09:06:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 04 09:06:21.691408 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e185e722-47a3-4f4d-b28f-7bdc07368391 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:21.810947 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e185e722-47a3-4f4d-b28f-7bdc07368391 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:21.830824 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:21.848889 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26709828-dc52-4cac-8ab5-fede982576ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:21.849814 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26709828-dc52-4cac-8ab5-fede982576ae None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:21.850099 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26709828-dc52-4cac-8ab5-fede982576ae None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:21.850381 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26709828-dc52-4cac-8ab5-fede982576ae None admin] PATH_INFO: `/v3/projects/2dc218fe405e466788e5c7321d1151fe` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:21.851571 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26709828-dc52-4cac-8ab5-fede982576ae None admin] RBAC: Authorizing `identity:get_project(project_id=2dc218fe405e466788e5c7321d1151fe)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:21.853094 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26709828-dc52-4cac-8ab5-fede982576ae None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:21.854974 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 574/1116] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jul 4 09:06:21 2022] GET /identity/v3/projects/2dc218fe405e466788e5c7321d1151fe => generated 311 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:06:21.861596 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791d320f-7011-4f61-aa3f-6d207aa87ea5 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:21.966777 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791d320f-7011-4f61-aa3f-6d207aa87ea5 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:22.006036 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836498f1-16b7-405a-9982-92bf351481ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:22.006958 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836498f1-16b7-405a-9982-92bf351481ac None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:22.007298 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836498f1-16b7-405a-9982-92bf351481ac None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:22.007600 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836498f1-16b7-405a-9982-92bf351481ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:22.008957 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836498f1-16b7-405a-9982-92bf351481ac None admin] RBAC: Adding query filter params (role.id=157d1a80161e43a3ad84446eeca98e0b, scope.project.id=2dc218fe405e466788e5c7321d1151fe, user.id=8b88f907a7764f05b00073076807d8f3) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:06:22.009312 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836498f1-16b7-405a-9982-92bf351481ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:22.011671 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836498f1-16b7-405a-9982-92bf351481ac None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:22.017546 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 543/1117] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Jul 4 09:06:21 2022] GET /identity/v3/role_assignments?user.id=8b88f907a7764f05b00073076807d8f3&scope.project.id=2dc218fe405e466788e5c7321d1151fe&role.id=157d1a80161e43a3ad84446eeca98e0b => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:06:23.978599 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149c8da-c682-4e59-8ae8-1e83d2b625f8 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:23.979446 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149c8da-c682-4e59-8ae8-1e83d2b625f8 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:23.979446 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149c8da-c682-4e59-8ae8-1e83d2b625f8 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:23.981763 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 575/1118] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:06:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:06:23.987633 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe522d75-68df-4804-a5bf-87234fac1ddb None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:23.988071 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe522d75-68df-4804-a5bf-87234fac1ddb None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:23.988181 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe522d75-68df-4804-a5bf-87234fac1ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:24.006179 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-fe522d75-68df-4804-a5bf-87234fac1ddb None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:06:24.007352 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-fe522d75-68df-4804-a5bf-87234fac1ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:06:24.067039 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:24.075771 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 544/1119] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:06:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:06:24.098828 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4149c8da-c682-4e59-8ae8-1e83d2b625f8 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:24.216339 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4149c8da-c682-4e59-8ae8-1e83d2b625f8 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:24.257091 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a48111-fb88-4ae5-9c4a-ccfd97fc1f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:24.257952 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a48111-fb88-4ae5-9c4a-ccfd97fc1f99 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:24.258237 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a48111-fb88-4ae5-9c4a-ccfd97fc1f99 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:24.258511 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a48111-fb88-4ae5-9c4a-ccfd97fc1f99 None admin] PATH_INFO: `/v3/roles/157d1a80161e43a3ad84446eeca98e0b` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:24.260083 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a48111-fb88-4ae5-9c4a-ccfd97fc1f99 None admin] RBAC: Authorizing `identity:get_role(role_id=157d1a80161e43a3ad84446eeca98e0b)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:24.261829 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a48111-fb88-4ae5-9c4a-ccfd97fc1f99 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:24.263380 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 576/1120] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Jul 4 09:06:24 2022] GET /identity/v3/roles/157d1a80161e43a3ad84446eeca98e0b => generated 223 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:06:24.273184 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe522d75-68df-4804-a5bf-87234fac1ddb None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:24.381912 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe522d75-68df-4804-a5bf-87234fac1ddb None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:24.422993 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ea96a6-e903-47ae-abbe-e152efddac0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:24.423860 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea96a6-e903-47ae-abbe-e152efddac0f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:24.424178 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea96a6-e903-47ae-abbe-e152efddac0f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:24.424449 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea96a6-e903-47ae-abbe-e152efddac0f None admin] PATH_INFO: `/v3/users/8b88f907a7764f05b00073076807d8f3` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:24.425702 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ea96a6-e903-47ae-abbe-e152efddac0f None admin] RBAC: Authorizing `identity:get_user(user_id=8b88f907a7764f05b00073076807d8f3)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:24.427170 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ea96a6-e903-47ae-abbe-e152efddac0f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:24.428847 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 545/1121] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Jul 4 09:06:24 2022] GET /identity/v3/users/8b88f907a7764f05b00073076807d8f3 => generated 286 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:06:24.435171 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a48111-fb88-4ae5-9c4a-ccfd97fc1f99 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:24.493818 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:24.539948 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a48111-fb88-4ae5-9c4a-ccfd97fc1f99 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:24.580008 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff389ef7-82f4-46d1-b654-c5f7097120b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:24.580859 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff389ef7-82f4-46d1-b654-c5f7097120b1 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:24.581142 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff389ef7-82f4-46d1-b654-c5f7097120b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:24.581424 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff389ef7-82f4-46d1-b654-c5f7097120b1 None admin] PATH_INFO: `/v3/projects/2dc218fe405e466788e5c7321d1151fe` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:24.582720 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff389ef7-82f4-46d1-b654-c5f7097120b1 None admin] RBAC: Authorizing `identity:get_project(project_id=2dc218fe405e466788e5c7321d1151fe)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:24.584303 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff389ef7-82f4-46d1-b654-c5f7097120b1 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:24.586016 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 577/1122] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jul 4 09:06:24 2022] GET /identity/v3/projects/2dc218fe405e466788e5c7321d1151fe => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:06:24.592653 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ea96a6-e903-47ae-abbe-e152efddac0f None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:24.662393 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:24.701946 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ea96a6-e903-47ae-abbe-e152efddac0f None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:24.737526 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbe7930-3da6-4337-8818-d33b74c98876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:24.738393 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe7930-3da6-4337-8818-d33b74c98876 None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:24.738670 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe7930-3da6-4337-8818-d33b74c98876 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:24.738937 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe7930-3da6-4337-8818-d33b74c98876 None admin] PATH_INFO: `/v3/projects/2dc218fe405e466788e5c7321d1151fe/users/8b88f907a7764f05b00073076807d8f3/roles/157d1a80161e43a3ad84446eeca98e0b` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:24.741536 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbe7930-3da6-4337-8818-d33b74c98876 None admin] RBAC: Authorizing `identity:create_grant(project_id=2dc218fe405e466788e5c7321d1151fe, user_id=8b88f907a7764f05b00073076807d8f3, role_id=157d1a80161e43a3ad84446eeca98e0b)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:24.742977 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbe7930-3da6-4337-8818-d33b74c98876 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:24.757943 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 546/1123] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Jul 4 09:06:24 2022] PUT /identity/v3/projects/2dc218fe405e466788e5c7321d1151fe/users/8b88f907a7764f05b00073076807d8f3/roles/157d1a80161e43a3ad84446eeca98e0b => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:06:26.743779 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e24c52d-72c1-4599-8585-49b97c55bf7d None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:26.744421 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e24c52d-72c1-4599-8585-49b97c55bf7d None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:26.744421 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e24c52d-72c1-4599-8585-49b97c55bf7d None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:26.746457 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 578/1124] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:06:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:06:26.755105 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c8345d-07cc-4259-9168-e706bc75e075 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:26.755520 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c8345d-07cc-4259-9168-e706bc75e075 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:26.755677 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c8345d-07cc-4259-9168-e706bc75e075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:26.776290 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-51c8345d-07cc-4259-9168-e706bc75e075 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:06:26.777488 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-51c8345d-07cc-4259-9168-e706bc75e075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:06:26.849624 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 547/1125] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:06:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:06:26.874236 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e24c52d-72c1-4599-8585-49b97c55bf7d None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:26.997989 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e24c52d-72c1-4599-8585-49b97c55bf7d None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:27.021914 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:27.036128 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e4bbdf-d6dc-424d-b593-2def6e20ce1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:27.037002 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e4bbdf-d6dc-424d-b593-2def6e20ce1d None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:27.037285 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e4bbdf-d6dc-424d-b593-2def6e20ce1d None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:27.037553 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e4bbdf-d6dc-424d-b593-2def6e20ce1d None admin] PATH_INFO: `/v3/roles/157d1a80161e43a3ad84446eeca98e0b` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:27.039240 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e4bbdf-d6dc-424d-b593-2def6e20ce1d None admin] RBAC: Authorizing `identity:get_role(role_id=157d1a80161e43a3ad84446eeca98e0b)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:27.040714 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e4bbdf-d6dc-424d-b593-2def6e20ce1d None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:27.042164 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 579/1126] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Jul 4 09:06:26 2022] GET /identity/v3/roles/157d1a80161e43a3ad84446eeca98e0b => generated 223 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:06:27.048446 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c8345d-07cc-4259-9168-e706bc75e075 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:27.103325 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:27.153237 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c8345d-07cc-4259-9168-e706bc75e075 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:27.188176 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e0c15c-b806-46a1-a523-9e893072e71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:27.189036 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0c15c-b806-46a1-a523-9e893072e71f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:27.189314 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0c15c-b806-46a1-a523-9e893072e71f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:27.189583 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0c15c-b806-46a1-a523-9e893072e71f None admin] PATH_INFO: `/v3/users/8b88f907a7764f05b00073076807d8f3` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:27.190891 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e0c15c-b806-46a1-a523-9e893072e71f None admin] RBAC: Authorizing `identity:get_user(user_id=8b88f907a7764f05b00073076807d8f3)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:27.192378 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e0c15c-b806-46a1-a523-9e893072e71f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:27.194004 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 548/1127] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Jul 4 09:06:27 2022] GET /identity/v3/users/8b88f907a7764f05b00073076807d8f3 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:06:27.200413 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e4bbdf-d6dc-424d-b593-2def6e20ce1d None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:27.334924 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e4bbdf-d6dc-424d-b593-2def6e20ce1d None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:27.370793 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9142fc21-5c3a-48bc-9608-4b002b54efbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:27.371432 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142fc21-5c3a-48bc-9608-4b002b54efbe None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:27.371716 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142fc21-5c3a-48bc-9608-4b002b54efbe None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:27.372025 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142fc21-5c3a-48bc-9608-4b002b54efbe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:27.433056 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:27.444397 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9142fc21-5c3a-48bc-9608-4b002b54efbe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:27.445868 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9142fc21-5c3a-48bc-9608-4b002b54efbe None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:27.553657 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 580/1128] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jul 4 09:06:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 04 09:06:27.560267 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e0c15c-b806-46a1-a523-9e893072e71f None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:27.668560 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e0c15c-b806-46a1-a523-9e893072e71f None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:27.688547 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:27.704285 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d06fd8a-c10b-4eea-83c6-0df629185ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:27.705137 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d06fd8a-c10b-4eea-83c6-0df629185ffa None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:27.705415 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d06fd8a-c10b-4eea-83c6-0df629185ffa None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:27.705716 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d06fd8a-c10b-4eea-83c6-0df629185ffa None admin] PATH_INFO: `/v3/projects/2dc218fe405e466788e5c7321d1151fe` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:27.707006 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d06fd8a-c10b-4eea-83c6-0df629185ffa None admin] RBAC: Authorizing `identity:get_project(project_id=2dc218fe405e466788e5c7321d1151fe)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:27.708522 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d06fd8a-c10b-4eea-83c6-0df629185ffa None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:27.710208 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 549/1129] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jul 4 09:06:27 2022] GET /identity/v3/projects/2dc218fe405e466788e5c7321d1151fe => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:06:27.718579 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9142fc21-5c3a-48bc-9608-4b002b54efbe None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:27.834927 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:27.845600 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9142fc21-5c3a-48bc-9608-4b002b54efbe None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:27.885081 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5e86e6-4a21-4887-8745-80d9c3dad267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:27.886018 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e86e6-4a21-4887-8745-80d9c3dad267 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:27.886394 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e86e6-4a21-4887-8745-80d9c3dad267 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:27.886765 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e86e6-4a21-4887-8745-80d9c3dad267 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:27.887655 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5e86e6-4a21-4887-8745-80d9c3dad267 None admin] RBAC: Adding query filter params (role.id=157d1a80161e43a3ad84446eeca98e0b, scope.project.id=2dc218fe405e466788e5c7321d1151fe, user.id=8b88f907a7764f05b00073076807d8f3) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:06:27.888000 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5e86e6-4a21-4887-8745-80d9c3dad267 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:27.889461 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5e86e6-4a21-4887-8745-80d9c3dad267 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:27.898213 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 581/1130] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Jul 4 09:06:27 2022] GET /identity/v3/role_assignments?user.id=8b88f907a7764f05b00073076807d8f3&scope.project.id=2dc218fe405e466788e5c7321d1151fe&role.id=157d1a80161e43a3ad84446eeca98e0b => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:06:29.936067 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad1a116-9993-4052-87f9-ac0528d1bed7 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:29.936597 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad1a116-9993-4052-87f9-ac0528d1bed7 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:29.936597 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad1a116-9993-4052-87f9-ac0528d1bed7 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:29.938360 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 550/1131] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:06:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:06:29.946954 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e9c16-36cc-4203-9073-f8864b53bc9a None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:29.947391 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e9c16-36cc-4203-9073-f8864b53bc9a None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:29.947530 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e9c16-36cc-4203-9073-f8864b53bc9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:29.971014 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-824e9c16-36cc-4203-9073-f8864b53bc9a None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:06:29.972249 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-824e9c16-36cc-4203-9073-f8864b53bc9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:06:30.040921 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 582/1132] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:06:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:06:30.070779 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad1a116-9993-4052-87f9-ac0528d1bed7 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:30.190141 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad1a116-9993-4052-87f9-ac0528d1bed7 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:30.225392 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2280e799-651d-4e08-9f2d-f9dfa272730c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:30.226169 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2280e799-651d-4e08-9f2d-f9dfa272730c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:30.226456 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2280e799-651d-4e08-9f2d-f9dfa272730c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:30.226727 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2280e799-651d-4e08-9f2d-f9dfa272730c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:30.228037 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2280e799-651d-4e08-9f2d-f9dfa272730c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:30.229501 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2280e799-651d-4e08-9f2d-f9dfa272730c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:30.231142 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 551/1133] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:06:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:06:30.240390 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824e9c16-36cc-4203-9073-f8864b53bc9a None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:30.337825 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:30.360149 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824e9c16-36cc-4203-9073-f8864b53bc9a None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:30.395147 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fc2ffe-b250-45e0-98ae-50ce14639429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:30.395790 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc2ffe-b250-45e0-98ae-50ce14639429 None admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:30.396095 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc2ffe-b250-45e0-98ae-50ce14639429 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:30.396369 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc2ffe-b250-45e0-98ae-50ce14639429 None admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:30.397060 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fc2ffe-b250-45e0-98ae-50ce14639429 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:30.398502 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fc2ffe-b250-45e0-98ae-50ce14639429 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:30.431856 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 583/1134] 10.222.0.42 () {60 vars in 1141 bytes} [Mon Jul 4 09:06:30 2022] POST /identity/v3/projects => generated 311 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:06:32.471242 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc25ebf8-41e7-4dcb-b8b4-060f693867a5 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:32.471773 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc25ebf8-41e7-4dcb-b8b4-060f693867a5 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:32.471888 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc25ebf8-41e7-4dcb-b8b4-060f693867a5 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:32.474061 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 552/1135] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:06:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:06:32.479645 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf37f9-b54c-4a15-be07-e63936271ad3 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:32.480204 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf37f9-b54c-4a15-be07-e63936271ad3 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:32.480296 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf37f9-b54c-4a15-be07-e63936271ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:32.499047 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-67cf37f9-b54c-4a15-be07-e63936271ad3 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:06:32.500272 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-67cf37f9-b54c-4a15-be07-e63936271ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:06:32.569737 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 584/1136] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:06:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:06:32.594607 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc25ebf8-41e7-4dcb-b8b4-060f693867a5 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:32.654817 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:32.700460 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc25ebf8-41e7-4dcb-b8b4-060f693867a5 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:32.739152 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf75859-0b8f-4c08-ab1c-66aa2b28119b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:32.739862 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf75859-0b8f-4c08-ab1c-66aa2b28119b None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:32.740192 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf75859-0b8f-4c08-ab1c-66aa2b28119b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:32.740462 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf75859-0b8f-4c08-ab1c-66aa2b28119b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:32.741758 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf75859-0b8f-4c08-ab1c-66aa2b28119b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:32.743228 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf75859-0b8f-4c08-ab1c-66aa2b28119b None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:32.744883 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 553/1137] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:06:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:06:32.751020 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cf37f9-b54c-4a15-be07-e63936271ad3 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:32.818975 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:32.854165 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cf37f9-b54c-4a15-be07-e63936271ad3 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:32.890106 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be6e811-d078-415d-b0d9-62832d64cf0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:32.890805 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be6e811-d078-415d-b0d9-62832d64cf0b None admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:32.891093 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be6e811-d078-415d-b0d9-62832d64cf0b None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:32.891366 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be6e811-d078-415d-b0d9-62832d64cf0b None admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:32.892428 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be6e811-d078-415d-b0d9-62832d64cf0b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:32.893560 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be6e811-d078-415d-b0d9-62832d64cf0b None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:32.914575 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 585/1138] 10.222.0.42 () {60 vars in 1132 bytes} [Mon Jul 4 09:06:32 2022] POST /identity/v3/users => generated 286 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:06:34.932063 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce78db7-b63f-4d15-854b-b8a968f75796 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:34.932551 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce78db7-b63f-4d15-854b-b8a968f75796 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:34.932551 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce78db7-b63f-4d15-854b-b8a968f75796 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:34.934016 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 554/1139] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:06:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:06:34.940309 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af33f9b8-6970-43c8-a448-68d528e1db18 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:34.941000 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af33f9b8-6970-43c8-a448-68d528e1db18 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:34.941236 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af33f9b8-6970-43c8-a448-68d528e1db18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:34.961275 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-af33f9b8-6970-43c8-a448-68d528e1db18 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:06:34.962479 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-af33f9b8-6970-43c8-a448-68d528e1db18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:06:35.034390 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 586/1140] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:06:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:06:35.057814 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce78db7-b63f-4d15-854b-b8a968f75796 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:35.176672 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce78db7-b63f-4d15-854b-b8a968f75796 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:35.202239 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:35.215618 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f9a101-cb6c-4247-b834-3de85c2cdecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:35.216438 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f9a101-cb6c-4247-b834-3de85c2cdecb None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:35.216719 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f9a101-cb6c-4247-b834-3de85c2cdecb None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:35.216993 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f9a101-cb6c-4247-b834-3de85c2cdecb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:35.227660 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f9a101-cb6c-4247-b834-3de85c2cdecb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:06:35.235606 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-71f9a101-cb6c-4247-b834-3de85c2cdecb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:06:35.235606 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:06:35.235606 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:06:35.235606 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:06:35.235606 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:06:35.235606 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:06:35.235606 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:06:35.235606 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:06:35.235606 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:06:35.235606 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:06:35.235606 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:06:35.235606 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:06:35.235606 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:06:35.235606 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:06:35.235606 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:06:35.235606 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:06:35.236758 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:06:35.236758 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:06:35.236758 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:06:35.236758 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:06:35.236758 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:06:35.236758 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:06:35.236758 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:06:35.236758 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:06:35.236758 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:06:35.236758 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:06:35.236758 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:06:35.236758 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:06:35.236758 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:06:35.236758 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:06:35.236758 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:06:35.236758 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:06:35.237710 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:06:35.237710 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:06:35.237710 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:06:35.237710 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:06:35.237710 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:06:35.237710 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:06:35.237710 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:06:35.237710 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:06:35.237710 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:06:35.237710 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:06:35.237710 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:06:35.237710 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:06:35.237710 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 555/1141] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Jul 4 09:06:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:06:35.242965 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af33f9b8-6970-43c8-a448-68d528e1db18 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:35.299679 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:35.344352 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af33f9b8-6970-43c8-a448-68d528e1db18 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:35.379136 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41690783-526f-4305-8520-bb8d9d178bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:35.379783 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41690783-526f-4305-8520-bb8d9d178bc3 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:35.380092 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41690783-526f-4305-8520-bb8d9d178bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:35.380364 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41690783-526f-4305-8520-bb8d9d178bc3 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:35.381106 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41690783-526f-4305-8520-bb8d9d178bc3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:06:35.381415 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41690783-526f-4305-8520-bb8d9d178bc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:35.382787 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41690783-526f-4305-8520-bb8d9d178bc3 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:35.398419 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 587/1142] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jul 4 09:06:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:06:35.404253 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f9a101-cb6c-4247-b834-3de85c2cdecb None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:35.510224 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f9a101-cb6c-4247-b834-3de85c2cdecb None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:35.545107 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03ff06d-edb0-4579-aaaa-e52c03153eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:35.545946 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ff06d-edb0-4579-aaaa-e52c03153eaf None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:35.546228 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ff06d-edb0-4579-aaaa-e52c03153eaf None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:35.546494 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ff06d-edb0-4579-aaaa-e52c03153eaf None admin] PATH_INFO: `/v3/users/0e6d5e1dcb354ca79a55e93af8c77fe1` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:35.560490 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03ff06d-edb0-4579-aaaa-e52c03153eaf None admin] RBAC: Authorizing `identity:get_user(user_id=0e6d5e1dcb354ca79a55e93af8c77fe1)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:35.561932 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03ff06d-edb0-4579-aaaa-e52c03153eaf None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:35.563571 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 556/1143] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Jul 4 09:06:35 2022] GET /identity/v3/users/0e6d5e1dcb354ca79a55e93af8c77fe1 => generated 286 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:06:35.569999 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41690783-526f-4305-8520-bb8d9d178bc3 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:35.679917 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41690783-526f-4305-8520-bb8d9d178bc3 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:35.695981 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:35.726964 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532c2773-a781-4091-b1a8-f02e11122e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:35.727937 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c2773-a781-4091-b1a8-f02e11122e0e None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:35.728313 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c2773-a781-4091-b1a8-f02e11122e0e None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:35.728627 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c2773-a781-4091-b1a8-f02e11122e0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:35.797975 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532c2773-a781-4091-b1a8-f02e11122e0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:35.799452 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532c2773-a781-4091-b1a8-f02e11122e0e None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:35.913138 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 588/1144] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jul 4 09:06:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 04 09:06:35.919261 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03ff06d-edb0-4579-aaaa-e52c03153eaf None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:35.962917 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:36.026001 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03ff06d-edb0-4579-aaaa-e52c03153eaf None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:36.068150 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26198a9e-a378-47e5-b035-baff5daf924f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:36.068926 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26198a9e-a378-47e5-b035-baff5daf924f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:36.069198 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26198a9e-a378-47e5-b035-baff5daf924f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:36.069464 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26198a9e-a378-47e5-b035-baff5daf924f None admin] PATH_INFO: `/v3/projects/52d60603ecf0484884f7c3bf1d289d30` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:36.070705 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26198a9e-a378-47e5-b035-baff5daf924f None admin] RBAC: Authorizing `identity:get_project(project_id=52d60603ecf0484884f7c3bf1d289d30)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:36.072185 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26198a9e-a378-47e5-b035-baff5daf924f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:36.073961 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 557/1145] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jul 4 09:06:35 2022] GET /identity/v3/projects/52d60603ecf0484884f7c3bf1d289d30 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:06:36.081222 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532c2773-a781-4091-b1a8-f02e11122e0e None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:36.103902 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:36.192573 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532c2773-a781-4091-b1a8-f02e11122e0e None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:36.227684 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1338a50c-09b2-4ae7-8a46-5ee168b395ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:36.228360 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1338a50c-09b2-4ae7-8a46-5ee168b395ae None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:36.228669 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1338a50c-09b2-4ae7-8a46-5ee168b395ae None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:36.228938 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1338a50c-09b2-4ae7-8a46-5ee168b395ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:36.229844 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1338a50c-09b2-4ae7-8a46-5ee168b395ae None admin] RBAC: Adding query filter params (role.id=965049e7ce6144aaad23c15f3a5e37c3, scope.project.id=52d60603ecf0484884f7c3bf1d289d30, user.id=0e6d5e1dcb354ca79a55e93af8c77fe1) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:06:36.230155 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1338a50c-09b2-4ae7-8a46-5ee168b395ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:36.231598 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1338a50c-09b2-4ae7-8a46-5ee168b395ae None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:36.237510 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 589/1146] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Jul 4 09:06:36 2022] GET /identity/v3/role_assignments?user.id=0e6d5e1dcb354ca79a55e93af8c77fe1&scope.project.id=52d60603ecf0484884f7c3bf1d289d30&role.id=965049e7ce6144aaad23c15f3a5e37c3 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:06:38.203334 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4523e5a3-0b86-4778-8c39-01a9be10afa6 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:38.203953 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4523e5a3-0b86-4778-8c39-01a9be10afa6 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:38.203953 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4523e5a3-0b86-4778-8c39-01a9be10afa6 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:38.205298 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 558/1147] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:06:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:06:38.212044 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f31a728-5bdd-454a-82f2-271f817cc5be None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:38.212813 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f31a728-5bdd-454a-82f2-271f817cc5be None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:38.212813 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f31a728-5bdd-454a-82f2-271f817cc5be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:38.232519 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-6f31a728-5bdd-454a-82f2-271f817cc5be None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:06:38.234020 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-6f31a728-5bdd-454a-82f2-271f817cc5be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:06:38.308341 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 590/1148] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:06:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:06:38.330834 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4523e5a3-0b86-4778-8c39-01a9be10afa6 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:38.442048 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4523e5a3-0b86-4778-8c39-01a9be10afa6 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:38.452714 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:38.478836 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ab8efa-8205-4871-bae8-598411154bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:38.479568 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ab8efa-8205-4871-bae8-598411154bc4 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:38.479887 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ab8efa-8205-4871-bae8-598411154bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:38.480175 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ab8efa-8205-4871-bae8-598411154bc4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:38.491173 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ab8efa-8205-4871-bae8-598411154bc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:06:38.498741 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-15ab8efa-8205-4871-bae8-598411154bc4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:06:38.498741 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:06:38.498741 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:06:38.498741 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:06:38.498741 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:06:38.498741 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:06:38.498741 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:06:38.498741 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:06:38.498741 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:06:38.498741 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:06:38.498741 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:06:38.498741 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:06:38.498741 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:06:38.498741 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:06:38.498741 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:06:38.498741 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:06:38.499836 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:06:38.499836 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:06:38.499836 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:06:38.499836 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:06:38.499836 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:06:38.499836 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:06:38.499836 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:06:38.499836 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:06:38.499836 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:06:38.499836 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:06:38.499836 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:06:38.499836 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:06:38.499836 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:06:38.499836 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:06:38.499836 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:06:38.499836 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:06:38.500896 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:06:38.500896 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:06:38.500896 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:06:38.500896 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:06:38.500896 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:06:38.500896 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:06:38.500896 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:06:38.500896 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:06:38.500896 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:06:38.500896 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:06:38.500896 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:06:38.500896 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:06:38.500896 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 559/1149] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Jul 4 09:06:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:06:38.506821 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f31a728-5bdd-454a-82f2-271f817cc5be None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:38.520280 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:38.610245 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f31a728-5bdd-454a-82f2-271f817cc5be None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:38.645430 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83012dfa-8518-4d2d-bf33-a9e53f093923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:38.646080 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83012dfa-8518-4d2d-bf33-a9e53f093923 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:38.646363 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83012dfa-8518-4d2d-bf33-a9e53f093923 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:38.646633 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83012dfa-8518-4d2d-bf33-a9e53f093923 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:38.647374 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83012dfa-8518-4d2d-bf33-a9e53f093923 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:06:38.647681 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83012dfa-8518-4d2d-bf33-a9e53f093923 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:38.649086 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83012dfa-8518-4d2d-bf33-a9e53f093923 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:38.657514 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 591/1150] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jul 4 09:06:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:06:38.666750 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ab8efa-8205-4871-bae8-598411154bc4 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:38.775767 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ab8efa-8205-4871-bae8-598411154bc4 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:38.813237 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab19877b-0abf-41b3-aa44-4efc4722c6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:38.814089 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab19877b-0abf-41b3-aa44-4efc4722c6ee None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:38.814371 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab19877b-0abf-41b3-aa44-4efc4722c6ee None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:38.814648 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab19877b-0abf-41b3-aa44-4efc4722c6ee None admin] PATH_INFO: `/v3/users/0e6d5e1dcb354ca79a55e93af8c77fe1` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:38.815989 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab19877b-0abf-41b3-aa44-4efc4722c6ee None admin] RBAC: Authorizing `identity:get_user(user_id=0e6d5e1dcb354ca79a55e93af8c77fe1)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:38.817452 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab19877b-0abf-41b3-aa44-4efc4722c6ee None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:38.819078 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 560/1151] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Jul 4 09:06:38 2022] GET /identity/v3/users/0e6d5e1dcb354ca79a55e93af8c77fe1 => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:06:38.825518 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83012dfa-8518-4d2d-bf33-a9e53f093923 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:38.906710 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:38.938009 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83012dfa-8518-4d2d-bf33-a9e53f093923 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:38.975090 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e0ed9c-c024-484a-96b6-6535aec2d896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:38.976064 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e0ed9c-c024-484a-96b6-6535aec2d896 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:38.976348 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e0ed9c-c024-484a-96b6-6535aec2d896 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:38.976622 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e0ed9c-c024-484a-96b6-6535aec2d896 None admin] PATH_INFO: `/v3/projects/52d60603ecf0484884f7c3bf1d289d30` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:38.977799 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e0ed9c-c024-484a-96b6-6535aec2d896 None admin] RBAC: Authorizing `identity:get_project(project_id=52d60603ecf0484884f7c3bf1d289d30)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:38.979242 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e0ed9c-c024-484a-96b6-6535aec2d896 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:38.981004 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 592/1152] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jul 4 09:06:38 2022] GET /identity/v3/projects/52d60603ecf0484884f7c3bf1d289d30 => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:06:38.988339 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab19877b-0abf-41b3-aa44-4efc4722c6ee None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:39.031093 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:39.095779 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab19877b-0abf-41b3-aa44-4efc4722c6ee None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:39.131602 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74f4a21-9628-433b-b28a-0acdefbdede8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:39.132524 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f4a21-9628-433b-b28a-0acdefbdede8 None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:39.132799 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f4a21-9628-433b-b28a-0acdefbdede8 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:39.133082 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f4a21-9628-433b-b28a-0acdefbdede8 None admin] PATH_INFO: `/v3/projects/52d60603ecf0484884f7c3bf1d289d30/users/0e6d5e1dcb354ca79a55e93af8c77fe1/roles/965049e7ce6144aaad23c15f3a5e37c3` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:39.135118 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74f4a21-9628-433b-b28a-0acdefbdede8 None admin] RBAC: Authorizing `identity:create_grant(project_id=52d60603ecf0484884f7c3bf1d289d30, user_id=0e6d5e1dcb354ca79a55e93af8c77fe1, role_id=965049e7ce6144aaad23c15f3a5e37c3)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:39.137042 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74f4a21-9628-433b-b28a-0acdefbdede8 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:39.155570 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 561/1153] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Jul 4 09:06:38 2022] PUT /identity/v3/projects/52d60603ecf0484884f7c3bf1d289d30/users/0e6d5e1dcb354ca79a55e93af8c77fe1/roles/965049e7ce6144aaad23c15f3a5e37c3 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:06:41.119006 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6952b5-b02b-42a1-93fa-ce68ba4c0ee8 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:41.119585 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6952b5-b02b-42a1-93fa-ce68ba4c0ee8 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:41.119585 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6952b5-b02b-42a1-93fa-ce68ba4c0ee8 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:41.120998 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 593/1154] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:06:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:06:41.127407 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2486fb20-daf8-44a7-bf66-7cb0006aefbc None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:41.128128 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2486fb20-daf8-44a7-bf66-7cb0006aefbc None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:41.128379 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2486fb20-daf8-44a7-bf66-7cb0006aefbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:41.157415 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-2486fb20-daf8-44a7-bf66-7cb0006aefbc None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:06:41.158530 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-2486fb20-daf8-44a7-bf66-7cb0006aefbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:06:41.230288 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 562/1155] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:06:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:06:41.254157 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6952b5-b02b-42a1-93fa-ce68ba4c0ee8 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:41.367144 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6952b5-b02b-42a1-93fa-ce68ba4c0ee8 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:41.403083 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dc26f2-5f94-46ff-acf2-4b05dc194f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:41.403863 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc26f2-5f94-46ff-acf2-4b05dc194f9c None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:41.404189 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc26f2-5f94-46ff-acf2-4b05dc194f9c None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:41.404466 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc26f2-5f94-46ff-acf2-4b05dc194f9c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:41.412632 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:41.417543 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dc26f2-5f94-46ff-acf2-4b05dc194f9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:06:41.425584 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-10dc26f2-5f94-46ff-acf2-4b05dc194f9c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:06:41.425584 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:06:41.425584 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:06:41.425584 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:06:41.425584 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:06:41.425584 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:06:41.425584 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:06:41.425584 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:06:41.425584 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:06:41.425584 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:06:41.425584 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:06:41.425584 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:06:41.425584 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:06:41.425584 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:06:41.425584 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:06:41.425584 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:06:41.426617 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:06:41.426617 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:06:41.426617 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:06:41.426617 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:06:41.426617 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:06:41.426617 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:06:41.426617 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:06:41.426617 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:06:41.426617 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:06:41.426617 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:06:41.426617 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:06:41.426617 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:06:41.426617 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:06:41.426617 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:06:41.426617 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:06:41.426617 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:06:41.427672 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:06:41.427672 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:06:41.427672 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:06:41.427672 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:06:41.427672 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:06:41.427672 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:06:41.427672 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:06:41.427672 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:06:41.427672 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:06:41.427672 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:06:41.427672 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:06:41.427672 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:06:41.427672 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 594/1156] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Jul 4 09:06:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:06:41.433206 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2486fb20-daf8-44a7-bf66-7cb0006aefbc None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:41.463896 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:41.540867 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2486fb20-daf8-44a7-bf66-7cb0006aefbc None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:41.576422 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b92dfe-7d98-49be-8ac1-965395c07135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:41.577068 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b92dfe-7d98-49be-8ac1-965395c07135 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:41.577349 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b92dfe-7d98-49be-8ac1-965395c07135 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:41.577621 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b92dfe-7d98-49be-8ac1-965395c07135 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:41.578363 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b92dfe-7d98-49be-8ac1-965395c07135 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:06:41.578670 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b92dfe-7d98-49be-8ac1-965395c07135 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:41.580091 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b92dfe-7d98-49be-8ac1-965395c07135 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:41.588236 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 563/1157] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jul 4 09:06:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:06:41.595325 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dc26f2-5f94-46ff-acf2-4b05dc194f9c None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:41.704025 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dc26f2-5f94-46ff-acf2-4b05dc194f9c None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:41.742200 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d969b5-152c-4688-a4fa-6c8f371f595a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:41.743052 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d969b5-152c-4688-a4fa-6c8f371f595a None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:41.743340 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d969b5-152c-4688-a4fa-6c8f371f595a None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:41.743612 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d969b5-152c-4688-a4fa-6c8f371f595a None admin] PATH_INFO: `/v3/users/0e6d5e1dcb354ca79a55e93af8c77fe1` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:41.744872 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d969b5-152c-4688-a4fa-6c8f371f595a None admin] RBAC: Authorizing `identity:get_user(user_id=0e6d5e1dcb354ca79a55e93af8c77fe1)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:41.746334 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d969b5-152c-4688-a4fa-6c8f371f595a None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:41.747950 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 595/1158] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Jul 4 09:06:41 2022] GET /identity/v3/users/0e6d5e1dcb354ca79a55e93af8c77fe1 => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:06:41.757026 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b92dfe-7d98-49be-8ac1-965395c07135 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:41.859606 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:41.869302 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b92dfe-7d98-49be-8ac1-965395c07135 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:41.904685 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a27981f-8b9e-4b06-ac5d-d67ed13f07ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:41.905333 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a27981f-8b9e-4b06-ac5d-d67ed13f07ee None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:41.905616 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a27981f-8b9e-4b06-ac5d-d67ed13f07ee None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:41.905884 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a27981f-8b9e-4b06-ac5d-d67ed13f07ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:41.973998 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a27981f-8b9e-4b06-ac5d-d67ed13f07ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:41.975417 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a27981f-8b9e-4b06-ac5d-d67ed13f07ee None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:42.065346 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:42.082533 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 564/1159] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jul 4 09:06:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 04 09:06:42.091758 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d969b5-152c-4688-a4fa-6c8f371f595a None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:42.178965 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:42.214387 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d969b5-152c-4688-a4fa-6c8f371f595a None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:42.249297 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaee9d3c-2009-4fec-aaae-2de8097fd1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:42.250080 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee9d3c-2009-4fec-aaae-2de8097fd1f8 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:42.250354 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee9d3c-2009-4fec-aaae-2de8097fd1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:42.250616 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee9d3c-2009-4fec-aaae-2de8097fd1f8 None admin] PATH_INFO: `/v3/projects/52d60603ecf0484884f7c3bf1d289d30` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:42.251919 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaee9d3c-2009-4fec-aaae-2de8097fd1f8 None admin] RBAC: Authorizing `identity:get_project(project_id=52d60603ecf0484884f7c3bf1d289d30)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:42.253373 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaee9d3c-2009-4fec-aaae-2de8097fd1f8 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:42.255040 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 596/1160] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jul 4 09:06:42 2022] GET /identity/v3/projects/52d60603ecf0484884f7c3bf1d289d30 => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:06:42.261613 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a27981f-8b9e-4b06-ac5d-d67ed13f07ee None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:42.368593 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a27981f-8b9e-4b06-ac5d-d67ed13f07ee None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:42.403569 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4154fa-3922-4348-b5fd-b61736c42e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:42.404229 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4154fa-3922-4348-b5fd-b61736c42e8e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:42.404505 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4154fa-3922-4348-b5fd-b61736c42e8e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:42.404778 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4154fa-3922-4348-b5fd-b61736c42e8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:42.405588 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4154fa-3922-4348-b5fd-b61736c42e8e None admin] RBAC: Adding query filter params (role.id=965049e7ce6144aaad23c15f3a5e37c3, scope.project.id=52d60603ecf0484884f7c3bf1d289d30, user.id=0e6d5e1dcb354ca79a55e93af8c77fe1) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:06:42.405901 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4154fa-3922-4348-b5fd-b61736c42e8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:42.407325 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4154fa-3922-4348-b5fd-b61736c42e8e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:42.413852 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 565/1161] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Jul 4 09:06:42 2022] GET /identity/v3/role_assignments?user.id=0e6d5e1dcb354ca79a55e93af8c77fe1&scope.project.id=52d60603ecf0484884f7c3bf1d289d30&role.id=965049e7ce6144aaad23c15f3a5e37c3 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:06:44.450935 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f5096b-1d36-4db7-90f3-04c486e83594 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:44.451902 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f5096b-1d36-4db7-90f3-04c486e83594 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:44.451902 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f5096b-1d36-4db7-90f3-04c486e83594 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:44.454113 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 597/1162] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:06:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:06:44.460561 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583884cb-5efb-446c-a129-40f1980c5684 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:44.460993 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583884cb-5efb-446c-a129-40f1980c5684 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:44.461130 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583884cb-5efb-446c-a129-40f1980c5684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:44.485381 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-583884cb-5efb-446c-a129-40f1980c5684 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:06:44.486573 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-583884cb-5efb-446c-a129-40f1980c5684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:06:44.538179 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:44.556677 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 566/1163] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:06:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:06:44.579259 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f5096b-1d36-4db7-90f3-04c486e83594 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:44.708329 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f5096b-1d36-4db7-90f3-04c486e83594 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:44.745094 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c5ee1c-55e9-430c-b541-48ff8e3ce5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:44.745725 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c5ee1c-55e9-430c-b541-48ff8e3ce5bf None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:44.746012 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c5ee1c-55e9-430c-b541-48ff8e3ce5bf None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:44.746289 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c5ee1c-55e9-430c-b541-48ff8e3ce5bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:44.749764 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:44.823802 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c5ee1c-55e9-430c-b541-48ff8e3ce5bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:44.825294 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c5ee1c-55e9-430c-b541-48ff8e3ce5bf None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:44.928885 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 598/1164] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jul 4 09:06:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 04 09:06:44.935259 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583884cb-5efb-446c-a129-40f1980c5684 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:45.052204 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583884cb-5efb-446c-a129-40f1980c5684 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:45.086865 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3ac288-7845-47ca-b053-f8055db41446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:45.087656 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ac288-7845-47ca-b053-f8055db41446 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:45.088044 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ac288-7845-47ca-b053-f8055db41446 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:45.088305 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ac288-7845-47ca-b053-f8055db41446 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:45.095292 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3ac288-7845-47ca-b053-f8055db41446 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:45.096762 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3ac288-7845-47ca-b053-f8055db41446 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:45.111120 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-cd3ac288-7845-47ca-b053-f8055db41446 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 04 09:06:45.111120 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:06:45.111120 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 04 09:06:45.111120 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 04 09:06:45.111120 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:06:45.111120 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:06:45.111120 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:06:45.111120 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:06:45.111120 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 04 09:06:45.111120 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:06:45.111120 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:06:45.111120 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:06:45.111120 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:06:45.111120 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:06:45.111120 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:06:45.111120 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:06:45.111120 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:06:45.112309 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:06:45.112309 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:06:45.112309 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:06:45.112309 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:06:45.112309 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:06:45.112309 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:06:45.112309 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:06:45.112309 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:06:45.112309 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:06:45.112309 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:06:45.112309 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:06:45.112309 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:06:45.112309 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:06:45.112309 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:06:45.112309 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:06:45.112309 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:06:45.113479 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:06:45.113479 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:06:45.113479 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:06:45.113479 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:06:45.113479 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:06:45.113479 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:06:45.113479 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:06:45.113479 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:06:45.113479 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:06:45.113479 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:06:45.113479 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 04 09:06:45.113479 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:06:45.113479 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 04 09:06:45.113479 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:06:45.113479 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 567/1165] 10.222.0.42 () {56 vars in 1117 bytes} [Mon Jul 4 09:06:44 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:06:45.118388 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c5ee1c-55e9-430c-b541-48ff8e3ce5bf None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:45.157940 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:45.229788 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c5ee1c-55e9-430c-b541-48ff8e3ce5bf None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:45.265179 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf5df24-2269-455e-968a-ca1c437cdc2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:45.265831 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5df24-2269-455e-968a-ca1c437cdc2b None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:45.266111 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5df24-2269-455e-968a-ca1c437cdc2b None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:45.266380 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5df24-2269-455e-968a-ca1c437cdc2b None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:45.267091 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf5df24-2269-455e-968a-ca1c437cdc2b None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:06:45.267393 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf5df24-2269-455e-968a-ca1c437cdc2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:45.268795 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf5df24-2269-455e-968a-ca1c437cdc2b None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:45.275912 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 599/1166] 10.222.0.42 () {56 vars in 1115 bytes} [Mon Jul 4 09:06:45 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:06:47.270107 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d86bdc-a229-4719-8511-d11aa5ea64a1 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:47.270946 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d86bdc-a229-4719-8511-d11aa5ea64a1 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:47.270946 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d86bdc-a229-4719-8511-d11aa5ea64a1 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:47.273232 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 568/1167] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:06:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:06:47.278732 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f496431-21c0-4a72-a256-cf67f89c2ae8 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:47.279168 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f496431-21c0-4a72-a256-cf67f89c2ae8 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:47.279256 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f496431-21c0-4a72-a256-cf67f89c2ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:47.298190 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-4f496431-21c0-4a72-a256-cf67f89c2ae8 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:06:47.299392 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-4f496431-21c0-4a72-a256-cf67f89c2ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:06:47.375348 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 600/1168] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:06:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:06:47.398935 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d86bdc-a229-4719-8511-d11aa5ea64a1 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:47.452658 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:47.510570 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d86bdc-a229-4719-8511-d11aa5ea64a1 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:47.546431 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeaf90f-8343-437a-ae0f-487a6395d3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:47.547008 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeaf90f-8343-437a-ae0f-487a6395d3fc None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:47.547286 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeaf90f-8343-437a-ae0f-487a6395d3fc None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:47.547553 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeaf90f-8343-437a-ae0f-487a6395d3fc None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:47.548454 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeaf90f-8343-437a-ae0f-487a6395d3fc None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:47.549846 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeaf90f-8343-437a-ae0f-487a6395d3fc None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:47.567578 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 569/1169] 10.222.0.42 () {60 vars in 1138 bytes} [Mon Jul 4 09:06:47 2022] POST /identity/v3/domains => generated 267 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:06:49.593609 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48900d1b-499d-44d9-8ae7-bd13f518c397 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:49.594256 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48900d1b-499d-44d9-8ae7-bd13f518c397 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:49.594256 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48900d1b-499d-44d9-8ae7-bd13f518c397 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:49.596562 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 601/1170] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:06:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:06:49.602870 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c544a-5b79-41b8-a3c0-5eb724ef4def None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:49.603552 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c544a-5b79-41b8-a3c0-5eb724ef4def None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:49.603835 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c544a-5b79-41b8-a3c0-5eb724ef4def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:49.635281 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-603c544a-5b79-41b8-a3c0-5eb724ef4def None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:06:49.636499 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-603c544a-5b79-41b8-a3c0-5eb724ef4def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:06:49.710422 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 570/1171] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:06:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:06:49.734641 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48900d1b-499d-44d9-8ae7-bd13f518c397 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:49.776112 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:49.847905 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48900d1b-499d-44d9-8ae7-bd13f518c397 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:49.881407 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0417a3a1-f42c-42a2-962f-4a0d0a2f1d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:49.882257 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417a3a1-f42c-42a2-962f-4a0d0a2f1d7e None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:49.882532 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417a3a1-f42c-42a2-962f-4a0d0a2f1d7e None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:49.882795 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417a3a1-f42c-42a2-962f-4a0d0a2f1d7e None admin] PATH_INFO: `/v3/domains/d3aaffb0ba1345809a929f17d1b67620` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:49.893709 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0417a3a1-f42c-42a2-962f-4a0d0a2f1d7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=d3aaffb0ba1345809a929f17d1b67620)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:49.895487 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0417a3a1-f42c-42a2-962f-4a0d0a2f1d7e None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:49.897170 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 602/1172] 10.222.0.42 () {56 vars in 1183 bytes} [Mon Jul 4 09:06:49 2022] GET /identity/v3/domains/d3aaffb0ba1345809a929f17d1b67620 => generated 267 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:06:49.903087 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603c544a-5b79-41b8-a3c0-5eb724ef4def None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:49.936881 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:50.013079 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603c544a-5b79-41b8-a3c0-5eb724ef4def None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:50.048269 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c8ceb7-f4b0-4e89-8220-bed557899b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:50.048920 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c8ceb7-f4b0-4e89-8220-bed557899b10 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:50.049212 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c8ceb7-f4b0-4e89-8220-bed557899b10 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:50.049463 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c8ceb7-f4b0-4e89-8220-bed557899b10 None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:50.050159 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c8ceb7-f4b0-4e89-8220-bed557899b10 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:50.051612 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c8ceb7-f4b0-4e89-8220-bed557899b10 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:50.085513 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 571/1173] 10.222.0.42 () {60 vars in 1141 bytes} [Mon Jul 4 09:06:49 2022] POST /identity/v3/projects => generated 361 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:06:52.117293 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64907ea6-d4aa-4ed9-bda2-5663573ab978 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:52.118157 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64907ea6-d4aa-4ed9-bda2-5663573ab978 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:52.118157 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64907ea6-d4aa-4ed9-bda2-5663573ab978 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:52.120628 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 603/1174] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:06:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:06:52.128550 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854db59a-727f-444c-9634-c8b4b67f92cc None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:52.128990 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854db59a-727f-444c-9634-c8b4b67f92cc None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:52.129080 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854db59a-727f-444c-9634-c8b4b67f92cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:52.146625 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-854db59a-727f-444c-9634-c8b4b67f92cc None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:06:52.147734 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-854db59a-727f-444c-9634-c8b4b67f92cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:06:52.215624 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 572/1175] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:06:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 09:06:52.245902 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64907ea6-d4aa-4ed9-bda2-5663573ab978 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:52.340846 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:52.352713 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64907ea6-d4aa-4ed9-bda2-5663573ab978 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:52.390424 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f66f0a3-ca36-4c5d-b87f-68217b2b2b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:52.391277 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f66f0a3-ca36-4c5d-b87f-68217b2b2b75 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:52.391560 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f66f0a3-ca36-4c5d-b87f-68217b2b2b75 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:52.391832 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f66f0a3-ca36-4c5d-b87f-68217b2b2b75 None admin] PATH_INFO: `/v3/domains/d3aaffb0ba1345809a929f17d1b67620` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:52.393091 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f66f0a3-ca36-4c5d-b87f-68217b2b2b75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=d3aaffb0ba1345809a929f17d1b67620)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:52.394525 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f66f0a3-ca36-4c5d-b87f-68217b2b2b75 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:52.396151 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 604/1176] 10.222.0.42 () {56 vars in 1183 bytes} [Mon Jul 4 09:06:52 2022] GET /identity/v3/domains/d3aaffb0ba1345809a929f17d1b67620 => generated 267 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:06:52.402204 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854db59a-727f-444c-9634-c8b4b67f92cc None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:52.420984 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:52.510759 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854db59a-727f-444c-9634-c8b4b67f92cc None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:52.546284 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b12775d-cdd6-4d8e-90cb-c768ab1a1f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:52.546934 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b12775d-cdd6-4d8e-90cb-c768ab1a1f60 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:52.547213 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b12775d-cdd6-4d8e-90cb-c768ab1a1f60 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:52.547486 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b12775d-cdd6-4d8e-90cb-c768ab1a1f60 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:52.548209 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b12775d-cdd6-4d8e-90cb-c768ab1a1f60 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:52.549674 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b12775d-cdd6-4d8e-90cb-c768ab1a1f60 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:52.576915 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 573/1177] 10.222.0.42 () {60 vars in 1132 bytes} [Mon Jul 4 09:06:52 2022] POST /identity/v3/users => generated 311 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:06:54.622089 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c586e-2f2d-4212-ace8-932f64c7bc13 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:54.622942 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c586e-2f2d-4212-ace8-932f64c7bc13 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:54.622942 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c586e-2f2d-4212-ace8-932f64c7bc13 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:54.625262 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 605/1178] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:06:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:06:54.630689 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba744fa4-461e-4e26-a8b3-c00a5671f216 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:54.631103 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba744fa4-461e-4e26-a8b3-c00a5671f216 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:54.631193 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba744fa4-461e-4e26-a8b3-c00a5671f216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:54.649793 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-ba744fa4-461e-4e26-a8b3-c00a5671f216 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:06:54.651004 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ba744fa4-461e-4e26-a8b3-c00a5671f216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:06:54.734540 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 574/1179] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:06:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:06:54.761838 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023c586e-2f2d-4212-ace8-932f64c7bc13 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:54.872197 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023c586e-2f2d-4212-ace8-932f64c7bc13 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:54.912921 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3359f219-2808-4770-a2e8-9ee5fb41aa52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:54.913712 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3359f219-2808-4770-a2e8-9ee5fb41aa52 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:54.913988 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3359f219-2808-4770-a2e8-9ee5fb41aa52 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:54.914261 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3359f219-2808-4770-a2e8-9ee5fb41aa52 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:54.925757 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3359f219-2808-4770-a2e8-9ee5fb41aa52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:06:54.933345 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-3359f219-2808-4770-a2e8-9ee5fb41aa52 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:06:54.933345 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:06:54.933345 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:06:54.933345 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:06:54.933345 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:06:54.933345 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:06:54.933345 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:06:54.933345 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:06:54.933345 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:06:54.933345 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:06:54.933345 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:06:54.933345 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:06:54.933345 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:06:54.933345 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:06:54.933345 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:06:54.933345 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:06:54.934384 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:06:54.934384 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:06:54.934384 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:06:54.934384 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:06:54.934384 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:06:54.934384 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:06:54.934384 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:06:54.934384 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:06:54.934384 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:06:54.934384 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:06:54.934384 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:06:54.934384 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:06:54.934384 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:06:54.934384 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:06:54.934384 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:06:54.934384 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:06:54.935276 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:06:54.935276 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:06:54.935276 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:06:54.935276 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:06:54.935276 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:06:54.935276 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:06:54.935276 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:06:54.935276 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:06:54.935276 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:06:54.935276 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:06:54.935276 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:06:54.935276 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:06:54.935276 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 606/1180] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Jul 4 09:06:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:06:54.942587 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba744fa4-461e-4e26-a8b3-c00a5671f216 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:54.944844 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:55.049195 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba744fa4-461e-4e26-a8b3-c00a5671f216 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:55.083672 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f70aad-ef71-42a0-8b51-d595a421bf8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:55.084346 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f70aad-ef71-42a0-8b51-d595a421bf8f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:55.084620 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f70aad-ef71-42a0-8b51-d595a421bf8f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:55.084883 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f70aad-ef71-42a0-8b51-d595a421bf8f None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:55.085619 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f70aad-ef71-42a0-8b51-d595a421bf8f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:06:55.085917 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f70aad-ef71-42a0-8b51-d595a421bf8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:55.087298 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f70aad-ef71-42a0-8b51-d595a421bf8f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:55.095344 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 575/1181] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jul 4 09:06:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:06:55.104127 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3359f219-2808-4770-a2e8-9ee5fb41aa52 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:55.127184 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:55.220610 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3359f219-2808-4770-a2e8-9ee5fb41aa52 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:55.258019 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f6b40b-1292-4054-b7f7-dcee23217137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:55.258878 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6b40b-1292-4054-b7f7-dcee23217137 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:55.259157 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6b40b-1292-4054-b7f7-dcee23217137 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:55.259436 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6b40b-1292-4054-b7f7-dcee23217137 None admin] PATH_INFO: `/v3/users/ae9586eb96054f1b9ea50305184c34d8` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:55.274541 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f6b40b-1292-4054-b7f7-dcee23217137 None admin] RBAC: Authorizing `identity:get_user(user_id=ae9586eb96054f1b9ea50305184c34d8)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:55.276054 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f6b40b-1292-4054-b7f7-dcee23217137 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:55.277720 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 607/1182] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Jul 4 09:06:55 2022] GET /identity/v3/users/ae9586eb96054f1b9ea50305184c34d8 => generated 311 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:06:55.284040 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f70aad-ef71-42a0-8b51-d595a421bf8f None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:55.348905 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:55.395346 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f70aad-ef71-42a0-8b51-d595a421bf8f None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:55.428057 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e19c1ce-e708-4511-b293-bc4d3653a7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:55.428707 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19c1ce-e708-4511-b293-bc4d3653a7f4 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:55.428991 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19c1ce-e708-4511-b293-bc4d3653a7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:55.429251 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19c1ce-e708-4511-b293-bc4d3653a7f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:55.501926 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e19c1ce-e708-4511-b293-bc4d3653a7f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:55.503394 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e19c1ce-e708-4511-b293-bc4d3653a7f4 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:55.566864 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:55.608205 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 576/1183] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jul 4 09:06:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 04 09:06:55.615315 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f6b40b-1292-4054-b7f7-dcee23217137 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:55.695243 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:55.719109 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f6b40b-1292-4054-b7f7-dcee23217137 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:55.756689 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6ec47e-6a00-44ef-bf6c-bad19b230ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:55.757548 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ec47e-6a00-44ef-bf6c-bad19b230ed4 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:55.757833 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ec47e-6a00-44ef-bf6c-bad19b230ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:55.758165 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ec47e-6a00-44ef-bf6c-bad19b230ed4 None admin] PATH_INFO: `/v3/projects/cb3f6c68f7164e9fa375ac5c23d11749` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:55.759377 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6ec47e-6a00-44ef-bf6c-bad19b230ed4 None admin] RBAC: Authorizing `identity:get_project(project_id=cb3f6c68f7164e9fa375ac5c23d11749)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:55.760924 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6ec47e-6a00-44ef-bf6c-bad19b230ed4 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:55.762592 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 608/1184] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jul 4 09:06:55 2022] GET /identity/v3/projects/cb3f6c68f7164e9fa375ac5c23d11749 => generated 361 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:06:55.772107 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e19c1ce-e708-4511-b293-bc4d3653a7f4 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:55.884377 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e19c1ce-e708-4511-b293-bc4d3653a7f4 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:55.930369 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de4bdcb-aa01-485e-849f-7038239f576f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:55.931029 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4bdcb-aa01-485e-849f-7038239f576f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:55.931309 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4bdcb-aa01-485e-849f-7038239f576f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:55.931586 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4bdcb-aa01-485e-849f-7038239f576f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:55.932458 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de4bdcb-aa01-485e-849f-7038239f576f None admin] RBAC: Adding query filter params (role.id=965049e7ce6144aaad23c15f3a5e37c3, scope.project.id=cb3f6c68f7164e9fa375ac5c23d11749, user.id=ae9586eb96054f1b9ea50305184c34d8) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:06:55.932769 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de4bdcb-aa01-485e-849f-7038239f576f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:55.934232 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de4bdcb-aa01-485e-849f-7038239f576f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:55.939958 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 577/1185] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Jul 4 09:06:55 2022] GET /identity/v3/role_assignments?user.id=ae9586eb96054f1b9ea50305184c34d8&scope.project.id=cb3f6c68f7164e9fa375ac5c23d11749&role.id=965049e7ce6144aaad23c15f3a5e37c3 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:06:57.924498 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60985148-8f42-4cde-ad02-8e1283405c2f None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:57.925013 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60985148-8f42-4cde-ad02-8e1283405c2f None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:57.925013 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60985148-8f42-4cde-ad02-8e1283405c2f None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:57.926426 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 609/1186] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:06:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:06:57.932520 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614a108-cfc7-4953-b654-3b626ca817f9 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:57.932986 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614a108-cfc7-4953-b654-3b626ca817f9 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:57.933079 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614a108-cfc7-4953-b654-3b626ca817f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:57.951258 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-1614a108-cfc7-4953-b654-3b626ca817f9 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:06:57.952469 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-1614a108-cfc7-4953-b654-3b626ca817f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:06:57.975424 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:58.025147 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 578/1187] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:06:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:06:58.047991 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60985148-8f42-4cde-ad02-8e1283405c2f None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:58.164106 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60985148-8f42-4cde-ad02-8e1283405c2f None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:58.202367 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cb4db5-a68e-4144-bbed-e9c76ce18ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:58.203145 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb4db5-a68e-4144-bbed-e9c76ce18ec8 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:58.203427 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb4db5-a68e-4144-bbed-e9c76ce18ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:58.203698 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb4db5-a68e-4144-bbed-e9c76ce18ec8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:58.214764 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cb4db5-a68e-4144-bbed-e9c76ce18ec8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:06:58.222344 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-38cb4db5-a68e-4144-bbed-e9c76ce18ec8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:06:58.222344 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:06:58.222344 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:06:58.222344 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:06:58.222344 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:06:58.222344 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:06:58.222344 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:06:58.222344 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:06:58.222344 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:06:58.222344 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:06:58.222344 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:06:58.222344 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:06:58.222344 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:06:58.222344 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:06:58.222344 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:06:58.222344 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:06:58.223481 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:06:58.223481 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:06:58.223481 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:06:58.223481 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:06:58.223481 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:06:58.223481 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:06:58.223481 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:06:58.223481 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:06:58.223481 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:06:58.223481 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:06:58.223481 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:06:58.223481 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:06:58.223481 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:06:58.223481 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:06:58.223481 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:06:58.223481 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:06:58.224601 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:06:58.224601 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:06:58.224601 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:06:58.224601 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:06:58.224601 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:06:58.224601 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:06:58.224601 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:06:58.224601 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:06:58.224601 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:06:58.224601 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:06:58.224601 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:06:58.224601 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:06:58.224601 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 610/1188] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Jul 4 09:06:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:06:58.231211 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1614a108-cfc7-4953-b654-3b626ca817f9 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:58.338417 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1614a108-cfc7-4953-b654-3b626ca817f9 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:58.374164 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecbb986-d531-4109-9fcd-f0bb4571c556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:58.374811 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecbb986-d531-4109-9fcd-f0bb4571c556 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:58.375092 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecbb986-d531-4109-9fcd-f0bb4571c556 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:58.375359 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecbb986-d531-4109-9fcd-f0bb4571c556 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:58.376129 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecbb986-d531-4109-9fcd-f0bb4571c556 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:06:58.376427 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecbb986-d531-4109-9fcd-f0bb4571c556 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:58.377810 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecbb986-d531-4109-9fcd-f0bb4571c556 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:58.386018 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 579/1189] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jul 4 09:06:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:06:58.394839 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cb4db5-a68e-4144-bbed-e9c76ce18ec8 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:58.399104 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:58.498987 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cb4db5-a68e-4144-bbed-e9c76ce18ec8 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:58.536553 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77373cc5-187b-40c0-a45d-c4335d297c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:58.537408 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77373cc5-187b-40c0-a45d-c4335d297c0a None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:58.537691 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77373cc5-187b-40c0-a45d-c4335d297c0a None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:58.537961 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77373cc5-187b-40c0-a45d-c4335d297c0a None admin] PATH_INFO: `/v3/users/ae9586eb96054f1b9ea50305184c34d8` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:58.539264 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77373cc5-187b-40c0-a45d-c4335d297c0a None admin] RBAC: Authorizing `identity:get_user(user_id=ae9586eb96054f1b9ea50305184c34d8)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:58.540742 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77373cc5-187b-40c0-a45d-c4335d297c0a None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:58.542403 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 611/1190] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Jul 4 09:06:58 2022] GET /identity/v3/users/ae9586eb96054f1b9ea50305184c34d8 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:06:58.548862 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecbb986-d531-4109-9fcd-f0bb4571c556 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:58.575304 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:58.661818 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecbb986-d531-4109-9fcd-f0bb4571c556 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:58.695967 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a356207-3429-4572-96f4-8f1aa3d3c97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:58.696811 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a356207-3429-4572-96f4-8f1aa3d3c97e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:58.697085 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a356207-3429-4572-96f4-8f1aa3d3c97e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:58.697362 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a356207-3429-4572-96f4-8f1aa3d3c97e None admin] PATH_INFO: `/v3/projects/cb3f6c68f7164e9fa375ac5c23d11749` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:58.698612 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a356207-3429-4572-96f4-8f1aa3d3c97e None admin] RBAC: Authorizing `identity:get_project(project_id=cb3f6c68f7164e9fa375ac5c23d11749)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:58.700089 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a356207-3429-4572-96f4-8f1aa3d3c97e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:58.701769 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 580/1191] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jul 4 09:06:58 2022] GET /identity/v3/projects/cb3f6c68f7164e9fa375ac5c23d11749 => generated 361 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:06:58.707862 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77373cc5-187b-40c0-a45d-c4335d297c0a None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:06:58.796817 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:06:58.828255 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77373cc5-187b-40c0-a45d-c4335d297c0a None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:06:58.865600 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5800764-f57a-4af0-b747-3729b6c8a535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:06:58.866895 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5800764-f57a-4af0-b747-3729b6c8a535 None admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:06:58.867231 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5800764-f57a-4af0-b747-3729b6c8a535 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:06:58.867582 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5800764-f57a-4af0-b747-3729b6c8a535 None admin] PATH_INFO: `/v3/projects/cb3f6c68f7164e9fa375ac5c23d11749/users/ae9586eb96054f1b9ea50305184c34d8/roles/965049e7ce6144aaad23c15f3a5e37c3` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:06:58.872182 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5800764-f57a-4af0-b747-3729b6c8a535 None admin] RBAC: Authorizing `identity:create_grant(project_id=cb3f6c68f7164e9fa375ac5c23d11749, user_id=ae9586eb96054f1b9ea50305184c34d8, role_id=965049e7ce6144aaad23c15f3a5e37c3)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:06:58.874436 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5800764-f57a-4af0-b747-3729b6c8a535 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:06:58.891051 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 612/1192] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Jul 4 09:06:58 2022] PUT /identity/v3/projects/cb3f6c68f7164e9fa375ac5c23d11749/users/ae9586eb96054f1b9ea50305184c34d8/roles/965049e7ce6144aaad23c15f3a5e37c3 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:07:00.854646 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c48a00-e4bf-4b49-b7b1-8454d502af0a None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:07:00.855585 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c48a00-e4bf-4b49-b7b1-8454d502af0a None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:07:00.855585 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c48a00-e4bf-4b49-b7b1-8454d502af0a None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:07:00.857950 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 581/1193] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:07:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:07:00.864743 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bbc303-e69e-4104-9705-2275b9206614 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:07:00.865484 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bbc303-e69e-4104-9705-2275b9206614 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:07:00.865614 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bbc303-e69e-4104-9705-2275b9206614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:07:00.885490 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-e8bbc303-e69e-4104-9705-2275b9206614 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:07:00.886671 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-e8bbc303-e69e-4104-9705-2275b9206614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:07:00.964194 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 613/1194] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:07:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:07:00.994666 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c48a00-e4bf-4b49-b7b1-8454d502af0a None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:07:01.088939 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:07:01.103602 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c48a00-e4bf-4b49-b7b1-8454d502af0a None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:07:01.150735 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a5a64e-68de-4af2-83f4-a35bf126dc86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:07:01.151436 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a5a64e-68de-4af2-83f4-a35bf126dc86 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:07:01.151711 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a5a64e-68de-4af2-83f4-a35bf126dc86 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:07:01.152079 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a5a64e-68de-4af2-83f4-a35bf126dc86 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:07:01.166835 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a5a64e-68de-4af2-83f4-a35bf126dc86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:07:01.174360 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-18a5a64e-68de-4af2-83f4-a35bf126dc86 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:07:01.174360 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:07:01.174360 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:07:01.174360 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:07:01.174360 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:07:01.174360 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:07:01.174360 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:07:01.174360 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:07:01.174360 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:07:01.174360 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:07:01.174360 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:07:01.174360 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:07:01.174360 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:07:01.174360 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:07:01.174360 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:07:01.174360 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:07:01.175483 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:07:01.175483 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:07:01.175483 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:07:01.175483 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:07:01.175483 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:07:01.175483 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:07:01.175483 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:07:01.175483 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:07:01.175483 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:07:01.175483 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:07:01.175483 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:07:01.175483 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:07:01.175483 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:07:01.175483 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:07:01.175483 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:07:01.175483 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:07:01.176436 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:07:01.176436 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:07:01.176436 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:07:01.176436 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:07:01.176436 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:07:01.176436 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:07:01.176436 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:07:01.176436 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:07:01.176436 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:07:01.176436 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:07:01.176436 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:07:01.176436 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:07:01.176436 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 582/1195] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Jul 4 09:07:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:07:01.183479 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bbc303-e69e-4104-9705-2275b9206614 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:07:01.246780 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:07:01.285667 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bbc303-e69e-4104-9705-2275b9206614 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:07:01.323609 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bb82a2-ae6c-48fe-a7e5-e4c9a169e199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:07:01.324304 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb82a2-ae6c-48fe-a7e5-e4c9a169e199 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:07:01.324586 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb82a2-ae6c-48fe-a7e5-e4c9a169e199 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:07:01.324859 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb82a2-ae6c-48fe-a7e5-e4c9a169e199 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:07:01.325608 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bb82a2-ae6c-48fe-a7e5-e4c9a169e199 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:07:01.325916 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bb82a2-ae6c-48fe-a7e5-e4c9a169e199 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:07:01.327302 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bb82a2-ae6c-48fe-a7e5-e4c9a169e199 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:07:01.335393 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 614/1196] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jul 4 09:07:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:07:01.342575 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a5a64e-68de-4af2-83f4-a35bf126dc86 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:07:01.442504 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a5a64e-68de-4af2-83f4-a35bf126dc86 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:07:01.480819 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0930e656-1c95-4330-879a-21470e102993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:07:01.481687 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930e656-1c95-4330-879a-21470e102993 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:07:01.481969 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930e656-1c95-4330-879a-21470e102993 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:07:01.482240 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930e656-1c95-4330-879a-21470e102993 None admin] PATH_INFO: `/v3/users/ae9586eb96054f1b9ea50305184c34d8` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:07:01.483857 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0930e656-1c95-4330-879a-21470e102993 None admin] RBAC: Authorizing `identity:get_user(user_id=ae9586eb96054f1b9ea50305184c34d8)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:07:01.485356 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0930e656-1c95-4330-879a-21470e102993 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:07:01.487011 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 583/1197] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Jul 4 09:07:01 2022] GET /identity/v3/users/ae9586eb96054f1b9ea50305184c34d8 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:07:01.493645 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bb82a2-ae6c-48fe-a7e5-e4c9a169e199 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:07:01.611494 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bb82a2-ae6c-48fe-a7e5-e4c9a169e199 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:07:01.634499 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:07:01.646518 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1eb114-9c46-4ebd-8bf6-07b731b867a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:07:01.647162 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1eb114-9c46-4ebd-8bf6-07b731b867a9 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:07:01.647443 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1eb114-9c46-4ebd-8bf6-07b731b867a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:07:01.647717 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1eb114-9c46-4ebd-8bf6-07b731b867a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:07:01.716381 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1eb114-9c46-4ebd-8bf6-07b731b867a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:07:01.717775 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1eb114-9c46-4ebd-8bf6-07b731b867a9 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:07:01.825227 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 615/1198] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jul 4 09:07:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 04 09:07:01.831433 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0930e656-1c95-4330-879a-21470e102993 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:07:01.851606 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:07:01.941300 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0930e656-1c95-4330-879a-21470e102993 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:07:01.979249 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc8d9ea-a1ee-4e34-8e67-43eafbf7be08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:07:01.980077 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc8d9ea-a1ee-4e34-8e67-43eafbf7be08 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:07:01.980361 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc8d9ea-a1ee-4e34-8e67-43eafbf7be08 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:07:01.980633 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc8d9ea-a1ee-4e34-8e67-43eafbf7be08 None admin] PATH_INFO: `/v3/projects/cb3f6c68f7164e9fa375ac5c23d11749` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:07:01.981946 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc8d9ea-a1ee-4e34-8e67-43eafbf7be08 None admin] RBAC: Authorizing `identity:get_project(project_id=cb3f6c68f7164e9fa375ac5c23d11749)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:07:01.983706 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc8d9ea-a1ee-4e34-8e67-43eafbf7be08 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:07:01.985472 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 584/1199] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jul 4 09:07:01 2022] GET /identity/v3/projects/cb3f6c68f7164e9fa375ac5c23d11749 => generated 361 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:07:01.992019 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1eb114-9c46-4ebd-8bf6-07b731b867a9 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:07:02.017267 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:07:02.094804 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1eb114-9c46-4ebd-8bf6-07b731b867a9 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:07:02.132794 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f5636-b7bb-450c-8b32-85e136c6b1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:07:02.133443 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f5636-b7bb-450c-8b32-85e136c6b1cb None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:07:02.133721 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f5636-b7bb-450c-8b32-85e136c6b1cb None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:07:02.133991 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f5636-b7bb-450c-8b32-85e136c6b1cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:07:02.134807 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1f5636-b7bb-450c-8b32-85e136c6b1cb None admin] RBAC: Adding query filter params (role.id=965049e7ce6144aaad23c15f3a5e37c3, scope.project.id=cb3f6c68f7164e9fa375ac5c23d11749, user.id=ae9586eb96054f1b9ea50305184c34d8) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:07:02.135138 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1f5636-b7bb-450c-8b32-85e136c6b1cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:07:02.136630 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1f5636-b7bb-450c-8b32-85e136c6b1cb None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:07:02.142386 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 616/1200] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Jul 4 09:07:01 2022] GET /identity/v3/role_assignments?user.id=ae9586eb96054f1b9ea50305184c34d8&scope.project.id=cb3f6c68f7164e9fa375ac5c23d11749&role.id=965049e7ce6144aaad23c15f3a5e37c3 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:07:11.973910 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=58 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:07:12.139744 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=56 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:07:56.941507 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de14092c-60c9-437d-ae33-386d455753b2 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:07:56.942108 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de14092c-60c9-437d-ae33-386d455753b2 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:07:56.942108 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de14092c-60c9-437d-ae33-386d455753b2 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:07:56.943617 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 585/1201] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:07:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:07:56.948904 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb70d87-0a8a-4b9b-a924-0221e4b8ff3c None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:07:56.949457 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb70d87-0a8a-4b9b-a924-0221e4b8ff3c None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:07:56.949457 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb70d87-0a8a-4b9b-a924-0221e4b8ff3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:07:56.967129 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-1fb70d87-0a8a-4b9b-a924-0221e4b8ff3c None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:07:56.968363 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-1fb70d87-0a8a-4b9b-a924-0221e4b8ff3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:07:57.048029 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 617/1202] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:07:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 09:07:57.070563 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de14092c-60c9-437d-ae33-386d455753b2 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:07:57.204984 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de14092c-60c9-437d-ae33-386d455753b2 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:07:57.245436 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593aa99d-bc6a-4f60-97bf-281b0a609419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:07:57.246238 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593aa99d-bc6a-4f60-97bf-281b0a609419 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:07:57.246518 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593aa99d-bc6a-4f60-97bf-281b0a609419 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:07:57.246787 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593aa99d-bc6a-4f60-97bf-281b0a609419 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:07:57.261100 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593aa99d-bc6a-4f60-97bf-281b0a609419 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:07:57.262669 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593aa99d-bc6a-4f60-97bf-281b0a609419 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:07:57.281188 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-593aa99d-bc6a-4f60-97bf-281b0a609419 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:07:57.281188 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:07:57.281188 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:07:57.281188 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:07:57.281188 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:07:57.281188 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:07:57.281188 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:07:57.281188 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:07:57.281188 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:07:57.281188 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:07:57.281188 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:07:57.281188 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:07:57.281188 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:07:57.281188 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:07:57.281188 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:07:57.282286 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:07:57.282286 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:07:57.282286 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:07:57.282286 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:07:57.282286 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:07:57.282286 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:07:57.282286 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:07:57.282286 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:07:57.282286 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:07:57.282286 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:07:57.282286 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:07:57.282286 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:07:57.282286 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:07:57.282286 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:07:57.282286 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:07:57.282286 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:07:57.282286 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:07:57.283256 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:07:57.283256 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:07:57.283256 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:07:57.283256 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:07:57.283256 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 586/1203] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:07:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:07:57.291512 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb70d87-0a8a-4b9b-a924-0221e4b8ff3c None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:07:57.406670 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb70d87-0a8a-4b9b-a924-0221e4b8ff3c None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:07:57.446057 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:07:57.456712 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da54f2ef-d5bd-40a9-a55a-5ec5474c41db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:07:57.457437 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da54f2ef-d5bd-40a9-a55a-5ec5474c41db None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:07:57.457790 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da54f2ef-d5bd-40a9-a55a-5ec5474c41db None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:07:57.458134 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da54f2ef-d5bd-40a9-a55a-5ec5474c41db None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:07:57.458942 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da54f2ef-d5bd-40a9-a55a-5ec5474c41db None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:07:57.459332 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da54f2ef-d5bd-40a9-a55a-5ec5474c41db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:07:57.461200 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da54f2ef-d5bd-40a9-a55a-5ec5474c41db None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:07:57.478042 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 618/1204] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jul 4 09:07:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:07:57.484146 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593aa99d-bc6a-4f60-97bf-281b0a609419 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:07:57.569842 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:07:57.637907 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593aa99d-bc6a-4f60-97bf-281b0a609419 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:07:57.682481 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f252719-97b7-402e-9d6f-0f9b84483ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:07:57.683331 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f252719-97b7-402e-9d6f-0f9b84483ccd None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:07:57.683625 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f252719-97b7-402e-9d6f-0f9b84483ccd None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:07:57.683937 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f252719-97b7-402e-9d6f-0f9b84483ccd None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:07:57.684805 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f252719-97b7-402e-9d6f-0f9b84483ccd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:07:57.686725 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f252719-97b7-402e-9d6f-0f9b84483ccd None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:07:57.711280 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 587/1205] 10.222.0.42 () {60 vars in 1132 bytes} [Mon Jul 4 09:07:57 2022] POST /identity/v3/users => generated 251 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:08:00.067004 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3e40c1-2039-4009-911a-248981c16bd4 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:00.067569 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3e40c1-2039-4009-911a-248981c16bd4 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:00.067569 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3e40c1-2039-4009-911a-248981c16bd4 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:00.068960 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 619/1206] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:08:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:08:00.074957 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc135fec-3e18-4e3e-bef0-87c194520ef5 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:00.075457 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc135fec-3e18-4e3e-bef0-87c194520ef5 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:00.075564 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc135fec-3e18-4e3e-bef0-87c194520ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:00.093213 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-fc135fec-3e18-4e3e-bef0-87c194520ef5 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:08:00.094396 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-fc135fec-3e18-4e3e-bef0-87c194520ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:08:00.170267 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 588/1207] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:08:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:08:00.199197 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3e40c1-2039-4009-911a-248981c16bd4 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:08:00.317503 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3e40c1-2039-4009-911a-248981c16bd4 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:08:00.360663 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82081289-9ea8-44c3-9467-73f73c0d1a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:08:00.361859 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82081289-9ea8-44c3-9467-73f73c0d1a57 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:00.362003 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82081289-9ea8-44c3-9467-73f73c0d1a57 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:00.362330 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82081289-9ea8-44c3-9467-73f73c0d1a57 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:00.374973 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82081289-9ea8-44c3-9467-73f73c0d1a57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:08:00.382632 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-82081289-9ea8-44c3-9467-73f73c0d1a57 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:08:00.382632 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:08:00.382632 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:08:00.382632 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:08:00.382632 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:08:00.382632 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:08:00.382632 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:08:00.382632 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:08:00.382632 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:08:00.382632 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:08:00.382632 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:08:00.382632 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:08:00.382632 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:08:00.382632 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:08:00.382632 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:08:00.382632 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:08:00.386203 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:08:00.386203 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:08:00.386203 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:08:00.386203 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:08:00.386203 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:08:00.386203 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:08:00.386203 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:08:00.386203 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:08:00.386203 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:08:00.386203 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:08:00.386203 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:08:00.386203 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:08:00.386203 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:08:00.386203 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:08:00.386203 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:08:00.386203 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:08:00.387064 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:08:00.387064 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:08:00.387064 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:08:00.387064 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:08:00.387064 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:08:00.387064 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:08:00.387064 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:08:00.387064 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:08:00.387064 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:08:00.387064 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:08:00.387064 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:08:00.387064 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:08:00.387064 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 620/1208] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Jul 4 09:08:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:08:00.389961 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc135fec-3e18-4e3e-bef0-87c194520ef5 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:08:00.429639 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:08:00.497396 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc135fec-3e18-4e3e-bef0-87c194520ef5 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:08:00.536368 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31564593-3f8f-4f2b-a7d1-a4b404c59ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:08:00.537462 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31564593-3f8f-4f2b-a7d1-a4b404c59ef3 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:00.537994 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31564593-3f8f-4f2b-a7d1-a4b404c59ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:00.538509 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31564593-3f8f-4f2b-a7d1-a4b404c59ef3 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:00.539839 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31564593-3f8f-4f2b-a7d1-a4b404c59ef3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:08:00.540443 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31564593-3f8f-4f2b-a7d1-a4b404c59ef3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:08:00.542074 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31564593-3f8f-4f2b-a7d1-a4b404c59ef3 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:08:00.551596 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 589/1209] 10.222.0.42 () {56 vars in 1103 bytes} [Mon Jul 4 09:08:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:08:00.557729 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82081289-9ea8-44c3-9467-73f73c0d1a57 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:08:00.619369 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:08:00.682441 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82081289-9ea8-44c3-9467-73f73c0d1a57 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:08:00.720032 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b3a18c-6fd7-43ef-97ff-5d016e6a241a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:08:00.720826 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b3a18c-6fd7-43ef-97ff-5d016e6a241a None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:00.721111 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b3a18c-6fd7-43ef-97ff-5d016e6a241a None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:00.721381 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b3a18c-6fd7-43ef-97ff-5d016e6a241a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:00.733757 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b3a18c-6fd7-43ef-97ff-5d016e6a241a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:08:00.735301 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b3a18c-6fd7-43ef-97ff-5d016e6a241a None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:08:00.755877 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-79b3a18c-6fd7-43ef-97ff-5d016e6a241a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:08:00.755877 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:08:00.755877 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:08:00.755877 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:08:00.755877 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:08:00.755877 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:08:00.755877 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:08:00.755877 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:08:00.755877 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:08:00.755877 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:08:00.755877 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:08:00.755877 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:08:00.755877 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:08:00.755877 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:08:00.755877 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:08:00.757499 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:08:00.757499 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:08:00.757499 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:08:00.757499 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:08:00.757499 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:08:00.757499 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:08:00.757499 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:08:00.757499 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:08:00.757499 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:08:00.757499 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:08:00.757499 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:08:00.757499 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:08:00.757499 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:08:00.757499 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:08:00.757499 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:08:00.757499 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:08:00.757499 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:08:00.758433 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:08:00.758433 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:08:00.758433 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:08:00.758433 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:08:00.758433 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 621/1210] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:08:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:08:00.763623 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31564593-3f8f-4f2b-a7d1-a4b404c59ef3 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:08:00.887002 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:08:00.889440 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31564593-3f8f-4f2b-a7d1-a4b404c59ef3 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:08:00.931228 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992f068e-467c-4a43-a08d-dc3e45037615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:08:00.931961 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f068e-467c-4a43-a08d-dc3e45037615 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:00.932497 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f068e-467c-4a43-a08d-dc3e45037615 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:00.932777 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f068e-467c-4a43-a08d-dc3e45037615 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:00.933570 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992f068e-467c-4a43-a08d-dc3e45037615 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:08:00.933882 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992f068e-467c-4a43-a08d-dc3e45037615 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:08:00.935290 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992f068e-467c-4a43-a08d-dc3e45037615 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:08:00.956932 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 590/1211] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jul 4 09:08:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:08:00.958126 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b3a18c-6fd7-43ef-97ff-5d016e6a241a None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:08:01.083384 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b3a18c-6fd7-43ef-97ff-5d016e6a241a None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:08:01.085085 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:08:01.123815 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1185ab5e-d594-4086-832d-dc92415aa224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:08:01.124959 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185ab5e-d594-4086-832d-dc92415aa224 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:01.124959 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185ab5e-d594-4086-832d-dc92415aa224 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:01.125286 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185ab5e-d594-4086-832d-dc92415aa224 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:01.134024 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1185ab5e-d594-4086-832d-dc92415aa224 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:08:01.135924 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1185ab5e-d594-4086-832d-dc92415aa224 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:08:01.153206 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-1185ab5e-d594-4086-832d-dc92415aa224 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 04 09:08:01.153206 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:08:01.153206 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:08:01.153206 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:08:01.153206 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:08:01.153206 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:08:01.153206 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:08:01.153206 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:08:01.153206 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:08:01.153206 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:08:01.153206 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:08:01.153206 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:08:01.153206 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:08:01.153206 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:08:01.153206 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:08:01.153206 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:08:01.154637 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:08:01.154637 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:08:01.154637 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:08:01.154637 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:08:01.154637 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:08:01.154637 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:08:01.154637 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:08:01.154637 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:08:01.154637 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:08:01.154637 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:08:01.154637 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:08:01.154637 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:08:01.154637 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:08:01.154637 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:08:01.154637 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:08:01.154637 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:08:01.154637 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:08:01.154637 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:08:01.155600 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:08:01.155600 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:08:01.155600 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:08:01.155600 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:08:01.155600 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:08:01.155600 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:08:01.155600 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:08:01.155600 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:08:01.155600 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 04 09:08:01.155600 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:08:01.155600 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 622/1212] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:08:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:08:01.160581 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992f068e-467c-4a43-a08d-dc3e45037615 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:08:01.278083 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992f068e-467c-4a43-a08d-dc3e45037615 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:08:01.323389 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071b8717-a2ba-4d19-b7a2-8a6dbe30eba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:08:01.324221 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b8717-a2ba-4d19-b7a2-8a6dbe30eba3 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:01.324518 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b8717-a2ba-4d19-b7a2-8a6dbe30eba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:01.324868 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b8717-a2ba-4d19-b7a2-8a6dbe30eba3 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:01.325824 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071b8717-a2ba-4d19-b7a2-8a6dbe30eba3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:08:01.326147 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071b8717-a2ba-4d19-b7a2-8a6dbe30eba3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:08:01.327982 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071b8717-a2ba-4d19-b7a2-8a6dbe30eba3 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:08:01.351294 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 591/1213] 10.222.0.42 () {56 vars in 1143 bytes} [Mon Jul 4 09:08:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:08:01.357977 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1185ab5e-d594-4086-832d-dc92415aa224 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:08:01.477002 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1185ab5e-d594-4086-832d-dc92415aa224 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:08:01.515527 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92b3ba7-11db-4f99-b519-6b82c8db66c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:08:01.516920 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b3ba7-11db-4f99-b519-6b82c8db66c4 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:01.516920 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b3ba7-11db-4f99-b519-6b82c8db66c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:01.517228 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b3ba7-11db-4f99-b519-6b82c8db66c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:01.552042 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:08:01.593250 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92b3ba7-11db-4f99-b519-6b82c8db66c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:08:01.594808 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92b3ba7-11db-4f99-b519-6b82c8db66c4 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:08:01.705518 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 623/1214] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jul 4 09:08:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 04 09:08:01.711383 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071b8717-a2ba-4d19-b7a2-8a6dbe30eba3 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:08:01.731775 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:08:01.829507 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071b8717-a2ba-4d19-b7a2-8a6dbe30eba3 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:08:01.872444 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a3837b-1c01-43bb-8c4f-fef9c27d380b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:08:01.873246 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a3837b-1c01-43bb-8c4f-fef9c27d380b None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:01.873529 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a3837b-1c01-43bb-8c4f-fef9c27d380b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:01.873802 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a3837b-1c01-43bb-8c4f-fef9c27d380b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:01.888777 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a3837b-1c01-43bb-8c4f-fef9c27d380b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:08:01.890318 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a3837b-1c01-43bb-8c4f-fef9c27d380b None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:08:01.910908 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-f3a3837b-1c01-43bb-8c4f-fef9c27d380b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:08:01.910908 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:08:01.910908 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:08:01.910908 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:08:01.910908 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:08:01.910908 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:08:01.910908 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:08:01.910908 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:08:01.910908 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:08:01.910908 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:08:01.910908 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:08:01.910908 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:08:01.910908 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:08:01.910908 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:08:01.910908 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:08:01.912368 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:08:01.912368 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:08:01.912368 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:08:01.912368 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:08:01.912368 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:08:01.912368 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:08:01.912368 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:08:01.912368 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:08:01.912368 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:08:01.912368 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:08:01.912368 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:08:01.912368 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:08:01.912368 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:08:01.912368 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:08:01.912368 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:08:01.912368 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:08:01.912368 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:08:01.913735 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:08:01.913735 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:08:01.913735 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:08:01.913735 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:08:01.913735 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 592/1215] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:08:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:08:01.918297 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92b3ba7-11db-4f99-b519-6b82c8db66c4 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:08:01.986459 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:08:02.027631 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92b3ba7-11db-4f99-b519-6b82c8db66c4 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:08:02.065914 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2213b98-f4b3-4b29-ab6b-e3cbc6c4ea4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:08:02.066712 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2213b98-f4b3-4b29-ab6b-e3cbc6c4ea4d None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:02.067083 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2213b98-f4b3-4b29-ab6b-e3cbc6c4ea4d None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:02.067468 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2213b98-f4b3-4b29-ab6b-e3cbc6c4ea4d None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:02.068316 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2213b98-f4b3-4b29-ab6b-e3cbc6c4ea4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:08:02.068712 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2213b98-f4b3-4b29-ab6b-e3cbc6c4ea4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:08:02.070190 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2213b98-f4b3-4b29-ab6b-e3cbc6c4ea4d None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:08:02.084049 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 624/1216] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jul 4 09:08:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:08:02.089821 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a3837b-1c01-43bb-8c4f-fef9c27d380b None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:08:02.170599 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:08:02.208099 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a3837b-1c01-43bb-8c4f-fef9c27d380b None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:08:02.246354 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672896f1-b7e8-4daa-8e2c-bc1a43c5476a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:08:02.247327 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672896f1-b7e8-4daa-8e2c-bc1a43c5476a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:02.247709 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672896f1-b7e8-4daa-8e2c-bc1a43c5476a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:02.249383 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672896f1-b7e8-4daa-8e2c-bc1a43c5476a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:02.257115 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672896f1-b7e8-4daa-8e2c-bc1a43c5476a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:08:02.258890 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672896f1-b7e8-4daa-8e2c-bc1a43c5476a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:08:02.275094 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-672896f1-b7e8-4daa-8e2c-bc1a43c5476a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:08:02.275094 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:08:02.275094 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:08:02.275094 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:08:02.275094 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:08:02.275094 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:08:02.275094 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:08:02.275094 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:08:02.275094 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:08:02.275094 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:08:02.275094 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:08:02.275094 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:08:02.275094 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:08:02.275094 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:08:02.275094 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:08:02.276333 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:08:02.276333 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:08:02.276333 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:08:02.276333 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:08:02.276333 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:08:02.276333 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:08:02.276333 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:08:02.276333 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:08:02.276333 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:08:02.276333 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:08:02.276333 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:08:02.276333 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:08:02.276333 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:08:02.276333 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:08:02.276333 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:08:02.276333 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:08:02.276333 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:08:02.277450 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:08:02.277450 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:08:02.277450 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:08:02.277450 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:08:02.277450 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:08:02.277450 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:08:02.277450 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:08:02.277450 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:08:02.283525 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 593/1217] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jul 4 09:08:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:08:02.284854 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2213b98-f4b3-4b29-ab6b-e3cbc6c4ea4d None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:08:02.395485 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2213b98-f4b3-4b29-ab6b-e3cbc6c4ea4d None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:08:02.419772 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:08:02.432744 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3555a05-6070-4d4b-8e43-a0a2277e9db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:08:02.433437 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3555a05-6070-4d4b-8e43-a0a2277e9db8 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:02.433810 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3555a05-6070-4d4b-8e43-a0a2277e9db8 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:02.434091 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3555a05-6070-4d4b-8e43-a0a2277e9db8 None admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:02.435038 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3555a05-6070-4d4b-8e43-a0a2277e9db8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:08:02.435364 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3555a05-6070-4d4b-8e43-a0a2277e9db8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:08:02.436820 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3555a05-6070-4d4b-8e43-a0a2277e9db8 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:08:02.455025 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 625/1218] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Jul 4 09:08:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:08:02.456894 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672896f1-b7e8-4daa-8e2c-bc1a43c5476a None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:08:02.571542 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672896f1-b7e8-4daa-8e2c-bc1a43c5476a None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:08:02.603000 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:08:02.611331 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a72ecac-0e6e-44a8-9e6a-7c600834dc5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:08:02.612527 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a72ecac-0e6e-44a8-9e6a-7c600834dc5c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:02.612987 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a72ecac-0e6e-44a8-9e6a-7c600834dc5c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:02.613304 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a72ecac-0e6e-44a8-9e6a-7c600834dc5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:02.614575 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a72ecac-0e6e-44a8-9e6a-7c600834dc5c None admin] RBAC: Adding query filter params (role.id=6cc6801f39634594b9183000ff34fbf2, scope.project.id=d015d4f3d9d4464983ff561e8e08523c, user.id=46ec1a2091f1434cabc69066eb3b6725) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:08:02.615010 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a72ecac-0e6e-44a8-9e6a-7c600834dc5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:08:02.617098 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a72ecac-0e6e-44a8-9e6a-7c600834dc5c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:08:02.633919 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 594/1219] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Jul 4 09:08:02 2022] GET /identity/v3/role_assignments?user.id=46ec1a2091f1434cabc69066eb3b6725&scope.project.id=d015d4f3d9d4464983ff561e8e08523c&role.id=6cc6801f39634594b9183000ff34fbf2 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:08:04.666425 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5108f-54b2-4efd-9d21-747df66d00e5 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:04.667086 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5108f-54b2-4efd-9d21-747df66d00e5 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:04.667086 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5108f-54b2-4efd-9d21-747df66d00e5 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:04.668373 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 626/1220] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:08:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:08:04.673799 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2751e4a9-4d57-45d3-beb5-a519abd80754 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:04.674275 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2751e4a9-4d57-45d3-beb5-a519abd80754 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:04.674375 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2751e4a9-4d57-45d3-beb5-a519abd80754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:04.693220 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-2751e4a9-4d57-45d3-beb5-a519abd80754 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:08:04.694695 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-2751e4a9-4d57-45d3-beb5-a519abd80754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:08:04.772809 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 595/1221] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:08:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:08:04.797555 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e5108f-54b2-4efd-9d21-747df66d00e5 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:08:04.904381 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e5108f-54b2-4efd-9d21-747df66d00e5 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:08:04.938811 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae3935c-eb4f-4d35-bee6-0fe1547b3ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:08:04.939531 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3935c-eb4f-4d35-bee6-0fe1547b3ea8 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:04.939810 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3935c-eb4f-4d35-bee6-0fe1547b3ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:04.940110 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3935c-eb4f-4d35-bee6-0fe1547b3ea8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:04.950681 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae3935c-eb4f-4d35-bee6-0fe1547b3ea8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:08:04.958615 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-5ae3935c-eb4f-4d35-bee6-0fe1547b3ea8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:08:04.958615 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:08:04.958615 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:08:04.958615 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:08:04.958615 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:08:04.958615 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:08:04.958615 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:08:04.958615 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:08:04.958615 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:08:04.958615 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:08:04.958615 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:08:04.958615 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:08:04.958615 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:08:04.958615 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:08:04.958615 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:08:04.958615 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:08:04.959848 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:08:04.959848 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:08:04.959848 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:08:04.959848 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:08:04.959848 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:08:04.959848 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:08:04.959848 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:08:04.959848 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:08:04.959848 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:08:04.959848 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:08:04.959848 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:08:04.959848 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:08:04.959848 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:08:04.959848 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:08:04.959848 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:08:04.959848 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:08:04.961204 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:08:04.961204 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:08:04.961204 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:08:04.961204 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:08:04.961204 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:08:04.961204 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:08:04.961204 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:08:04.961204 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:08:04.961204 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:08:04.961204 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:08:04.961204 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:08:04.961204 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:08:04.961204 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 627/1222] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Jul 4 09:08:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:08:04.966445 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2751e4a9-4d57-45d3-beb5-a519abd80754 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:08:05.069509 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2751e4a9-4d57-45d3-beb5-a519abd80754 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:08:05.093880 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:08:05.106517 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddab93d2-c3d0-4c12-830e-9a80f71f4804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:08:05.107186 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab93d2-c3d0-4c12-830e-9a80f71f4804 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:05.107466 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab93d2-c3d0-4c12-830e-9a80f71f4804 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:05.108080 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab93d2-c3d0-4c12-830e-9a80f71f4804 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:05.108830 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddab93d2-c3d0-4c12-830e-9a80f71f4804 None admin] RBAC: Adding query filter params (name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:08:05.109256 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddab93d2-c3d0-4c12-830e-9a80f71f4804 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:08:05.110696 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddab93d2-c3d0-4c12-830e-9a80f71f4804 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:08:05.119648 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 596/1223] 10.222.0.42 () {56 vars in 1103 bytes} [Mon Jul 4 09:08:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:08:05.125689 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae3935c-eb4f-4d35-bee6-0fe1547b3ea8 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:08:05.170993 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:08:05.233027 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae3935c-eb4f-4d35-bee6-0fe1547b3ea8 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:08:05.268877 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5be797-10e3-447d-96fa-bcc457311eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:08:05.269681 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5be797-10e3-447d-96fa-bcc457311eb5 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:05.269963 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5be797-10e3-447d-96fa-bcc457311eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:05.270235 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5be797-10e3-447d-96fa-bcc457311eb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:05.282978 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5be797-10e3-447d-96fa-bcc457311eb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:08:05.284503 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5be797-10e3-447d-96fa-bcc457311eb5 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:08:05.303724 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-ad5be797-10e3-447d-96fa-bcc457311eb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:08:05.303724 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:08:05.303724 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:08:05.303724 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:08:05.303724 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:08:05.303724 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:08:05.303724 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:08:05.303724 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:08:05.303724 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:08:05.303724 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:08:05.303724 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:08:05.303724 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:08:05.303724 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:08:05.303724 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:08:05.303724 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:08:05.304977 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:08:05.304977 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:08:05.304977 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:08:05.304977 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:08:05.304977 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:08:05.304977 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:08:05.304977 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:08:05.304977 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:08:05.304977 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:08:05.304977 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:08:05.304977 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:08:05.304977 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:08:05.304977 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:08:05.304977 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:08:05.304977 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:08:05.304977 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:08:05.304977 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:08:05.306408 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:08:05.306408 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:08:05.306408 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:08:05.306408 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:08:05.306408 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 628/1224] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:08:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:08:05.313168 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddab93d2-c3d0-4c12-830e-9a80f71f4804 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:08:05.417861 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddab93d2-c3d0-4c12-830e-9a80f71f4804 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:08:05.452029 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faf6623-da5d-4f3c-b525-5255503bf41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:08:05.452705 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faf6623-da5d-4f3c-b525-5255503bf41f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:05.452990 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faf6623-da5d-4f3c-b525-5255503bf41f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:05.453272 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faf6623-da5d-4f3c-b525-5255503bf41f None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:05.454005 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faf6623-da5d-4f3c-b525-5255503bf41f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:08:05.454314 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faf6623-da5d-4f3c-b525-5255503bf41f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:08:05.455713 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faf6623-da5d-4f3c-b525-5255503bf41f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:08:05.469379 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 597/1225] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jul 4 09:08:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:08:05.475519 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5be797-10e3-447d-96fa-bcc457311eb5 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:08:05.579203 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:08:05.586729 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5be797-10e3-447d-96fa-bcc457311eb5 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:08:05.621070 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de7a45e-9ef1-4487-bcb4-506ec17e6268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:08:05.621874 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7a45e-9ef1-4487-bcb4-506ec17e6268 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:05.622164 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7a45e-9ef1-4487-bcb4-506ec17e6268 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:05.622439 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7a45e-9ef1-4487-bcb4-506ec17e6268 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:05.630362 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de7a45e-9ef1-4487-bcb4-506ec17e6268 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:08:05.631906 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de7a45e-9ef1-4487-bcb4-506ec17e6268 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:08:05.646289 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-8de7a45e-9ef1-4487-bcb4-506ec17e6268 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 04 09:08:05.646289 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:08:05.646289 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:08:05.646289 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:08:05.646289 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:08:05.646289 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:08:05.646289 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:08:05.646289 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:08:05.646289 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:08:05.646289 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:08:05.646289 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:08:05.646289 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:08:05.646289 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:08:05.646289 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:08:05.646289 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:08:05.646289 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:08:05.647358 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:08:05.647358 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:08:05.647358 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:08:05.647358 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:08:05.647358 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:08:05.647358 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:08:05.647358 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:08:05.647358 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:08:05.647358 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:08:05.647358 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:08:05.647358 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:08:05.647358 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:08:05.647358 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:08:05.647358 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:08:05.647358 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:08:05.647358 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:08:05.647358 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:08:05.647358 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:08:05.648361 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:08:05.648361 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:08:05.648361 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:08:05.648361 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:08:05.648361 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:08:05.648361 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:08:05.648361 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:08:05.648361 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:08:05.648361 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 04 09:08:05.648361 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:08:05.648361 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 629/1226] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:08:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:08:05.654517 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faf6623-da5d-4f3c-b525-5255503bf41f None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:08:05.705340 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:08:05.765395 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faf6623-da5d-4f3c-b525-5255503bf41f None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:08:05.802988 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba51461-f999-4604-a7bc-eb6720094770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:08:05.803634 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba51461-f999-4604-a7bc-eb6720094770 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:05.803940 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba51461-f999-4604-a7bc-eb6720094770 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:05.804224 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba51461-f999-4604-a7bc-eb6720094770 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:05.805063 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba51461-f999-4604-a7bc-eb6720094770 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:08:05.805359 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba51461-f999-4604-a7bc-eb6720094770 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:08:05.807004 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba51461-f999-4604-a7bc-eb6720094770 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:08:05.827534 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 598/1227] 10.222.0.42 () {56 vars in 1143 bytes} [Mon Jul 4 09:08:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:08:05.834551 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de7a45e-9ef1-4487-bcb4-506ec17e6268 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:08:05.941076 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de7a45e-9ef1-4487-bcb4-506ec17e6268 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:08:05.984065 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9d6dbe-4709-402a-a9ea-de2bfb7c2e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:08:05.984863 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9d6dbe-4709-402a-a9ea-de2bfb7c2e91 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:05.985150 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9d6dbe-4709-402a-a9ea-de2bfb7c2e91 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:05.985427 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9d6dbe-4709-402a-a9ea-de2bfb7c2e91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:05.998483 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9d6dbe-4709-402a-a9ea-de2bfb7c2e91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:08:06.000193 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9d6dbe-4709-402a-a9ea-de2bfb7c2e91 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:08:06.019000 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-2b9d6dbe-4709-402a-a9ea-de2bfb7c2e91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:08:06.019000 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:08:06.019000 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:08:06.019000 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:08:06.019000 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:08:06.019000 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:08:06.019000 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:08:06.019000 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:08:06.019000 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:08:06.019000 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:08:06.019000 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:08:06.019000 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:08:06.019000 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:08:06.019000 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:08:06.019000 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:08:06.019963 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:08:06.019963 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:08:06.019963 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:08:06.019963 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:08:06.019963 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:08:06.019963 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:08:06.019963 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:08:06.019963 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:08:06.019963 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:08:06.019963 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:08:06.019963 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:08:06.019963 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:08:06.019963 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:08:06.019963 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:08:06.019963 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:08:06.019963 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:08:06.019963 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:08:06.020866 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:08:06.020866 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:08:06.020866 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:08:06.020866 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:08:06.020866 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 630/1228] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:08:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:08:06.026448 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba51461-f999-4604-a7bc-eb6720094770 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:08:06.133786 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba51461-f999-4604-a7bc-eb6720094770 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:08:06.136427 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:08:06.172582 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae8cecf-63ee-43e4-a603-b9720c60dc0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:08:06.173242 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae8cecf-63ee-43e4-a603-b9720c60dc0f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:06.173522 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae8cecf-63ee-43e4-a603-b9720c60dc0f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:06.173796 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae8cecf-63ee-43e4-a603-b9720c60dc0f None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:06.174524 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae8cecf-63ee-43e4-a603-b9720c60dc0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:08:06.174822 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae8cecf-63ee-43e4-a603-b9720c60dc0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:08:06.176247 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae8cecf-63ee-43e4-a603-b9720c60dc0f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:08:06.188665 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 599/1229] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jul 4 09:08:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:08:06.194934 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9d6dbe-4709-402a-a9ea-de2bfb7c2e91 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:08:06.205588 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:08:06.312140 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9d6dbe-4709-402a-a9ea-de2bfb7c2e91 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:08:06.345923 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9600717-5679-45dc-9a4f-04bce64f7cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:08:06.346718 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9600717-5679-45dc-9a4f-04bce64f7cfa None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:06.347000 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9600717-5679-45dc-9a4f-04bce64f7cfa None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:06.347272 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9600717-5679-45dc-9a4f-04bce64f7cfa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:06.354332 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9600717-5679-45dc-9a4f-04bce64f7cfa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:08:06.355784 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9600717-5679-45dc-9a4f-04bce64f7cfa None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:08:06.370339 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-a9600717-5679-45dc-9a4f-04bce64f7cfa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:08:06.370339 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:08:06.370339 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:08:06.370339 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:08:06.370339 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:08:06.370339 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:08:06.370339 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:08:06.370339 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:08:06.370339 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:08:06.370339 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:08:06.370339 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:08:06.370339 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:08:06.370339 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:08:06.370339 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:08:06.370339 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:08:06.371462 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:08:06.371462 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:08:06.371462 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:08:06.371462 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:08:06.371462 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:08:06.371462 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:08:06.371462 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:08:06.371462 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:08:06.371462 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:08:06.371462 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:08:06.371462 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:08:06.371462 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:08:06.371462 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:08:06.371462 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:08:06.371462 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:08:06.371462 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:08:06.371462 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:08:06.372718 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:08:06.372718 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:08:06.372718 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:08:06.372718 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:08:06.372718 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:08:06.372718 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:08:06.372718 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:08:06.372718 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:08:06.372718 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 631/1230] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jul 4 09:08:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:08:06.379931 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae8cecf-63ee-43e4-a603-b9720c60dc0f None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:08:06.490250 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae8cecf-63ee-43e4-a603-b9720c60dc0f None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:08:06.526360 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce1ec6d-8bcd-4b04-a9be-6278402e1036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:08:06.527018 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce1ec6d-8bcd-4b04-a9be-6278402e1036 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:06.527295 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce1ec6d-8bcd-4b04-a9be-6278402e1036 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:06.527568 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce1ec6d-8bcd-4b04-a9be-6278402e1036 None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:06.528389 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce1ec6d-8bcd-4b04-a9be-6278402e1036 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:08:06.528692 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce1ec6d-8bcd-4b04-a9be-6278402e1036 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:08:06.530139 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce1ec6d-8bcd-4b04-a9be-6278402e1036 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:08:06.544608 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 600/1231] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Jul 4 09:08:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:08:06.550896 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9600717-5679-45dc-9a4f-04bce64f7cfa None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:08:06.626248 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:08:06.669252 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9600717-5679-45dc-9a4f-04bce64f7cfa None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:08:06.702794 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bcfde4-6b2f-44b8-9e3d-bbb3ea85ac9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:08:06.703646 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bcfde4-6b2f-44b8-9e3d-bbb3ea85ac9d None admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:06.703958 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bcfde4-6b2f-44b8-9e3d-bbb3ea85ac9d None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:06.704240 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bcfde4-6b2f-44b8-9e3d-bbb3ea85ac9d None admin] PATH_INFO: `/v3/projects/d015d4f3d9d4464983ff561e8e08523c/users/46ec1a2091f1434cabc69066eb3b6725/roles/6cc6801f39634594b9183000ff34fbf2` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:06.718648 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bcfde4-6b2f-44b8-9e3d-bbb3ea85ac9d None admin] RBAC: Authorizing `identity:create_grant(project_id=d015d4f3d9d4464983ff561e8e08523c, user_id=46ec1a2091f1434cabc69066eb3b6725, role_id=6cc6801f39634594b9183000ff34fbf2)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:08:06.720127 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bcfde4-6b2f-44b8-9e3d-bbb3ea85ac9d None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:08:06.733239 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 632/1232] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Jul 4 09:08:06 2022] PUT /identity/v3/projects/d015d4f3d9d4464983ff561e8e08523c/users/46ec1a2091f1434cabc69066eb3b6725/roles/6cc6801f39634594b9183000ff34fbf2 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:08:08.793901 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab32e6a9-f3b7-482c-be32-42a0f47c549a None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:08.794471 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab32e6a9-f3b7-482c-be32-42a0f47c549a None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:08.794471 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab32e6a9-f3b7-482c-be32-42a0f47c549a None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:08.795837 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 601/1233] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:08:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:08:08.801113 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a379b2a-ac29-4ee8-a51b-a4e74acffe1a None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:08.801555 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a379b2a-ac29-4ee8-a51b-a4e74acffe1a None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:08.801678 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a379b2a-ac29-4ee8-a51b-a4e74acffe1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:08.818775 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-2a379b2a-ac29-4ee8-a51b-a4e74acffe1a None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:08:08.820113 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-2a379b2a-ac29-4ee8-a51b-a4e74acffe1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:08:08.891791 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 633/1234] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:08:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:08:08.917092 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab32e6a9-f3b7-482c-be32-42a0f47c549a None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:08:08.944414 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:08:09.033140 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab32e6a9-f3b7-482c-be32-42a0f47c549a None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:08:09.068394 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941e8417-8dc8-4f84-84bc-c696893631c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:08:09.069152 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e8417-8dc8-4f84-84bc-c696893631c6 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:09.069408 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e8417-8dc8-4f84-84bc-c696893631c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:09.069676 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e8417-8dc8-4f84-84bc-c696893631c6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:09.080584 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941e8417-8dc8-4f84-84bc-c696893631c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:08:09.088417 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-941e8417-8dc8-4f84-84bc-c696893631c6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:08:09.088417 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:08:09.088417 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:08:09.088417 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:08:09.088417 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:08:09.088417 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:08:09.088417 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:08:09.088417 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:08:09.088417 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:08:09.088417 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:08:09.088417 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:08:09.088417 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:08:09.088417 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:08:09.088417 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:08:09.088417 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:08:09.088417 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:08:09.089662 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:08:09.089662 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:08:09.089662 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:08:09.089662 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:08:09.089662 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:08:09.089662 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:08:09.089662 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:08:09.089662 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:08:09.089662 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:08:09.089662 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:08:09.089662 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:08:09.089662 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:08:09.089662 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:08:09.089662 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:08:09.089662 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:08:09.089662 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:08:09.090525 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:08:09.090525 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:08:09.090525 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:08:09.090525 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:08:09.090525 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:08:09.090525 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:08:09.090525 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:08:09.090525 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:08:09.090525 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:08:09.090525 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:08:09.090525 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:08:09.090525 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:08:09.090525 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 602/1235] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Jul 4 09:08:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:08:09.096144 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a379b2a-ac29-4ee8-a51b-a4e74acffe1a None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:08:09.148765 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:08:09.216060 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a379b2a-ac29-4ee8-a51b-a4e74acffe1a None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:08:09.253272 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed984e41-10ef-418e-9d7d-8831d1877e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:08:09.253946 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed984e41-10ef-418e-9d7d-8831d1877e1c None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:09.254228 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed984e41-10ef-418e-9d7d-8831d1877e1c None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:09.254505 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed984e41-10ef-418e-9d7d-8831d1877e1c None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:09.255256 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed984e41-10ef-418e-9d7d-8831d1877e1c None admin] RBAC: Adding query filter params (name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:08:09.255569 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed984e41-10ef-418e-9d7d-8831d1877e1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:08:09.257008 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed984e41-10ef-418e-9d7d-8831d1877e1c None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:08:09.267018 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 634/1236] 10.222.0.42 () {56 vars in 1103 bytes} [Mon Jul 4 09:08:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:08:09.274202 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941e8417-8dc8-4f84-84bc-c696893631c6 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:08:09.373382 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:08:09.390167 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941e8417-8dc8-4f84-84bc-c696893631c6 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:08:09.428638 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45de4317-0a20-4feb-a545-a0877b7df466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:08:09.429459 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de4317-0a20-4feb-a545-a0877b7df466 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:09.429710 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de4317-0a20-4feb-a545-a0877b7df466 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:09.429984 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de4317-0a20-4feb-a545-a0877b7df466 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:09.442411 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45de4317-0a20-4feb-a545-a0877b7df466 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:08:09.444323 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45de4317-0a20-4feb-a545-a0877b7df466 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:08:09.464634 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-45de4317-0a20-4feb-a545-a0877b7df466 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:08:09.464634 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:08:09.464634 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:08:09.464634 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:08:09.464634 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:08:09.464634 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:08:09.464634 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:08:09.464634 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:08:09.464634 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:08:09.464634 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:08:09.464634 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:08:09.464634 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:08:09.464634 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:08:09.464634 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:08:09.464634 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:08:09.466017 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:08:09.466017 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:08:09.466017 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:08:09.466017 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:08:09.466017 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:08:09.466017 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:08:09.466017 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:08:09.466017 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:08:09.466017 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:08:09.466017 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:08:09.466017 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:08:09.466017 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:08:09.466017 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:08:09.466017 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:08:09.466017 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:08:09.466017 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:08:09.466017 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:08:09.466899 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:08:09.466899 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:08:09.466899 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:08:09.466899 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:08:09.466899 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 603/1237] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:08:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:08:09.472076 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed984e41-10ef-418e-9d7d-8831d1877e1c None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:08:09.578562 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed984e41-10ef-418e-9d7d-8831d1877e1c None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:08:09.588427 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:08:09.617324 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99db72d8-8891-4753-b832-264de2248d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:08:09.618002 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db72d8-8891-4753-b832-264de2248d0a None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:09.618286 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db72d8-8891-4753-b832-264de2248d0a None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:09.618563 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db72d8-8891-4753-b832-264de2248d0a None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:09.619337 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99db72d8-8891-4753-b832-264de2248d0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:08:09.619623 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99db72d8-8891-4753-b832-264de2248d0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:08:09.621047 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99db72d8-8891-4753-b832-264de2248d0a None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:08:09.639558 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 635/1238] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jul 4 09:08:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:08:09.641236 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45de4317-0a20-4feb-a545-a0877b7df466 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:08:09.764040 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45de4317-0a20-4feb-a545-a0877b7df466 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:08:09.800790 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95739df-a8b4-47c1-95aa-253256e957eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:08:09.801592 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95739df-a8b4-47c1-95aa-253256e957eb None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:09.801872 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95739df-a8b4-47c1-95aa-253256e957eb None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:09.802143 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95739df-a8b4-47c1-95aa-253256e957eb None admin] PATH_INFO: `/v3/users/placement` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:09.805714 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:08:09.811217 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95739df-a8b4-47c1-95aa-253256e957eb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:08:09.812866 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95739df-a8b4-47c1-95aa-253256e957eb None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:08:09.827403 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-c95739df-a8b4-47c1-95aa-253256e957eb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 04 09:08:09.827403 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:08:09.827403 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:08:09.827403 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:08:09.827403 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:08:09.827403 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:08:09.827403 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:08:09.827403 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:08:09.827403 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:08:09.827403 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:08:09.827403 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:08:09.827403 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:08:09.827403 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:08:09.827403 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:08:09.827403 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:08:09.827403 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:08:09.828713 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:08:09.828713 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:08:09.828713 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:08:09.828713 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:08:09.828713 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:08:09.828713 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:08:09.828713 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:08:09.828713 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:08:09.828713 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:08:09.828713 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:08:09.828713 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:08:09.828713 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:08:09.828713 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:08:09.828713 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:08:09.828713 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:08:09.828713 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:08:09.828713 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:08:09.828713 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:08:09.829684 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:08:09.829684 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:08:09.829684 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:08:09.829684 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:08:09.829684 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:08:09.829684 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:08:09.829684 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:08:09.829684 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:08:09.829684 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 04 09:08:09.829684 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:08:09.829684 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 604/1239] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:08:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:08:09.835096 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99db72d8-8891-4753-b832-264de2248d0a None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:08:09.960210 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99db72d8-8891-4753-b832-264de2248d0a None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:08:10.000701 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adc522d-b70a-4437-b6c1-c8c2fa58e6e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:08:10.001468 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc522d-b70a-4437-b6c1-c8c2fa58e6e4 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:10.001755 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc522d-b70a-4437-b6c1-c8c2fa58e6e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:10.002034 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc522d-b70a-4437-b6c1-c8c2fa58e6e4 None admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:10.002874 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adc522d-b70a-4437-b6c1-c8c2fa58e6e4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:08:10.003225 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adc522d-b70a-4437-b6c1-c8c2fa58e6e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:08:10.004692 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adc522d-b70a-4437-b6c1-c8c2fa58e6e4 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:08:10.023783 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 636/1240] 10.222.0.42 () {56 vars in 1143 bytes} [Mon Jul 4 09:08:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:08:10.029664 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95739df-a8b4-47c1-95aa-253256e957eb None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:08:10.145679 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95739df-a8b4-47c1-95aa-253256e957eb None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:08:10.185561 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5515440a-eaca-4daf-a07d-118f323091c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:08:10.186209 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5515440a-eaca-4daf-a07d-118f323091c6 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:10.186491 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5515440a-eaca-4daf-a07d-118f323091c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:10.186763 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5515440a-eaca-4daf-a07d-118f323091c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:10.251138 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:08:10.259229 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5515440a-eaca-4daf-a07d-118f323091c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:08:10.260772 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5515440a-eaca-4daf-a07d-118f323091c6 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:08:10.371709 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 605/1241] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jul 4 09:08:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 04 09:08:10.374748 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adc522d-b70a-4437-b6c1-c8c2fa58e6e4 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:08:10.407968 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:08:10.491768 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adc522d-b70a-4437-b6c1-c8c2fa58e6e4 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:08:10.529428 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf497c9c-7400-403a-9cdd-30af77a1e3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:08:10.530216 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf497c9c-7400-403a-9cdd-30af77a1e3bc None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:10.530501 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf497c9c-7400-403a-9cdd-30af77a1e3bc None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:10.530805 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf497c9c-7400-403a-9cdd-30af77a1e3bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:10.541826 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf497c9c-7400-403a-9cdd-30af77a1e3bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:08:10.543320 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf497c9c-7400-403a-9cdd-30af77a1e3bc None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:08:10.560859 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-cf497c9c-7400-403a-9cdd-30af77a1e3bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:08:10.560859 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:08:10.560859 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:08:10.560859 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:08:10.560859 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:08:10.560859 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:08:10.560859 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:08:10.560859 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:08:10.560859 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:08:10.560859 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:08:10.560859 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:08:10.560859 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:08:10.560859 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:08:10.560859 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:08:10.560859 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:08:10.562027 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:08:10.562027 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:08:10.562027 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:08:10.562027 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:08:10.562027 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:08:10.562027 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:08:10.562027 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:08:10.562027 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:08:10.562027 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:08:10.562027 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:08:10.562027 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:08:10.562027 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:08:10.562027 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:08:10.562027 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:08:10.562027 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:08:10.562027 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:08:10.562027 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:08:10.567744 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:08:10.567744 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:08:10.567744 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:08:10.567744 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:08:10.567744 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 637/1242] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:08:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:08:10.568084 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5515440a-eaca-4daf-a07d-118f323091c6 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:08:10.675212 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:08:10.682580 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5515440a-eaca-4daf-a07d-118f323091c6 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:08:10.731792 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e174788-902a-4478-8350-d882e049dcc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:08:10.732849 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e174788-902a-4478-8350-d882e049dcc8 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:10.733131 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e174788-902a-4478-8350-d882e049dcc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:10.733406 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e174788-902a-4478-8350-d882e049dcc8 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:10.734134 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e174788-902a-4478-8350-d882e049dcc8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:08:10.734441 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e174788-902a-4478-8350-d882e049dcc8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:08:10.735854 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e174788-902a-4478-8350-d882e049dcc8 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:08:10.748316 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 606/1243] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jul 4 09:08:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:08:10.754754 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf497c9c-7400-403a-9cdd-30af77a1e3bc None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:08:10.842580 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:08:10.866473 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf497c9c-7400-403a-9cdd-30af77a1e3bc None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:08:10.903159 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15b789d-4f78-40ef-b3ac-8d134bf903f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:08:10.904022 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b789d-4f78-40ef-b3ac-8d134bf903f1 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:10.904280 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b789d-4f78-40ef-b3ac-8d134bf903f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:10.904637 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b789d-4f78-40ef-b3ac-8d134bf903f1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:10.911604 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15b789d-4f78-40ef-b3ac-8d134bf903f1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:08:10.913105 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15b789d-4f78-40ef-b3ac-8d134bf903f1 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:08:10.927252 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-c15b789d-4f78-40ef-b3ac-8d134bf903f1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:08:10.927252 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:08:10.927252 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:08:10.927252 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:08:10.927252 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:08:10.927252 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:08:10.927252 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:08:10.927252 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:08:10.927252 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:08:10.927252 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:08:10.927252 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:08:10.927252 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:08:10.927252 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:08:10.927252 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:08:10.927252 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:08:10.928523 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:08:10.928523 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:08:10.928523 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:08:10.928523 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:08:10.928523 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:08:10.928523 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:08:10.928523 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:08:10.928523 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:08:10.928523 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:08:10.928523 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:08:10.928523 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:08:10.928523 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:08:10.928523 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:08:10.928523 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:08:10.928523 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:08:10.928523 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:08:10.928523 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:08:10.929665 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:08:10.929665 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:08:10.929665 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:08:10.929665 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:08:10.929665 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:08:10.929665 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:08:10.929665 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:08:10.929665 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:08:10.929665 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 638/1244] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jul 4 09:08:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:08:10.936274 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e174788-902a-4478-8350-d882e049dcc8 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:08:11.041394 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e174788-902a-4478-8350-d882e049dcc8 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:08:11.090226 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8db8f2-8802-4874-a0ae-4a128ff1c585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:08:11.091129 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8db8f2-8802-4874-a0ae-4a128ff1c585 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:11.091567 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8db8f2-8802-4874-a0ae-4a128ff1c585 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:11.091895 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8db8f2-8802-4874-a0ae-4a128ff1c585 None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:11.092970 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8db8f2-8802-4874-a0ae-4a128ff1c585 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:08:11.093434 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8db8f2-8802-4874-a0ae-4a128ff1c585 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:08:11.095145 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8db8f2-8802-4874-a0ae-4a128ff1c585 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:08:11.111614 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 607/1245] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Jul 4 09:08:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:08:11.119527 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15b789d-4f78-40ef-b3ac-8d134bf903f1 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:08:11.233082 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15b789d-4f78-40ef-b3ac-8d134bf903f1 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:08:11.271639 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc70a7e4-d50f-473b-9815-04b5be595760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:08:11.272454 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70a7e4-d50f-473b-9815-04b5be595760 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:11.272791 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70a7e4-d50f-473b-9815-04b5be595760 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:11.273220 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70a7e4-d50f-473b-9815-04b5be595760 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:11.274105 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc70a7e4-d50f-473b-9815-04b5be595760 None admin] RBAC: Adding query filter params (role.id=6cc6801f39634594b9183000ff34fbf2, scope.project.id=d015d4f3d9d4464983ff561e8e08523c, user.id=46ec1a2091f1434cabc69066eb3b6725) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:08:11.274477 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc70a7e4-d50f-473b-9815-04b5be595760 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:08:11.275920 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc70a7e4-d50f-473b-9815-04b5be595760 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:08:11.283042 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 639/1246] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Jul 4 09:08:11 2022] GET /identity/v3/role_assignments?user.id=46ec1a2091f1434cabc69066eb3b6725&scope.project.id=d015d4f3d9d4464983ff561e8e08523c&role.id=6cc6801f39634594b9183000ff34fbf2 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:08:13.331664 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433919f-5e7d-4032-8740-8c72292ef399 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:13.332280 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433919f-5e7d-4032-8740-8c72292ef399 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:13.332280 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433919f-5e7d-4032-8740-8c72292ef399 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:13.333837 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 608/1247] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:08:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:08:13.341101 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac8fab-bc71-427c-896c-e4c102ec443f None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:13.341101 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac8fab-bc71-427c-896c-e4c102ec443f None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:13.341101 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac8fab-bc71-427c-896c-e4c102ec443f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:13.345587 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:08:13.361982 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-29ac8fab-bc71-427c-896c-e4c102ec443f None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:08:13.363472 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-29ac8fab-bc71-427c-896c-e4c102ec443f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:08:13.439285 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 640/1248] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:08:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:08:13.467613 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7433919f-5e7d-4032-8740-8c72292ef399 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:08:13.490089 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:08:13.590758 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7433919f-5e7d-4032-8740-8c72292ef399 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:08:13.629151 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475caa2a-2c9a-48e3-b053-6ec3325ce63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:08:13.630045 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475caa2a-2c9a-48e3-b053-6ec3325ce63f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:13.630385 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475caa2a-2c9a-48e3-b053-6ec3325ce63f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:13.630741 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475caa2a-2c9a-48e3-b053-6ec3325ce63f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:13.642937 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475caa2a-2c9a-48e3-b053-6ec3325ce63f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:08:13.650565 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-475caa2a-2c9a-48e3-b053-6ec3325ce63f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:08:13.650565 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:08:13.650565 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:08:13.650565 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:08:13.650565 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:08:13.650565 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:08:13.650565 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:08:13.650565 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:08:13.650565 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:08:13.650565 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:08:13.650565 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:08:13.650565 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:08:13.650565 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:08:13.650565 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:08:13.650565 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:08:13.650565 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:08:13.651964 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:08:13.651964 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:08:13.651964 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:08:13.651964 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:08:13.651964 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:08:13.651964 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:08:13.651964 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:08:13.651964 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:08:13.651964 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:08:13.651964 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:08:13.651964 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:08:13.651964 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:08:13.651964 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:08:13.651964 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:08:13.651964 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:08:13.651964 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:08:13.653069 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:08:13.653069 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:08:13.653069 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:08:13.653069 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:08:13.653069 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:08:13.653069 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:08:13.653069 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:08:13.653069 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:08:13.653069 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:08:13.653069 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:08:13.653069 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:08:13.653069 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:08:13.653069 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 609/1249] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Jul 4 09:08:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:08:13.657960 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac8fab-bc71-427c-896c-e4c102ec443f None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:08:13.769557 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac8fab-bc71-427c-896c-e4c102ec443f None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:08:13.800691 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:08:13.806214 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c63df96-a420-4316-a7ae-389e94efaa75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:08:13.806895 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63df96-a420-4316-a7ae-389e94efaa75 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:13.807352 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63df96-a420-4316-a7ae-389e94efaa75 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:13.807672 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63df96-a420-4316-a7ae-389e94efaa75 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:13.808584 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c63df96-a420-4316-a7ae-389e94efaa75 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:08:13.808889 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c63df96-a420-4316-a7ae-389e94efaa75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:08:13.810268 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c63df96-a420-4316-a7ae-389e94efaa75 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:08:13.818727 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 641/1250] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jul 4 09:08:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:08:13.824809 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475caa2a-2c9a-48e3-b053-6ec3325ce63f None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:08:13.914256 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:08:13.940851 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475caa2a-2c9a-48e3-b053-6ec3325ce63f None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:08:13.979100 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46db32a3-c8d1-4971-94eb-053242e3c0eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:08:13.980024 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db32a3-c8d1-4971-94eb-053242e3c0eb None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:13.980302 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db32a3-c8d1-4971-94eb-053242e3c0eb None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:13.980596 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db32a3-c8d1-4971-94eb-053242e3c0eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:13.992918 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46db32a3-c8d1-4971-94eb-053242e3c0eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:08:13.994611 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46db32a3-c8d1-4971-94eb-053242e3c0eb None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:08:14.012942 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-46db32a3-c8d1-4971-94eb-053242e3c0eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:08:14.012942 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:08:14.012942 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:08:14.012942 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:08:14.012942 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:08:14.012942 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:08:14.012942 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:08:14.012942 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:08:14.012942 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:08:14.012942 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:08:14.012942 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:08:14.012942 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:08:14.012942 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:08:14.012942 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:08:14.012942 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:08:14.014096 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:08:14.014096 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:08:14.014096 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:08:14.014096 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:08:14.014096 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:08:14.014096 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:08:14.014096 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:08:14.014096 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:08:14.014096 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:08:14.014096 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:08:14.014096 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:08:14.014096 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:08:14.014096 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:08:14.014096 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:08:14.014096 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:08:14.014096 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:08:14.014096 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:08:14.015203 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:08:14.015203 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:08:14.015203 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:08:14.015203 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:08:14.015203 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 610/1251] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:08:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:08:14.020572 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c63df96-a420-4316-a7ae-389e94efaa75 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:08:14.140292 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c63df96-a420-4316-a7ae-389e94efaa75 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:08:14.181525 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7f8844-5bb4-406f-928b-db20c73d5651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:08:14.182465 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f8844-5bb4-406f-928b-db20c73d5651 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:14.182816 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f8844-5bb4-406f-928b-db20c73d5651 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:14.183301 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f8844-5bb4-406f-928b-db20c73d5651 None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:14.184370 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7f8844-5bb4-406f-928b-db20c73d5651 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:08:14.184734 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7f8844-5bb4-406f-928b-db20c73d5651 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:08:14.186539 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7f8844-5bb4-406f-928b-db20c73d5651 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:08:14.200974 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 642/1252] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jul 4 09:08:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:08:14.206919 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46db32a3-c8d1-4971-94eb-053242e3c0eb None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:08:14.323289 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46db32a3-c8d1-4971-94eb-053242e3c0eb None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:08:14.353814 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:08:14.363725 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcd0322-93be-4274-ba05-45b62ec3b390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:08:14.364791 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd0322-93be-4274-ba05-45b62ec3b390 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:14.365130 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd0322-93be-4274-ba05-45b62ec3b390 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:14.365485 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd0322-93be-4274-ba05-45b62ec3b390 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:14.374494 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcd0322-93be-4274-ba05-45b62ec3b390 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:08:14.375988 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcd0322-93be-4274-ba05-45b62ec3b390 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:08:14.391193 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-bdcd0322-93be-4274-ba05-45b62ec3b390 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 04 09:08:14.391193 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:08:14.391193 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:08:14.391193 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:08:14.391193 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:08:14.391193 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:08:14.391193 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:08:14.391193 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:08:14.391193 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:08:14.391193 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:08:14.391193 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:08:14.391193 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:08:14.391193 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:08:14.391193 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:08:14.391193 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:08:14.391193 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:08:14.392441 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:08:14.392441 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:08:14.392441 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:08:14.392441 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:08:14.392441 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:08:14.392441 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:08:14.392441 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:08:14.392441 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:08:14.392441 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:08:14.392441 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:08:14.392441 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:08:14.392441 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:08:14.392441 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:08:14.392441 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:08:14.392441 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:08:14.392441 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:08:14.392441 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:08:14.392441 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:08:14.393531 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:08:14.393531 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:08:14.393531 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:08:14.393531 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:08:14.393531 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:08:14.393531 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:08:14.393531 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:08:14.393531 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:08:14.393531 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 04 09:08:14.393531 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:08:14.393531 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 611/1253] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:08:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:08:14.398689 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7f8844-5bb4-406f-928b-db20c73d5651 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:08:14.458896 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:08:14.511894 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7f8844-5bb4-406f-928b-db20c73d5651 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:08:14.547411 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489db0d9-1b7c-4a9c-abfe-24b529b17034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:08:14.548143 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489db0d9-1b7c-4a9c-abfe-24b529b17034 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:14.548425 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489db0d9-1b7c-4a9c-abfe-24b529b17034 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:14.548701 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489db0d9-1b7c-4a9c-abfe-24b529b17034 None admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:14.549624 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489db0d9-1b7c-4a9c-abfe-24b529b17034 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:08:14.549944 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489db0d9-1b7c-4a9c-abfe-24b529b17034 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:08:14.551623 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489db0d9-1b7c-4a9c-abfe-24b529b17034 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:08:14.575226 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 643/1254] 10.222.0.42 () {56 vars in 1143 bytes} [Mon Jul 4 09:08:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:08:14.581449 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcd0322-93be-4274-ba05-45b62ec3b390 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:08:14.699974 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcd0322-93be-4274-ba05-45b62ec3b390 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:08:14.734788 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e916e85b-09c9-4528-b773-f968235478ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:08:14.735363 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e916e85b-09c9-4528-b773-f968235478ab None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:14.735649 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e916e85b-09c9-4528-b773-f968235478ab None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:14.735952 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e916e85b-09c9-4528-b773-f968235478ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:14.804393 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:08:14.819746 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e916e85b-09c9-4528-b773-f968235478ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:08:14.821413 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e916e85b-09c9-4528-b773-f968235478ab None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:08:14.934506 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 612/1255] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jul 4 09:08:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 04 09:08:14.940459 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489db0d9-1b7c-4a9c-abfe-24b529b17034 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:08:15.051022 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489db0d9-1b7c-4a9c-abfe-24b529b17034 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:08:15.064934 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:08:15.090482 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5139ebb6-4909-4505-8b10-5143adfaba98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:08:15.091496 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5139ebb6-4909-4505-8b10-5143adfaba98 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:15.091791 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5139ebb6-4909-4505-8b10-5143adfaba98 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:15.092165 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5139ebb6-4909-4505-8b10-5143adfaba98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:15.106280 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5139ebb6-4909-4505-8b10-5143adfaba98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:08:15.108288 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5139ebb6-4909-4505-8b10-5143adfaba98 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:08:15.126990 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-5139ebb6-4909-4505-8b10-5143adfaba98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:08:15.126990 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:08:15.126990 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:08:15.126990 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:08:15.126990 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:08:15.126990 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:08:15.126990 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:08:15.126990 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:08:15.126990 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:08:15.126990 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:08:15.126990 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:08:15.126990 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:08:15.126990 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:08:15.126990 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:08:15.126990 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:08:15.128157 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:08:15.128157 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:08:15.128157 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:08:15.128157 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:08:15.128157 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:08:15.128157 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:08:15.128157 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:08:15.128157 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:08:15.128157 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:08:15.128157 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:08:15.128157 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:08:15.128157 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:08:15.128157 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:08:15.128157 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:08:15.128157 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:08:15.128157 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:08:15.128157 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:08:15.129114 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:08:15.129114 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:08:15.129114 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:08:15.129114 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:08:15.129114 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 644/1256] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:08:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:08:15.134167 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e916e85b-09c9-4528-b773-f968235478ab None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:08:15.224413 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:08:15.237914 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e916e85b-09c9-4528-b773-f968235478ab None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:08:15.277770 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed17ce66-852b-4137-8bed-92327bec7f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:08:15.278502 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed17ce66-852b-4137-8bed-92327bec7f77 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:15.278852 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed17ce66-852b-4137-8bed-92327bec7f77 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:15.279160 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed17ce66-852b-4137-8bed-92327bec7f77 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:15.280052 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed17ce66-852b-4137-8bed-92327bec7f77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:08:15.280387 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed17ce66-852b-4137-8bed-92327bec7f77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:08:15.281848 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed17ce66-852b-4137-8bed-92327bec7f77 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:08:15.294437 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 613/1257] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jul 4 09:08:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:08:15.299926 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5139ebb6-4909-4505-8b10-5143adfaba98 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:08:15.409241 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5139ebb6-4909-4505-8b10-5143adfaba98 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:08:15.449234 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ffb47c-4e10-4e10-9053-4d15a7be1e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:08:15.450105 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ffb47c-4e10-4e10-9053-4d15a7be1e7c None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:15.450396 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ffb47c-4e10-4e10-9053-4d15a7be1e7c None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:15.450702 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ffb47c-4e10-4e10-9053-4d15a7be1e7c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:15.458539 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ffb47c-4e10-4e10-9053-4d15a7be1e7c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:08:15.460251 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ffb47c-4e10-4e10-9053-4d15a7be1e7c None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:08:15.475888 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-94ffb47c-4e10-4e10-9053-4d15a7be1e7c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:08:15.475888 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:08:15.475888 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:08:15.475888 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:08:15.475888 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:08:15.475888 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:08:15.475888 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:08:15.475888 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:08:15.475888 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:08:15.475888 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:08:15.475888 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:08:15.475888 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:08:15.475888 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:08:15.475888 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:08:15.475888 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:08:15.476919 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:08:15.476919 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:08:15.476919 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:08:15.476919 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:08:15.476919 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:08:15.476919 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:08:15.476919 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:08:15.476919 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:08:15.476919 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:08:15.476919 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:08:15.476919 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:08:15.476919 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:08:15.476919 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:08:15.476919 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:08:15.476919 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:08:15.476919 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:08:15.476919 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:08:15.477826 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:08:15.477826 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:08:15.477826 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:08:15.477826 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:08:15.477826 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:08:15.477826 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:08:15.477826 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:08:15.477826 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:08:15.477826 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 645/1258] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jul 4 09:08:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:08:15.484064 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed17ce66-852b-4137-8bed-92327bec7f77 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:08:15.600493 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed17ce66-852b-4137-8bed-92327bec7f77 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:08:15.639184 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db85e737-493c-40de-ab62-c94013eb5cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:08:15.639956 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db85e737-493c-40de-ab62-c94013eb5cfd None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:15.640282 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db85e737-493c-40de-ab62-c94013eb5cfd None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:15.640594 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db85e737-493c-40de-ab62-c94013eb5cfd None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:15.641563 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db85e737-493c-40de-ab62-c94013eb5cfd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:08:15.642067 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db85e737-493c-40de-ab62-c94013eb5cfd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:08:15.643712 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db85e737-493c-40de-ab62-c94013eb5cfd None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:08:15.659533 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 614/1259] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Jul 4 09:08:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:08:15.668154 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ffb47c-4e10-4e10-9053-4d15a7be1e7c None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:08:15.695387 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:08:15.781070 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ffb47c-4e10-4e10-9053-4d15a7be1e7c None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:08:15.825602 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd656a7f-b1af-4404-b42b-cec52801601d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:08:15.826385 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd656a7f-b1af-4404-b42b-cec52801601d None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:15.826719 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd656a7f-b1af-4404-b42b-cec52801601d None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:15.827018 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd656a7f-b1af-4404-b42b-cec52801601d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:15.827859 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd656a7f-b1af-4404-b42b-cec52801601d None admin] RBAC: Adding query filter params (role.id=965049e7ce6144aaad23c15f3a5e37c3, scope.project.id=d015d4f3d9d4464983ff561e8e08523c, user.id=46ec1a2091f1434cabc69066eb3b6725) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:08:15.828209 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd656a7f-b1af-4404-b42b-cec52801601d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:08:15.829667 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd656a7f-b1af-4404-b42b-cec52801601d None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:08:15.836294 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 646/1260] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Jul 4 09:08:15 2022] GET /identity/v3/role_assignments?user.id=46ec1a2091f1434cabc69066eb3b6725&scope.project.id=d015d4f3d9d4464983ff561e8e08523c&role.id=965049e7ce6144aaad23c15f3a5e37c3 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:08:17.869274 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589eff34-9bfa-4a51-bef9-cb8f78b9702d None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:17.870113 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589eff34-9bfa-4a51-bef9-cb8f78b9702d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:17.870113 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589eff34-9bfa-4a51-bef9-cb8f78b9702d None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:17.872436 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 615/1261] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:08:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:08:17.878778 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a801be1-f320-49bb-9d97-a7ad93172102 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:17.879225 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a801be1-f320-49bb-9d97-a7ad93172102 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:17.879386 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a801be1-f320-49bb-9d97-a7ad93172102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:17.902559 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-2a801be1-f320-49bb-9d97-a7ad93172102 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:08:17.903746 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-2a801be1-f320-49bb-9d97-a7ad93172102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:08:17.981304 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 647/1262] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:08:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:08:18.005168 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589eff34-9bfa-4a51-bef9-cb8f78b9702d None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:08:18.022442 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:08:18.123582 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589eff34-9bfa-4a51-bef9-cb8f78b9702d None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:08:18.159155 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ba38a-b9ba-4adc-a44d-76e82688d788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:08:18.160045 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ba38a-b9ba-4adc-a44d-76e82688d788 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:18.160197 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ba38a-b9ba-4adc-a44d-76e82688d788 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:18.160502 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ba38a-b9ba-4adc-a44d-76e82688d788 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:18.170379 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142ba38a-b9ba-4adc-a44d-76e82688d788 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:08:18.177926 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-142ba38a-b9ba-4adc-a44d-76e82688d788 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:08:18.177926 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:08:18.177926 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:08:18.177926 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:08:18.177926 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:08:18.177926 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:08:18.177926 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:08:18.177926 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:08:18.177926 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:08:18.177926 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:08:18.177926 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:08:18.177926 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:08:18.177926 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:08:18.177926 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:08:18.177926 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:08:18.177926 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:08:18.179047 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:08:18.179047 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:08:18.179047 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:08:18.179047 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:08:18.179047 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:08:18.179047 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:08:18.179047 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:08:18.179047 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:08:18.179047 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:08:18.179047 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:08:18.179047 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:08:18.179047 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:08:18.179047 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:08:18.179047 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:08:18.179047 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:08:18.179047 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:08:18.180135 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:08:18.180135 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:08:18.180135 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:08:18.180135 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:08:18.180135 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:08:18.180135 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:08:18.180135 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:08:18.180135 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:08:18.180135 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:08:18.180135 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:08:18.180135 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:08:18.180135 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:08:18.180135 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 616/1263] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Jul 4 09:08:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:08:18.186146 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a801be1-f320-49bb-9d97-a7ad93172102 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:08:18.208375 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:08:18.293786 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a801be1-f320-49bb-9d97-a7ad93172102 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:08:18.328210 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3689f68-2258-47c7-91b6-f710f0908253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:08:18.328861 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3689f68-2258-47c7-91b6-f710f0908253 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:18.329138 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3689f68-2258-47c7-91b6-f710f0908253 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:18.329409 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3689f68-2258-47c7-91b6-f710f0908253 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:18.330146 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3689f68-2258-47c7-91b6-f710f0908253 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:08:18.330450 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3689f68-2258-47c7-91b6-f710f0908253 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:08:18.331818 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3689f68-2258-47c7-91b6-f710f0908253 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:08:18.339847 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 648/1264] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jul 4 09:08:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:08:18.346414 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ba38a-b9ba-4adc-a44d-76e82688d788 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:08:18.420964 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:08:18.464736 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ba38a-b9ba-4adc-a44d-76e82688d788 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:08:18.500308 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d2867b-7ca2-4b33-94ad-3cbcad5c60d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:08:18.501080 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d2867b-7ca2-4b33-94ad-3cbcad5c60d4 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:18.501357 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d2867b-7ca2-4b33-94ad-3cbcad5c60d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:18.501626 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d2867b-7ca2-4b33-94ad-3cbcad5c60d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:18.512741 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d2867b-7ca2-4b33-94ad-3cbcad5c60d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:08:18.514197 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d2867b-7ca2-4b33-94ad-3cbcad5c60d4 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:08:18.531206 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-53d2867b-7ca2-4b33-94ad-3cbcad5c60d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:08:18.531206 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:08:18.531206 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:08:18.531206 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:08:18.531206 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:08:18.531206 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:08:18.531206 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:08:18.531206 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:08:18.531206 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:08:18.531206 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:08:18.531206 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:08:18.531206 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:08:18.531206 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:08:18.531206 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:08:18.531206 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:08:18.532192 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:08:18.532192 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:08:18.532192 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:08:18.532192 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:08:18.532192 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:08:18.532192 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:08:18.532192 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:08:18.532192 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:08:18.532192 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:08:18.532192 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:08:18.532192 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:08:18.532192 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:08:18.532192 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:08:18.532192 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:08:18.532192 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:08:18.532192 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:08:18.532192 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:08:18.533230 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:08:18.533230 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:08:18.533230 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:08:18.533230 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:08:18.533230 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 617/1265] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:08:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:08:18.538251 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3689f68-2258-47c7-91b6-f710f0908253 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:08:18.627592 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:08:18.655517 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3689f68-2258-47c7-91b6-f710f0908253 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:08:18.693913 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bf84bb-155c-408b-a6fa-83a5a2bd23c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:08:18.694570 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf84bb-155c-408b-a6fa-83a5a2bd23c3 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:18.694961 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf84bb-155c-408b-a6fa-83a5a2bd23c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:18.695279 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf84bb-155c-408b-a6fa-83a5a2bd23c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:18.696140 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bf84bb-155c-408b-a6fa-83a5a2bd23c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:08:18.696461 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bf84bb-155c-408b-a6fa-83a5a2bd23c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:08:18.698151 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bf84bb-155c-408b-a6fa-83a5a2bd23c3 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:08:18.711432 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 649/1266] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jul 4 09:08:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:08:18.719239 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d2867b-7ca2-4b33-94ad-3cbcad5c60d4 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:08:18.833163 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d2867b-7ca2-4b33-94ad-3cbcad5c60d4 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:08:18.852567 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:08:18.869998 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b439f237-b6e5-4c21-9288-4c74e61ab231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:08:18.870791 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439f237-b6e5-4c21-9288-4c74e61ab231 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:18.871070 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439f237-b6e5-4c21-9288-4c74e61ab231 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:18.871342 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439f237-b6e5-4c21-9288-4c74e61ab231 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:18.878938 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b439f237-b6e5-4c21-9288-4c74e61ab231 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:08:18.880421 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b439f237-b6e5-4c21-9288-4c74e61ab231 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:08:18.895139 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-b439f237-b6e5-4c21-9288-4c74e61ab231 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 04 09:08:18.895139 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:08:18.895139 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:08:18.895139 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:08:18.895139 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:08:18.895139 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:08:18.895139 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:08:18.895139 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:08:18.895139 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:08:18.895139 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:08:18.895139 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:08:18.895139 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:08:18.895139 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:08:18.895139 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:08:18.895139 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:08:18.895139 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:08:18.896198 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:08:18.896198 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:08:18.896198 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:08:18.896198 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:08:18.896198 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:08:18.896198 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:08:18.896198 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:08:18.896198 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:08:18.896198 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:08:18.896198 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:08:18.896198 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:08:18.896198 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:08:18.896198 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:08:18.896198 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:08:18.896198 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:08:18.896198 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:08:18.896198 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:08:18.896198 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:08:18.897287 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:08:18.897287 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:08:18.897287 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:08:18.897287 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:08:18.897287 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:08:18.897287 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:08:18.897287 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:08:18.897287 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:08:18.897287 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 04 09:08:18.897287 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:08:18.897287 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 618/1267] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:08:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:08:18.902511 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bf84bb-155c-408b-a6fa-83a5a2bd23c3 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:08:19.002394 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bf84bb-155c-408b-a6fa-83a5a2bd23c3 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:08:19.037269 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb03b6b0-983b-4cf6-8850-e729162af88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:08:19.037923 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb03b6b0-983b-4cf6-8850-e729162af88c None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:19.038207 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb03b6b0-983b-4cf6-8850-e729162af88c None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:19.038536 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb03b6b0-983b-4cf6-8850-e729162af88c None admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:19.039459 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb03b6b0-983b-4cf6-8850-e729162af88c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:08:19.039770 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb03b6b0-983b-4cf6-8850-e729162af88c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:08:19.041323 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb03b6b0-983b-4cf6-8850-e729162af88c None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:08:19.050005 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:08:19.059370 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 650/1268] 10.222.0.42 () {56 vars in 1143 bytes} [Mon Jul 4 09:08:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:08:19.065915 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b439f237-b6e5-4c21-9288-4c74e61ab231 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:08:19.170032 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b439f237-b6e5-4c21-9288-4c74e61ab231 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:08:19.204239 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e142dc5-057a-41e4-9169-20553949216a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:08:19.205007 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e142dc5-057a-41e4-9169-20553949216a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:19.205288 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e142dc5-057a-41e4-9169-20553949216a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:19.205558 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e142dc5-057a-41e4-9169-20553949216a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:19.216478 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e142dc5-057a-41e4-9169-20553949216a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:08:19.217949 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e142dc5-057a-41e4-9169-20553949216a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:08:19.235386 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-0e142dc5-057a-41e4-9169-20553949216a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:08:19.235386 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:08:19.235386 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:08:19.235386 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:08:19.235386 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:08:19.235386 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:08:19.235386 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:08:19.235386 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:08:19.235386 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:08:19.235386 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:08:19.235386 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:08:19.235386 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:08:19.235386 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:08:19.235386 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:08:19.235386 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:08:19.236526 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:08:19.236526 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:08:19.236526 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:08:19.236526 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:08:19.236526 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:08:19.236526 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:08:19.236526 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:08:19.236526 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:08:19.236526 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:08:19.236526 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:08:19.236526 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:08:19.236526 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:08:19.236526 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:08:19.236526 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:08:19.236526 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:08:19.236526 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:08:19.236526 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:08:19.237818 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:08:19.237818 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:08:19.237818 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:08:19.237818 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:08:19.237818 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 619/1269] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:08:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:08:19.242373 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb03b6b0-983b-4cf6-8850-e729162af88c None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:08:19.346648 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb03b6b0-983b-4cf6-8850-e729162af88c None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:08:19.398036 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e553e7-9213-48f5-8527-876da9ebb1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:08:19.398701 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e553e7-9213-48f5-8527-876da9ebb1df None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:19.398980 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e553e7-9213-48f5-8527-876da9ebb1df None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:19.399246 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e553e7-9213-48f5-8527-876da9ebb1df None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:19.399996 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e553e7-9213-48f5-8527-876da9ebb1df None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:08:19.400298 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e553e7-9213-48f5-8527-876da9ebb1df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:08:19.401682 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e553e7-9213-48f5-8527-876da9ebb1df None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:08:19.414920 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 651/1270] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jul 4 09:08:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:08:19.421565 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e142dc5-057a-41e4-9169-20553949216a None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:08:19.457469 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:08:19.527289 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e142dc5-057a-41e4-9169-20553949216a None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:08:19.561995 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea2d4f0-9bd4-4392-9346-45522edbacc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:08:19.562769 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea2d4f0-9bd4-4392-9346-45522edbacc8 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:19.563046 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea2d4f0-9bd4-4392-9346-45522edbacc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:19.563322 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea2d4f0-9bd4-4392-9346-45522edbacc8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:19.570318 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea2d4f0-9bd4-4392-9346-45522edbacc8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:08:19.571787 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea2d4f0-9bd4-4392-9346-45522edbacc8 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:08:19.586127 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-7ea2d4f0-9bd4-4392-9346-45522edbacc8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:08:19.586127 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:08:19.586127 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:08:19.586127 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:08:19.586127 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:08:19.586127 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:08:19.586127 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:08:19.586127 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:08:19.586127 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:08:19.586127 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:08:19.586127 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:08:19.586127 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:08:19.586127 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:08:19.586127 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:08:19.586127 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:08:19.587151 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:08:19.587151 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:08:19.587151 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:08:19.587151 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:08:19.587151 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:08:19.587151 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:08:19.587151 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:08:19.587151 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:08:19.587151 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:08:19.587151 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:08:19.587151 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:08:19.587151 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:08:19.587151 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:08:19.587151 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:08:19.587151 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:08:19.587151 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:08:19.587151 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:08:19.588289 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:08:19.588289 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:08:19.588289 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:08:19.588289 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:08:19.588289 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:08:19.588289 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:08:19.588289 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:08:19.588289 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:08:19.588289 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 620/1271] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jul 4 09:08:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:08:19.593301 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e553e7-9213-48f5-8527-876da9ebb1df None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:08:19.663502 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:08:19.711706 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e553e7-9213-48f5-8527-876da9ebb1df None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:08:19.746491 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423f3a40-918f-449a-8878-67984aa3d739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:08:19.747139 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f3a40-918f-449a-8878-67984aa3d739 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:19.747418 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f3a40-918f-449a-8878-67984aa3d739 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:19.747688 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f3a40-918f-449a-8878-67984aa3d739 None admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:19.748502 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423f3a40-918f-449a-8878-67984aa3d739 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:08:19.748807 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423f3a40-918f-449a-8878-67984aa3d739 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:08:19.750231 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423f3a40-918f-449a-8878-67984aa3d739 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:08:19.762057 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 652/1272] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Jul 4 09:08:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:08:19.768795 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea2d4f0-9bd4-4392-9346-45522edbacc8 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:08:19.865326 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:08:19.874717 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea2d4f0-9bd4-4392-9346-45522edbacc8 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:08:19.909939 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac351b63-fc13-4d52-bb3d-8bf4d3c2f87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:08:19.910831 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac351b63-fc13-4d52-bb3d-8bf4d3c2f87a None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:19.911114 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac351b63-fc13-4d52-bb3d-8bf4d3c2f87a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:19.911385 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac351b63-fc13-4d52-bb3d-8bf4d3c2f87a None admin] PATH_INFO: `/v3/projects/d015d4f3d9d4464983ff561e8e08523c/users/46ec1a2091f1434cabc69066eb3b6725/roles/965049e7ce6144aaad23c15f3a5e37c3` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:19.913773 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac351b63-fc13-4d52-bb3d-8bf4d3c2f87a None admin] RBAC: Authorizing `identity:create_grant(project_id=d015d4f3d9d4464983ff561e8e08523c, user_id=46ec1a2091f1434cabc69066eb3b6725, role_id=965049e7ce6144aaad23c15f3a5e37c3)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:08:19.915191 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac351b63-fc13-4d52-bb3d-8bf4d3c2f87a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:08:19.930105 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 621/1273] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Jul 4 09:08:19 2022] PUT /identity/v3/projects/d015d4f3d9d4464983ff561e8e08523c/users/46ec1a2091f1434cabc69066eb3b6725/roles/965049e7ce6144aaad23c15f3a5e37c3 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:08:21.898226 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed375ed-ced9-4185-9767-d15c4637bbb5 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:21.898729 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed375ed-ced9-4185-9767-d15c4637bbb5 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:21.898729 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed375ed-ced9-4185-9767-d15c4637bbb5 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:21.900180 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 653/1274] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:08:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:08:21.906435 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e756dd7-febf-43b4-ac67-afc9fdbd9fe0 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:21.906843 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e756dd7-febf-43b4-ac67-afc9fdbd9fe0 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:21.907044 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e756dd7-febf-43b4-ac67-afc9fdbd9fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:21.932764 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-7e756dd7-febf-43b4-ac67-afc9fdbd9fe0 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:08:21.933938 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-7e756dd7-febf-43b4-ac67-afc9fdbd9fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:08:22.010502 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 622/1275] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:08:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:08:22.033970 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed375ed-ced9-4185-9767-d15c4637bbb5 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:08:22.150745 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed375ed-ced9-4185-9767-d15c4637bbb5 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:08:22.168999 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:08:22.187969 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6ef229-5cbb-4303-bbf5-e0ee7c10d81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:08:22.188749 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ef229-5cbb-4303-bbf5-e0ee7c10d81a None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:22.189028 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ef229-5cbb-4303-bbf5-e0ee7c10d81a None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:22.189302 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ef229-5cbb-4303-bbf5-e0ee7c10d81a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:22.199612 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6ef229-5cbb-4303-bbf5-e0ee7c10d81a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:08:22.207001 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-7c6ef229-5cbb-4303-bbf5-e0ee7c10d81a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:08:22.207001 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:08:22.207001 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:08:22.207001 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:08:22.207001 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:08:22.207001 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:08:22.207001 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:08:22.207001 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:08:22.207001 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:08:22.207001 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:08:22.207001 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:08:22.207001 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:08:22.207001 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:08:22.207001 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:08:22.207001 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:08:22.207001 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:08:22.208174 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:08:22.208174 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:08:22.208174 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:08:22.208174 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:08:22.208174 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:08:22.208174 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:08:22.208174 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:08:22.208174 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:08:22.208174 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:08:22.208174 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:08:22.208174 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:08:22.208174 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:08:22.208174 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:08:22.208174 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:08:22.208174 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:08:22.208174 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:08:22.209065 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:08:22.209065 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:08:22.209065 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:08:22.209065 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:08:22.209065 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:08:22.209065 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:08:22.209065 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:08:22.209065 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:08:22.209065 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:08:22.209065 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:08:22.209065 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:08:22.209065 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:08:22.209065 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 654/1276] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Jul 4 09:08:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:08:22.214188 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e756dd7-febf-43b4-ac67-afc9fdbd9fe0 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:08:22.296398 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:08:22.323275 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e756dd7-febf-43b4-ac67-afc9fdbd9fe0 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:08:22.357947 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68985810-0bc7-4764-96b3-344ac0365c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:08:22.358601 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68985810-0bc7-4764-96b3-344ac0365c09 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:22.358881 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68985810-0bc7-4764-96b3-344ac0365c09 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:22.359155 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68985810-0bc7-4764-96b3-344ac0365c09 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:22.359930 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68985810-0bc7-4764-96b3-344ac0365c09 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:08:22.360228 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68985810-0bc7-4764-96b3-344ac0365c09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:08:22.361632 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68985810-0bc7-4764-96b3-344ac0365c09 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:08:22.369803 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 623/1277] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jul 4 09:08:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:08:22.378482 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6ef229-5cbb-4303-bbf5-e0ee7c10d81a None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:08:22.499493 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6ef229-5cbb-4303-bbf5-e0ee7c10d81a None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:08:22.533297 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449aef62-f960-436e-8e92-e2717d442eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:08:22.534071 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449aef62-f960-436e-8e92-e2717d442eab None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:22.534350 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449aef62-f960-436e-8e92-e2717d442eab None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:22.534618 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449aef62-f960-436e-8e92-e2717d442eab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:22.545465 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449aef62-f960-436e-8e92-e2717d442eab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:08:22.546913 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449aef62-f960-436e-8e92-e2717d442eab None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:08:22.563851 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-449aef62-f960-436e-8e92-e2717d442eab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:08:22.563851 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:08:22.563851 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:08:22.563851 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:08:22.563851 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:08:22.563851 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:08:22.563851 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:08:22.563851 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:08:22.563851 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:08:22.563851 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:08:22.563851 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:08:22.563851 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:08:22.563851 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:08:22.563851 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:08:22.563851 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:08:22.564917 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:08:22.564917 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:08:22.564917 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:08:22.564917 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:08:22.564917 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:08:22.564917 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:08:22.564917 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:08:22.564917 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:08:22.564917 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:08:22.564917 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:08:22.564917 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:08:22.564917 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:08:22.564917 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:08:22.564917 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:08:22.564917 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:08:22.564917 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:08:22.564917 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:08:22.566024 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:08:22.566024 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:08:22.566024 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:08:22.566024 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:08:22.566024 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 655/1278] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:08:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:08:22.570787 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68985810-0bc7-4764-96b3-344ac0365c09 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:08:22.689057 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68985810-0bc7-4764-96b3-344ac0365c09 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:08:22.723404 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89bcc66-0bda-4ba2-9a8b-14d2b1593323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:08:22.724067 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89bcc66-0bda-4ba2-9a8b-14d2b1593323 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:22.724346 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89bcc66-0bda-4ba2-9a8b-14d2b1593323 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:22.724612 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89bcc66-0bda-4ba2-9a8b-14d2b1593323 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:22.725326 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89bcc66-0bda-4ba2-9a8b-14d2b1593323 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:08:22.725621 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89bcc66-0bda-4ba2-9a8b-14d2b1593323 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:08:22.727069 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89bcc66-0bda-4ba2-9a8b-14d2b1593323 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:08:22.739055 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 624/1279] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jul 4 09:08:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:08:22.747850 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449aef62-f960-436e-8e92-e2717d442eab None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:08:22.782317 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:08:22.854632 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449aef62-f960-436e-8e92-e2717d442eab None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:08:22.890654 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2760b5dc-ba91-4281-84d7-16760f1be720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:08:22.891927 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760b5dc-ba91-4281-84d7-16760f1be720 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:22.891927 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760b5dc-ba91-4281-84d7-16760f1be720 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:22.892119 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760b5dc-ba91-4281-84d7-16760f1be720 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:22.900003 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2760b5dc-ba91-4281-84d7-16760f1be720 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:08:22.901488 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2760b5dc-ba91-4281-84d7-16760f1be720 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:08:22.915655 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-2760b5dc-ba91-4281-84d7-16760f1be720 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 04 09:08:22.915655 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:08:22.915655 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:08:22.915655 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:08:22.915655 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:08:22.915655 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:08:22.915655 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:08:22.915655 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:08:22.915655 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:08:22.915655 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:08:22.915655 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:08:22.915655 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:08:22.915655 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:08:22.915655 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:08:22.915655 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:08:22.915655 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:08:22.916775 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:08:22.916775 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:08:22.916775 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:08:22.916775 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:08:22.916775 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:08:22.916775 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:08:22.916775 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:08:22.916775 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:08:22.916775 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:08:22.916775 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:08:22.916775 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:08:22.916775 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:08:22.916775 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:08:22.916775 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:08:22.916775 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:08:22.916775 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:08:22.916775 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:08:22.916775 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:08:22.917927 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:08:22.917927 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:08:22.917927 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:08:22.917927 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:08:22.917927 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:08:22.917927 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:08:22.917927 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:08:22.917927 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:08:22.917927 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 04 09:08:22.917927 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:08:22.917927 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 656/1280] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:08:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:08:22.924971 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89bcc66-0bda-4ba2-9a8b-14d2b1593323 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:08:22.929054 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:08:23.028136 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89bcc66-0bda-4ba2-9a8b-14d2b1593323 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:08:23.062549 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eaf610-5b00-45f2-9f68-5b98e9c12bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:08:23.063142 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eaf610-5b00-45f2-9f68-5b98e9c12bf5 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:23.063422 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eaf610-5b00-45f2-9f68-5b98e9c12bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:23.063694 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eaf610-5b00-45f2-9f68-5b98e9c12bf5 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:23.064569 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eaf610-5b00-45f2-9f68-5b98e9c12bf5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:08:23.064880 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eaf610-5b00-45f2-9f68-5b98e9c12bf5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:08:23.066338 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eaf610-5b00-45f2-9f68-5b98e9c12bf5 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:08:23.083667 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 625/1281] 10.222.0.42 () {56 vars in 1143 bytes} [Mon Jul 4 09:08:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:08:23.089586 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2760b5dc-ba91-4281-84d7-16760f1be720 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:08:23.179588 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:08:23.189876 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2760b5dc-ba91-4281-84d7-16760f1be720 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:08:23.222387 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee4008c-72e4-4e9d-901a-c006d4fcfd56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:08:23.223026 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee4008c-72e4-4e9d-901a-c006d4fcfd56 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:23.223304 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee4008c-72e4-4e9d-901a-c006d4fcfd56 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:23.223576 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee4008c-72e4-4e9d-901a-c006d4fcfd56 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:23.291122 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee4008c-72e4-4e9d-901a-c006d4fcfd56 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:08:23.292602 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee4008c-72e4-4e9d-901a-c006d4fcfd56 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:08:23.388998 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:08:23.400574 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 657/1282] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jul 4 09:08:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 04 09:08:23.407286 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eaf610-5b00-45f2-9f68-5b98e9c12bf5 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:08:23.477437 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:08:23.519953 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eaf610-5b00-45f2-9f68-5b98e9c12bf5 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:08:23.555765 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fbb260-5fac-474f-92e9-5b10a5371841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:08:23.556571 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fbb260-5fac-474f-92e9-5b10a5371841 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:23.556855 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fbb260-5fac-474f-92e9-5b10a5371841 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:23.557124 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fbb260-5fac-474f-92e9-5b10a5371841 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:23.570660 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fbb260-5fac-474f-92e9-5b10a5371841 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:08:23.572168 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fbb260-5fac-474f-92e9-5b10a5371841 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:08:23.590436 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-90fbb260-5fac-474f-92e9-5b10a5371841 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:08:23.590436 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:08:23.590436 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:08:23.590436 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:08:23.590436 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:08:23.590436 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:08:23.590436 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:08:23.590436 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:08:23.590436 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:08:23.590436 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:08:23.590436 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:08:23.590436 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:08:23.590436 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:08:23.590436 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:08:23.590436 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:08:23.591529 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:08:23.591529 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:08:23.591529 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:08:23.591529 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:08:23.591529 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:08:23.591529 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:08:23.591529 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:08:23.591529 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:08:23.591529 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:08:23.591529 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:08:23.591529 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:08:23.591529 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:08:23.591529 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:08:23.591529 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:08:23.591529 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:08:23.591529 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:08:23.591529 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:08:23.597107 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:08:23.597107 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:08:23.597107 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:08:23.597107 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:08:23.597107 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 626/1283] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:08:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:08:23.597482 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee4008c-72e4-4e9d-901a-c006d4fcfd56 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:08:23.709247 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee4008c-72e4-4e9d-901a-c006d4fcfd56 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:08:23.746636 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30751bb1-32e4-4e6d-9b09-902ac48bb93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:08:23.747281 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30751bb1-32e4-4e6d-9b09-902ac48bb93f None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:23.747564 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30751bb1-32e4-4e6d-9b09-902ac48bb93f None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:23.747835 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30751bb1-32e4-4e6d-9b09-902ac48bb93f None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:23.748581 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30751bb1-32e4-4e6d-9b09-902ac48bb93f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:08:23.748892 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30751bb1-32e4-4e6d-9b09-902ac48bb93f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:08:23.750262 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30751bb1-32e4-4e6d-9b09-902ac48bb93f None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:08:23.761556 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 658/1284] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jul 4 09:08:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:08:23.768242 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fbb260-5fac-474f-92e9-5b10a5371841 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:08:23.878208 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fbb260-5fac-474f-92e9-5b10a5371841 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:08:23.894060 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:08:23.914558 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490023c3-59f4-4c73-a660-d422b91d04d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:08:23.915348 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490023c3-59f4-4c73-a660-d422b91d04d0 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:23.915630 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490023c3-59f4-4c73-a660-d422b91d04d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:23.915920 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490023c3-59f4-4c73-a660-d422b91d04d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:23.922581 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490023c3-59f4-4c73-a660-d422b91d04d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:08:23.924073 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490023c3-59f4-4c73-a660-d422b91d04d0 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:08:23.937801 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-490023c3-59f4-4c73-a660-d422b91d04d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:08:23.937801 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:08:23.937801 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:08:23.937801 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:08:23.937801 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:08:23.937801 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:08:23.937801 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:08:23.937801 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:08:23.937801 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:08:23.937801 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:08:23.937801 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:08:23.937801 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:08:23.937801 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:08:23.937801 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:08:23.937801 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:08:23.939296 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:08:23.939296 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:08:23.939296 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:08:23.939296 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:08:23.939296 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:08:23.939296 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:08:23.939296 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:08:23.939296 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:08:23.939296 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 04 09:08:23.939296 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:08:23.939296 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:08:23.939296 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:08:23.939296 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:08:23.939296 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:08:23.939296 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:08:23.939296 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:08:23.939296 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:08:23.940534 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:08:23.940534 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:08:23.940534 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:08:23.940534 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:08:23.940534 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:08:23.940534 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:08:23.940534 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:08:23.940534 dv-cinder-844563-4-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 04 09:08:23.940534 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 627/1285] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jul 4 09:08:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:08:23.945672 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30751bb1-32e4-4e6d-9b09-902ac48bb93f None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:08:24.003300 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:08:24.057693 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30751bb1-32e4-4e6d-9b09-902ac48bb93f None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:08:24.103290 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b2a12b-1c04-4789-a6ea-61b1f19a5b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:08:24.104000 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2a12b-1c04-4789-a6ea-61b1f19a5b94 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:24.104282 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2a12b-1c04-4789-a6ea-61b1f19a5b94 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:24.104553 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2a12b-1c04-4789-a6ea-61b1f19a5b94 None admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:24.105342 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b2a12b-1c04-4789-a6ea-61b1f19a5b94 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:08:24.105649 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b2a12b-1c04-4789-a6ea-61b1f19a5b94 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:08:24.107092 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b2a12b-1c04-4789-a6ea-61b1f19a5b94 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:08:24.119528 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 659/1286] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Jul 4 09:08:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:08:24.129574 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490023c3-59f4-4c73-a660-d422b91d04d0 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:08:24.239510 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490023c3-59f4-4c73-a660-d422b91d04d0 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:08:24.275482 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366f1c5a-8346-4b9b-a4b7-26ca159278c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:08:24.276082 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f1c5a-8346-4b9b-a4b7-26ca159278c3 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:24.276365 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f1c5a-8346-4b9b-a4b7-26ca159278c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:24.276642 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f1c5a-8346-4b9b-a4b7-26ca159278c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:24.277468 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366f1c5a-8346-4b9b-a4b7-26ca159278c3 None admin] RBAC: Adding query filter params (role.id=965049e7ce6144aaad23c15f3a5e37c3, scope.project.id=d015d4f3d9d4464983ff561e8e08523c, user.id=46ec1a2091f1434cabc69066eb3b6725) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:08:24.277782 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366f1c5a-8346-4b9b-a4b7-26ca159278c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:08:24.279245 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366f1c5a-8346-4b9b-a4b7-26ca159278c3 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:08:24.287858 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 628/1287] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Jul 4 09:08:24 2022] GET /identity/v3/role_assignments?user.id=46ec1a2091f1434cabc69066eb3b6725&scope.project.id=d015d4f3d9d4464983ff561e8e08523c&role.id=965049e7ce6144aaad23c15f3a5e37c3 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:08:26.308468 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a3b25-9faf-4a49-9e90-a6323affbbc6 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:26.309348 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a3b25-9faf-4a49-9e90-a6323affbbc6 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:26.309348 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a3b25-9faf-4a49-9e90-a6323affbbc6 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:26.311550 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 660/1288] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:08:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:08:26.317774 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c82a74-07f4-49c9-b3bc-e132258061b9 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:26.318541 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c82a74-07f4-49c9-b3bc-e132258061b9 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:26.318690 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c82a74-07f4-49c9-b3bc-e132258061b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:26.342936 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-f3c82a74-07f4-49c9-b3bc-e132258061b9 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:08:26.344158 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f3c82a74-07f4-49c9-b3bc-e132258061b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:08:26.374875 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:08:26.414809 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 629/1289] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:08:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:08:26.437909 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827a3b25-9faf-4a49-9e90-a6323affbbc6 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:08:26.557654 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827a3b25-9faf-4a49-9e90-a6323affbbc6 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:08:26.568310 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:08:26.592234 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e06cc93-9ba7-4cdb-b23a-54cc510133cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:08:26.593022 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06cc93-9ba7-4cdb-b23a-54cc510133cf None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:26.593305 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06cc93-9ba7-4cdb-b23a-54cc510133cf None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:26.593561 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06cc93-9ba7-4cdb-b23a-54cc510133cf None admin] PATH_INFO: `/v3/services/placement` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:26.594204 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e06cc93-9ba7-4cdb-b23a-54cc510133cf None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:08:26.595582 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e06cc93-9ba7-4cdb-b23a-54cc510133cf None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:08:26.608108 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-7e06cc93-9ba7-4cdb-b23a-54cc510133cf None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 04 09:08:26.608108 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:08:26.608108 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 09:08:26.608108 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 09:08:26.608108 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 09:08:26.608108 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 09:08:26.608108 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 09:08:26.608108 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:08:26.608108 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 04 09:08:26.608108 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:08:26.608108 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:08:26.608108 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:08:26.608108 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:08:26.608108 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:08:26.608108 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:08:26.608108 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:08:26.608108 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:08:26.609483 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:08:26.609483 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:08:26.609483 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:08:26.609483 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:08:26.609483 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:08:26.609483 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:08:26.609483 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 09:08:26.609483 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 09:08:26.609483 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 09:08:26.609483 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 09:08:26.609483 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:08:26.609483 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:08:26.609483 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:08:26.609483 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:08:26.609483 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:08:26.609483 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:08:26.610625 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:08:26.610625 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:08:26.610625 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:08:26.610625 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:08:26.610625 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:08:26.610625 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:08:26.610625 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:08:26.610625 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:08:26.610625 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:08:26.610625 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:08:26.610625 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 09:08:26.610625 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:08:26.610625 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 04 09:08:26.610625 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:08:26.610625 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 661/1290] 10.222.0.42 () {56 vars in 1117 bytes} [Mon Jul 4 09:08:26 2022] GET /identity/v3/services/placement => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:08:26.618207 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c82a74-07f4-49c9-b3bc-e132258061b9 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:08:26.737279 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c82a74-07f4-49c9-b3bc-e132258061b9 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:08:26.771689 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f9c4a7-e0e8-45b2-872d-583004165452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:08:26.772378 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f9c4a7-e0e8-45b2-872d-583004165452 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:26.773018 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f9c4a7-e0e8-45b2-872d-583004165452 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:26.773018 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f9c4a7-e0e8-45b2-872d-583004165452 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:26.773651 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f9c4a7-e0e8-45b2-872d-583004165452 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:08:26.773902 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f9c4a7-e0e8-45b2-872d-583004165452 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:08:26.775289 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f9c4a7-e0e8-45b2-872d-583004165452 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:08:26.780425 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 630/1291] 10.222.0.42 () {56 vars in 1116 bytes} [Mon Jul 4 09:08:26 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:08:26.786551 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e06cc93-9ba7-4cdb-b23a-54cc510133cf None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:08:26.897914 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e06cc93-9ba7-4cdb-b23a-54cc510133cf None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:08:26.932628 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0262e0-50f5-4a88-ada5-33211b6b65d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:08:26.933284 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0262e0-50f5-4a88-ada5-33211b6b65d2 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:26.933564 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0262e0-50f5-4a88-ada5-33211b6b65d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:26.933841 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0262e0-50f5-4a88-ada5-33211b6b65d2 None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:26.934550 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0262e0-50f5-4a88-ada5-33211b6b65d2 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:08:26.934855 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0262e0-50f5-4a88-ada5-33211b6b65d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:08:26.936276 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0262e0-50f5-4a88-ada5-33211b6b65d2 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:08:26.941186 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 662/1292] 10.222.0.42 () {56 vars in 1116 bytes} [Mon Jul 4 09:08:26 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:08:28.928633 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea43e44c-531d-4677-bdbc-15a7aac3a4ff None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:28.929081 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea43e44c-531d-4677-bdbc-15a7aac3a4ff None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:28.929204 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea43e44c-531d-4677-bdbc-15a7aac3a4ff None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:28.930570 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 631/1293] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:08:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:08:28.935969 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c03211-eec5-416e-9ce0-a1acb79dfe7a None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:28.936386 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c03211-eec5-416e-9ce0-a1acb79dfe7a None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:28.936510 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c03211-eec5-416e-9ce0-a1acb79dfe7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:28.955377 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-c8c03211-eec5-416e-9ce0-a1acb79dfe7a None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:08:28.956619 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-c8c03211-eec5-416e-9ce0-a1acb79dfe7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:08:28.988589 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:08:29.034943 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 663/1294] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:08:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:08:29.058457 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea43e44c-531d-4677-bdbc-15a7aac3a4ff None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:08:29.095145 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:08:29.183034 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea43e44c-531d-4677-bdbc-15a7aac3a4ff None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:08:29.220503 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6adf6f0-85ed-414c-9e18-a9c8c2e9159c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:08:29.221160 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6adf6f0-85ed-414c-9e18-a9c8c2e9159c None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:29.221446 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6adf6f0-85ed-414c-9e18-a9c8c2e9159c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:29.221717 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6adf6f0-85ed-414c-9e18-a9c8c2e9159c None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:29.222447 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6adf6f0-85ed-414c-9e18-a9c8c2e9159c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:08:29.223846 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6adf6f0-85ed-414c-9e18-a9c8c2e9159c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:08:29.244619 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 632/1295] 10.222.0.42 () {60 vars in 1141 bytes} [Mon Jul 4 09:08:29 2022] POST /identity/v3/services => generated 246 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:08:31.250035 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e03e211-0aa5-47bf-a7a0-7e6477574d4f None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:31.250626 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e03e211-0aa5-47bf-a7a0-7e6477574d4f None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:31.250626 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e03e211-0aa5-47bf-a7a0-7e6477574d4f None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:31.251969 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 664/1296] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:08:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:08:31.258214 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a010b89-2665-46f6-b1d2-c0d7921b6cd2 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:31.258925 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a010b89-2665-46f6-b1d2-c0d7921b6cd2 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:31.259109 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a010b89-2665-46f6-b1d2-c0d7921b6cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:31.278386 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-5a010b89-2665-46f6-b1d2-c0d7921b6cd2 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:08:31.279582 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-5a010b89-2665-46f6-b1d2-c0d7921b6cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:08:31.360884 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 633/1297] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:08:31 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:08:31.386007 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e03e211-0aa5-47bf-a7a0-7e6477574d4f None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:08:31.490794 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e03e211-0aa5-47bf-a7a0-7e6477574d4f None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:08:31.526537 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d39621-e66e-4107-95d5-8f7ed12b5ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:08:31.527250 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d39621-e66e-4107-95d5-8f7ed12b5ed0 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:31.527534 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d39621-e66e-4107-95d5-8f7ed12b5ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:31.527793 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d39621-e66e-4107-95d5-8f7ed12b5ed0 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:31.528476 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d39621-e66e-4107-95d5-8f7ed12b5ed0 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:08:31.529854 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d39621-e66e-4107-95d5-8f7ed12b5ed0 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:08:31.541505 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-f4d39621-e66e-4107-95d5-8f7ed12b5ed0 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 04 09:08:31.541505 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:08:31.541505 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 09:08:31.541505 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 09:08:31.541505 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 09:08:31.541505 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 09:08:31.541505 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 09:08:31.541505 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:08:31.541505 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 04 09:08:31.541505 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:08:31.541505 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:08:31.541505 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:08:31.541505 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:08:31.541505 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:08:31.541505 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:08:31.541505 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:08:31.541505 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:08:31.542646 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:08:31.542646 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:08:31.542646 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:08:31.542646 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:08:31.542646 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:08:31.542646 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:08:31.542646 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 09:08:31.542646 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 09:08:31.542646 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 09:08:31.542646 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 09:08:31.542646 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:08:31.542646 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:08:31.542646 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:08:31.542646 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:08:31.542646 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:08:31.542646 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:08:31.543673 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:08:31.543673 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:08:31.543673 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:08:31.543673 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:08:31.543673 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:08:31.543673 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:08:31.543673 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:08:31.543673 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:08:31.543673 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:08:31.543673 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:08:31.543673 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 09:08:31.543673 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:08:31.543673 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 04 09:08:31.543673 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:08:31.543673 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 665/1298] 10.222.0.42 () {56 vars in 1117 bytes} [Mon Jul 4 09:08:31 2022] GET /identity/v3/services/placement => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:08:31.549326 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a010b89-2665-46f6-b1d2-c0d7921b6cd2 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:08:31.570450 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:08:31.664558 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a010b89-2665-46f6-b1d2-c0d7921b6cd2 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:08:31.709143 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d19d747-0370-4dee-af85-0f4c615535ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:08:31.709842 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19d747-0370-4dee-af85-0f4c615535ef None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:31.710129 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19d747-0370-4dee-af85-0f4c615535ef None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:31.710405 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19d747-0370-4dee-af85-0f4c615535ef None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:31.711113 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d19d747-0370-4dee-af85-0f4c615535ef None admin] RBAC: Adding query filter params (name=placement) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:08:31.711419 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d19d747-0370-4dee-af85-0f4c615535ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:08:31.712854 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d19d747-0370-4dee-af85-0f4c615535ef None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:08:31.718198 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 634/1299] 10.222.0.42 () {56 vars in 1116 bytes} [Mon Jul 4 09:08:31 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:08:31.724559 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d39621-e66e-4107-95d5-8f7ed12b5ed0 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:08:31.757930 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:08:31.845311 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d39621-e66e-4107-95d5-8f7ed12b5ed0 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:08:31.879557 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f230265-cecf-44aa-a334-f3515e7301ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:08:31.880235 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f230265-cecf-44aa-a334-f3515e7301ea None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:31.880517 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f230265-cecf-44aa-a334-f3515e7301ea None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:31.880793 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f230265-cecf-44aa-a334-f3515e7301ea None admin] PATH_INFO: `/v3/endpoints` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:31.881573 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f230265-cecf-44aa-a334-f3515e7301ea None admin] RBAC: Adding query filter params (interface=public, service_id=e01cda1f36f341259c050bd342612462, region_id=RegionOne) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:08:31.881932 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f230265-cecf-44aa-a334-f3515e7301ea None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:08:31.883318 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f230265-cecf-44aa-a334-f3515e7301ea None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:08:31.888785 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 666/1300] 10.222.0.42 () {56 vars in 1251 bytes} [Mon Jul 4 09:08:31 2022] GET /identity/v3/endpoints?service_id=e01cda1f36f341259c050bd342612462&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:08:31.894585 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d19d747-0370-4dee-af85-0f4c615535ef None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:08:31.982825 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:08:32.003547 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d19d747-0370-4dee-af85-0f4c615535ef None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:08:32.039181 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e0b64b-52cd-4b86-beec-0a5fdb99da12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:08:32.039844 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e0b64b-52cd-4b86-beec-0a5fdb99da12 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:32.040162 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e0b64b-52cd-4b86-beec-0a5fdb99da12 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:32.040441 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e0b64b-52cd-4b86-beec-0a5fdb99da12 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:32.041120 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e0b64b-52cd-4b86-beec-0a5fdb99da12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:08:32.042521 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e0b64b-52cd-4b86-beec-0a5fdb99da12 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:08:32.050353 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 635/1301] 10.222.0.42 () {56 vars in 1087 bytes} [Mon Jul 4 09:08:31 2022] GET /identity/v3/services => generated 2191 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:08:34.057932 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8514e0-38ef-44e4-a136-6428854c56ae None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:34.058826 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8514e0-38ef-44e4-a136-6428854c56ae None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:34.058826 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8514e0-38ef-44e4-a136-6428854c56ae None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:34.060921 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 667/1302] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:08:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:08:34.068767 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f34da6-9208-4566-afe8-89970abb056b None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:34.069362 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f34da6-9208-4566-afe8-89970abb056b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:34.069362 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f34da6-9208-4566-afe8-89970abb056b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:34.088504 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-a2f34da6-9208-4566-afe8-89970abb056b None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:08:34.089695 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a2f34da6-9208-4566-afe8-89970abb056b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:08:34.163237 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 636/1303] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:08:34 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 09:08:34.186520 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8514e0-38ef-44e4-a136-6428854c56ae None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:08:34.288458 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:08:34.295764 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8514e0-38ef-44e4-a136-6428854c56ae None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:08:34.329953 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a65c96a-fd36-485e-977b-6a9cdd0af500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:08:34.330735 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a65c96a-fd36-485e-977b-6a9cdd0af500 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:34.331016 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a65c96a-fd36-485e-977b-6a9cdd0af500 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:34.331287 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a65c96a-fd36-485e-977b-6a9cdd0af500 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:34.331969 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a65c96a-fd36-485e-977b-6a9cdd0af500 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:08:34.333339 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a65c96a-fd36-485e-977b-6a9cdd0af500 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:08:34.345239 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-9a65c96a-fd36-485e-977b-6a9cdd0af500 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 04 09:08:34.345239 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:08:34.345239 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 09:08:34.345239 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 09:08:34.345239 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 09:08:34.345239 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 09:08:34.345239 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 09:08:34.345239 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:08:34.345239 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 04 09:08:34.345239 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:08:34.345239 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:08:34.345239 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:08:34.345239 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:08:34.345239 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:08:34.345239 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:08:34.345239 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:08:34.345239 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:08:34.346474 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:08:34.346474 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:08:34.346474 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:08:34.346474 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:08:34.346474 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:08:34.346474 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:08:34.346474 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 09:08:34.346474 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 09:08:34.346474 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 09:08:34.346474 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 09:08:34.346474 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:08:34.346474 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:08:34.346474 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:08:34.346474 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:08:34.346474 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:08:34.346474 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:08:34.347434 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:08:34.347434 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 04 09:08:34.347434 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:08:34.347434 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:08:34.347434 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:08:34.347434 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:08:34.347434 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:08:34.347434 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:08:34.347434 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:08:34.347434 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:08:34.347434 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 09:08:34.347434 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:08:34.347434 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 04 09:08:34.347434 dv-cinder-844563-4-smb devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 04 09:08:34.347434 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 668/1304] 10.222.0.42 () {56 vars in 1117 bytes} [Mon Jul 4 09:08:34 2022] GET /identity/v3/services/placement => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:08:34.353811 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f34da6-9208-4566-afe8-89970abb056b None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:08:34.434696 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:08:34.468077 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f34da6-9208-4566-afe8-89970abb056b None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:08:34.503542 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660233ca-8f5f-4f68-9279-0b69f461d03d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:08:34.504227 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660233ca-8f5f-4f68-9279-0b69f461d03d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:34.504507 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660233ca-8f5f-4f68-9279-0b69f461d03d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:34.504784 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660233ca-8f5f-4f68-9279-0b69f461d03d None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:34.505494 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660233ca-8f5f-4f68-9279-0b69f461d03d None admin] RBAC: Adding query filter params (name=placement) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:08:34.505804 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660233ca-8f5f-4f68-9279-0b69f461d03d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:08:34.507201 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660233ca-8f5f-4f68-9279-0b69f461d03d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:08:34.512392 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 637/1305] 10.222.0.42 () {56 vars in 1116 bytes} [Mon Jul 4 09:08:34 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:08:34.521297 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a65c96a-fd36-485e-977b-6a9cdd0af500 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:08:34.632296 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a65c96a-fd36-485e-977b-6a9cdd0af500 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:08:34.670171 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c43e7c-3524-4bff-81dc-f7f6c95685df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:08:34.670832 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c43e7c-3524-4bff-81dc-f7f6c95685df None admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:08:34.671114 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c43e7c-3524-4bff-81dc-f7f6c95685df None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:08:34.671388 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c43e7c-3524-4bff-81dc-f7f6c95685df None admin] PATH_INFO: `/v3/endpoints` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:08:34.672169 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c43e7c-3524-4bff-81dc-f7f6c95685df None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:08:34.673554 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c43e7c-3524-4bff-81dc-f7f6c95685df None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:08:34.696387 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 669/1306] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Jul 4 09:08:34 2022] POST /identity/v3/endpoints => generated 331 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:08:44.509326 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=30 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:08:44.692491 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:37.439206 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5489044-7f41-4d18-8b72-636963d625bc None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:37.440353 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5489044-7f41-4d18-8b72-636963d625bc None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:37.440853 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5489044-7f41-4d18-8b72-636963d625bc None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:37.448364 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02589644-ddda-4607-8666-8ea630abbaea None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:37.448772 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02589644-ddda-4607-8666-8ea630abbaea None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:37.449121 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02589644-ddda-4607-8666-8ea630abbaea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:37.452066 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 638/1307] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:09:37 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:09:37.634583 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-02589644-ddda-4607-8666-8ea630abbaea None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:09:37.636238 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-02589644-ddda-4607-8666-8ea630abbaea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:09:37.800021 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 670/1308] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:09:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:09:37.839902 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da4822-b15c-4c4a-a5b1-03f948297276 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:37.840215 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da4822-b15c-4c4a-a5b1-03f948297276 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:37.840720 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da4822-b15c-4c4a-a5b1-03f948297276 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:37.842175 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 639/1309] 10.222.0.42 () {54 vars in 964 bytes} [Mon Jul 4 09:09:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:09:37.848338 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b00f333-2c1b-4143-92f9-1f4b5e34d1f6 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:37.848630 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b00f333-2c1b-4143-92f9-1f4b5e34d1f6 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:37.848908 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b00f333-2c1b-4143-92f9-1f4b5e34d1f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:37.932194 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-3b00f333-2c1b-4143-92f9-1f4b5e34d1f6 None None] MFA Rules not processed for user `4db0575f076240559f64e9548b56ffeb`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:09:37.933483 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-3b00f333-2c1b-4143-92f9-1f4b5e34d1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:09:37.955773 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:38.016569 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 671/1310] 10.222.0.42 () {58 vars in 1061 bytes} [Mon Jul 4 09:09:37 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:09:38.025730 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01da4822-b15c-4c4a-a5b1-03f948297276 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:38.027730 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-01da4822-b15c-4c4a-a5b1-03f948297276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:09:38.143092 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01da4822-b15c-4c4a-a5b1-03f948297276 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:38.218762 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63162b9-25a2-4b98-ac27-c009b7d81396 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:38.219415 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63162b9-25a2-4b98-ac27-c009b7d81396 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:38.219696 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63162b9-25a2-4b98-ac27-c009b7d81396 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:38.220012 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63162b9-25a2-4b98-ac27-c009b7d81396 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:38.221665 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f63162b9-25a2-4b98-ac27-c009b7d81396 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:09:38.277799 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:38.336004 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63162b9-25a2-4b98-ac27-c009b7d81396 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:38.337587 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63162b9-25a2-4b98-ac27-c009b7d81396 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:38.357988 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 640/1311] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:09:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:09:40.730085 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7139a4-029e-41ec-964c-f237283b5da0 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:40.730651 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7139a4-029e-41ec-964c-f237283b5da0 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:40.730757 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7139a4-029e-41ec-964c-f237283b5da0 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:40.732571 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 672/1312] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:09:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:09:40.738073 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e93b3c5-5ceb-4212-8159-fa2b363efaee None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:40.738578 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e93b3c5-5ceb-4212-8159-fa2b363efaee None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:40.738667 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e93b3c5-5ceb-4212-8159-fa2b363efaee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:40.830944 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-8e93b3c5-5ceb-4212-8159-fa2b363efaee None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:09:40.832277 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-8e93b3c5-5ceb-4212-8159-fa2b363efaee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:09:40.956909 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 641/1313] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:09:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:09:40.995687 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7139a4-029e-41ec-964c-f237283b5da0 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:40.997234 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-0a7139a4-029e-41ec-964c-f237283b5da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:09:41.127832 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7139a4-029e-41ec-964c-f237283b5da0 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:41.200621 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:41.203250 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe07e6a-5b11-4415-9ae9-68422f628ca7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:41.203897 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe07e6a-5b11-4415-9ae9-68422f628ca7 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:41.204198 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe07e6a-5b11-4415-9ae9-68422f628ca7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:41.204480 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe07e6a-5b11-4415-9ae9-68422f628ca7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:41.206613 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-cbe07e6a-5b11-4415-9ae9-68422f628ca7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:09:41.319137 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe07e6a-5b11-4415-9ae9-68422f628ca7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:41.320629 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe07e6a-5b11-4415-9ae9-68422f628ca7 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:41.340923 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 673/1314] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:09:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:09:43.660935 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35783960-37c0-4d15-8c42-d0df0ae01d82 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:43.661464 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35783960-37c0-4d15-8c42-d0df0ae01d82 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:43.661464 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35783960-37c0-4d15-8c42-d0df0ae01d82 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:43.663511 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 642/1315] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:09:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:09:43.672316 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dda463f-ea43-4040-bc63-71cfd916ad50 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:43.672722 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dda463f-ea43-4040-bc63-71cfd916ad50 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:43.672940 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dda463f-ea43-4040-bc63-71cfd916ad50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:43.739767 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-3dda463f-ea43-4040-bc63-71cfd916ad50 None None] MFA Rules not processed for user `cbeb03f2771e4aac8c0ee7d37e9ad2e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:09:43.741016 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-3dda463f-ea43-4040-bc63-71cfd916ad50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:09:43.796382 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:43.842367 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 674/1316] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:09:43 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:09:43.883093 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35783960-37c0-4d15-8c42-d0df0ae01d82 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:43.885566 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-35783960-37c0-4d15-8c42-d0df0ae01d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:09:43.901291 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:44.010542 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35783960-37c0-4d15-8c42-d0df0ae01d82 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:44.086478 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab600c54-ab06-4389-9370-2ec5de25fa94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:44.087118 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab600c54-ab06-4389-9370-2ec5de25fa94 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:44.087396 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab600c54-ab06-4389-9370-2ec5de25fa94 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:44.087680 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab600c54-ab06-4389-9370-2ec5de25fa94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:44.089360 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ab600c54-ab06-4389-9370-2ec5de25fa94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:09:44.153073 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:44.209562 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab600c54-ab06-4389-9370-2ec5de25fa94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:44.211807 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab600c54-ab06-4389-9370-2ec5de25fa94 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:44.241789 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 643/1317] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:09:43 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 09:09:46.824133 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c64b393-9a48-457a-9e60-2ba3d84ddf85 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:46.825026 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c64b393-9a48-457a-9e60-2ba3d84ddf85 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:46.825026 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c64b393-9a48-457a-9e60-2ba3d84ddf85 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:46.827138 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 675/1318] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:09:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:09:46.835701 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc38002-de05-4414-86e0-f273270e0bf3 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:46.836151 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc38002-de05-4414-86e0-f273270e0bf3 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:46.836313 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc38002-de05-4414-86e0-f273270e0bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:46.915174 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-0cc38002-de05-4414-86e0-f273270e0bf3 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:09:46.916307 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0cc38002-de05-4414-86e0-f273270e0bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:09:47.021807 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 644/1319] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:09:46 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:09:47.060285 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c64b393-9a48-457a-9e60-2ba3d84ddf85 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:47.061827 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-2c64b393-9a48-457a-9e60-2ba3d84ddf85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:09:47.178500 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c64b393-9a48-457a-9e60-2ba3d84ddf85 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:47.260567 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83ab521-96f2-47f9-a500-51206255ffc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:47.261221 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ab521-96f2-47f9-a500-51206255ffc5 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:47.261512 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ab521-96f2-47f9-a500-51206255ffc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:47.261787 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ab521-96f2-47f9-a500-51206255ffc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:47.263444 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-a83ab521-96f2-47f9-a500-51206255ffc5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:09:47.271245 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:47.376162 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83ab521-96f2-47f9-a500-51206255ffc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:47.377607 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83ab521-96f2-47f9-a500-51206255ffc5 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:47.395904 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 676/1320] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:09:47 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:09:50.070629 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f5494-9667-4742-838f-e49882231f22 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:50.071224 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f5494-9667-4742-838f-e49882231f22 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:50.071224 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f5494-9667-4742-838f-e49882231f22 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:50.072620 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 645/1321] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:09:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:09:50.078023 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc05f0-34c3-4d35-96a0-4010eb2eef3b None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:50.078454 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc05f0-34c3-4d35-96a0-4010eb2eef3b None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:50.078566 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc05f0-34c3-4d35-96a0-4010eb2eef3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:50.146258 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-21cc05f0-34c3-4d35-96a0-4010eb2eef3b None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:09:50.147392 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-21cc05f0-34c3-4d35-96a0-4010eb2eef3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:09:50.208227 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:50.254128 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 677/1322] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:09:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:09:50.290055 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52f5494-9667-4742-838f-e49882231f22 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:50.291706 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d52f5494-9667-4742-838f-e49882231f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:09:50.313294 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:50.411415 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52f5494-9667-4742-838f-e49882231f22 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:50.485362 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f08a4a3-1dde-4082-aba6-15d133276111 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:50.486010 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08a4a3-1dde-4082-aba6-15d133276111 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:50.486296 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08a4a3-1dde-4082-aba6-15d133276111 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:50.486572 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08a4a3-1dde-4082-aba6-15d133276111 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:50.488294 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-4f08a4a3-1dde-4082-aba6-15d133276111 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:09:50.562607 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:50.602175 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f08a4a3-1dde-4082-aba6-15d133276111 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:50.603665 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f08a4a3-1dde-4082-aba6-15d133276111 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:50.623666 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 646/1323] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:09:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:09:52.670662 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc6c26-6c97-4287-9c2c-0afad13769b2 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:52.671205 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc6c26-6c97-4287-9c2c-0afad13769b2 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:52.671205 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc6c26-6c97-4287-9c2c-0afad13769b2 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:52.672797 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 678/1324] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:09:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:09:52.678210 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790cb87-5fc8-4c67-b323-a0a734b50e30 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:52.678676 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790cb87-5fc8-4c67-b323-a0a734b50e30 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:52.678928 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790cb87-5fc8-4c67-b323-a0a734b50e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:52.750753 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-f790cb87-5fc8-4c67-b323-a0a734b50e30 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:09:52.751939 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f790cb87-5fc8-4c67-b323-a0a734b50e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:09:52.850675 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 647/1325] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:09:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:09:52.886155 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bc6c26-6c97-4287-9c2c-0afad13769b2 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:52.887836 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-97bc6c26-6c97-4287-9c2c-0afad13769b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:09:53.000280 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bc6c26-6c97-4287-9c2c-0afad13769b2 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:53.079155 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c633c9-1fd1-4902-910d-3cc518b23b4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:53.079815 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c633c9-1fd1-4902-910d-3cc518b23b4e service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:53.080124 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c633c9-1fd1-4902-910d-3cc518b23b4e service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:53.080396 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c633c9-1fd1-4902-910d-3cc518b23b4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:53.082155 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-e3c633c9-1fd1-4902-910d-3cc518b23b4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:09:53.100085 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:53.194726 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c633c9-1fd1-4902-910d-3cc518b23b4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:53.196233 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c633c9-1fd1-4902-910d-3cc518b23b4e service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:53.215156 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 679/1326] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:09:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:09:55.317095 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3b849-39f0-4741-93a4-b6b576aa80f1 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:55.317626 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3b849-39f0-4741-93a4-b6b576aa80f1 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:55.317721 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3b849-39f0-4741-93a4-b6b576aa80f1 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:55.319226 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 648/1327] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:09:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:09:55.325120 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67fc55a-2433-4f4f-acc4-d7082a84fa85 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:55.325624 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67fc55a-2433-4f4f-acc4-d7082a84fa85 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:55.325719 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67fc55a-2433-4f4f-acc4-d7082a84fa85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:55.397224 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-a67fc55a-2433-4f4f-acc4-d7082a84fa85 None None] MFA Rules not processed for user `cbeb03f2771e4aac8c0ee7d37e9ad2e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:09:55.398477 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-a67fc55a-2433-4f4f-acc4-d7082a84fa85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:09:55.468094 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:55.502685 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 680/1328] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:09:55 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:09:55.553477 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedca227-5eb4-4e79-9d88-15961b805aa5 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:55.553882 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedca227-5eb4-4e79-9d88-15961b805aa5 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:55.554220 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedca227-5eb4-4e79-9d88-15961b805aa5 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:55.555651 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 649/1329] 10.222.0.42 () {54 vars in 964 bytes} [Mon Jul 4 09:09:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:09:55.561671 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2f5d8-b9dd-465b-98ad-5ff4a9db6c21 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:55.561957 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2f5d8-b9dd-465b-98ad-5ff4a9db6c21 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:55.562232 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2f5d8-b9dd-465b-98ad-5ff4a9db6c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:55.637211 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-63c2f5d8-b9dd-465b-98ad-5ff4a9db6c21 None None] MFA Rules not processed for user `4db0575f076240559f64e9548b56ffeb`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:09:55.638415 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-63c2f5d8-b9dd-465b-98ad-5ff4a9db6c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:09:55.713585 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 681/1330] 10.222.0.42 () {58 vars in 1061 bytes} [Mon Jul 4 09:09:55 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:09:55.722655 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedca227-5eb4-4e79-9d88-15961b805aa5 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:55.724189 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-eedca227-5eb4-4e79-9d88-15961b805aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:09:55.756656 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:55.846688 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedca227-5eb4-4e79-9d88-15961b805aa5 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:55.923831 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d74a47-e5e0-4ab7-b01d-bbd9d6b461af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:55.924517 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d74a47-e5e0-4ab7-b01d-bbd9d6b461af service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:55.924799 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d74a47-e5e0-4ab7-b01d-bbd9d6b461af service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:55.925074 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d74a47-e5e0-4ab7-b01d-bbd9d6b461af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:55.926723 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d3d74a47-e5e0-4ab7-b01d-bbd9d6b461af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:09:56.007166 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:56.039728 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d74a47-e5e0-4ab7-b01d-bbd9d6b461af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:56.041207 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d74a47-e5e0-4ab7-b01d-bbd9d6b461af service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:56.059477 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 650/1331] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:09:55 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 09:09:58.725441 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17899b73-6e11-4c21-9302-dd295e7ddbc9 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:58.726040 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17899b73-6e11-4c21-9302-dd295e7ddbc9 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:58.726040 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17899b73-6e11-4c21-9302-dd295e7ddbc9 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:58.727382 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 682/1332] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:09:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:09:58.733117 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba13241d-1eff-4fc6-8501-d5c75f667df6 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:58.733553 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba13241d-1eff-4fc6-8501-d5c75f667df6 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:58.733648 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba13241d-1eff-4fc6-8501-d5c75f667df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:58.799279 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-ba13241d-1eff-4fc6-8501-d5c75f667df6 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:09:58.800502 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ba13241d-1eff-4fc6-8501-d5c75f667df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:09:58.914460 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 651/1333] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:09:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:09:58.953149 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17899b73-6e11-4c21-9302-dd295e7ddbc9 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:58.955498 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-17899b73-6e11-4c21-9302-dd295e7ddbc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:09:59.037015 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:59.076018 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17899b73-6e11-4c21-9302-dd295e7ddbc9 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:59.150539 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fee8a2-e185-45a9-acf7-364c24936e39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:59.151182 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fee8a2-e185-45a9-acf7-364c24936e39 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:59.151460 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fee8a2-e185-45a9-acf7-364c24936e39 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:59.151731 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fee8a2-e185-45a9-acf7-364c24936e39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:59.153384 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-61fee8a2-e185-45a9-acf7-364c24936e39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:09:59.267532 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fee8a2-e185-45a9-acf7-364c24936e39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:59.269034 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fee8a2-e185-45a9-acf7-364c24936e39 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:59.280706 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:59.290870 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 683/1334] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:09:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:10:01.371295 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437274ba-3fc6-4d13-b475-327c005fe194 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:01.371911 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437274ba-3fc6-4d13-b475-327c005fe194 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:01.371911 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437274ba-3fc6-4d13-b475-327c005fe194 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:01.373293 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 652/1335] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:10:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:10:01.379863 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07994c1a-92cb-4e3c-bb65-c5d8460c976e None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:01.380592 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07994c1a-92cb-4e3c-bb65-c5d8460c976e None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:01.380834 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07994c1a-92cb-4e3c-bb65-c5d8460c976e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:01.452344 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-07994c1a-92cb-4e3c-bb65-c5d8460c976e None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:01.453550 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-07994c1a-92cb-4e3c-bb65-c5d8460c976e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:01.558613 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 684/1336] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:10:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:10:01.607237 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437274ba-3fc6-4d13-b475-327c005fe194 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:01.608786 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-437274ba-3fc6-4d13-b475-327c005fe194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:01.650719 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:01.735490 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437274ba-3fc6-4d13-b475-327c005fe194 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:01.814805 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d87da-2ce9-446e-9195-698bbed859b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:01.815357 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d87da-2ce9-446e-9195-698bbed859b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:01.815630 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d87da-2ce9-446e-9195-698bbed859b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:01.816007 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d87da-2ce9-446e-9195-698bbed859b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:01.817621 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c54d87da-2ce9-446e-9195-698bbed859b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:01.918494 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:01.944723 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54d87da-2ce9-446e-9195-698bbed859b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:01.946182 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54d87da-2ce9-446e-9195-698bbed859b3 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:01.964505 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 653/1337] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:10:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 09:10:04.329853 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef231e-b439-4c6d-8cfa-f923ae8bf9ed None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:04.330447 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef231e-b439-4c6d-8cfa-f923ae8bf9ed None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:04.330447 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef231e-b439-4c6d-8cfa-f923ae8bf9ed None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:04.331907 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 685/1338] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:10:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:10:04.338266 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef05cdb4-8c7d-4d0f-be6a-5f903eb04bc5 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:04.338948 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef05cdb4-8c7d-4d0f-be6a-5f903eb04bc5 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:04.339195 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef05cdb4-8c7d-4d0f-be6a-5f903eb04bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:04.417274 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-ef05cdb4-8c7d-4d0f-be6a-5f903eb04bc5 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:04.418498 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ef05cdb4-8c7d-4d0f-be6a-5f903eb04bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:04.519886 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 654/1339] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:10:04 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:10:04.556272 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ef231e-b439-4c6d-8cfa-f923ae8bf9ed None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:04.557878 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-f4ef231e-b439-4c6d-8cfa-f923ae8bf9ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:04.642050 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:04.670237 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ef231e-b439-4c6d-8cfa-f923ae8bf9ed None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:04.746340 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ead0208-50d4-473a-bcca-b057fd00b657 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:04.746998 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead0208-50d4-473a-bcca-b057fd00b657 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:04.747282 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead0208-50d4-473a-bcca-b057fd00b657 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:04.747560 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead0208-50d4-473a-bcca-b057fd00b657 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:04.749243 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-7ead0208-50d4-473a-bcca-b057fd00b657 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:04.875484 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ead0208-50d4-473a-bcca-b057fd00b657 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:04.876987 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ead0208-50d4-473a-bcca-b057fd00b657 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:04.899746 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 686/1340] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:10:04 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:10:09.045824 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df550394-74a2-4c61-a003-d76b2f051b51 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:09.046334 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df550394-74a2-4c61-a003-d76b2f051b51 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:09.046334 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df550394-74a2-4c61-a003-d76b2f051b51 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:09.047663 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 655/1341] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:10:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:10:09.053016 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301fd08-f332-419d-8275-192267abb856 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:09.053439 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301fd08-f332-419d-8275-192267abb856 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:09.053546 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301fd08-f332-419d-8275-192267abb856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:09.059918 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:09.125738 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-8301fd08-f332-419d-8275-192267abb856 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:09.126951 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-8301fd08-f332-419d-8275-192267abb856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:09.239352 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 687/1342] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:10:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:10:09.278277 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df550394-74a2-4c61-a003-d76b2f051b51 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:09.280870 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-df550394-74a2-4c61-a003-d76b2f051b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:09.333036 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:09.381557 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df550394-74a2-4c61-a003-d76b2f051b51 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:09.385233 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde7668f-864c-4fac-a8df-3c451b37dac1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:09.385881 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde7668f-864c-4fac-a8df-3c451b37dac1 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:09.386164 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde7668f-864c-4fac-a8df-3c451b37dac1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:09.386434 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde7668f-864c-4fac-a8df-3c451b37dac1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:09.395559 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde7668f-864c-4fac-a8df-3c451b37dac1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:09.397053 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde7668f-864c-4fac-a8df-3c451b37dac1 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:09.406583 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 656/1343] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:10:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:10:12.073963 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac9bd98-20d9-47b2-8dbc-42aa04347b8c None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:12.074563 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac9bd98-20d9-47b2-8dbc-42aa04347b8c None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:12.074563 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac9bd98-20d9-47b2-8dbc-42aa04347b8c None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:12.075977 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 688/1344] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:10:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:10:12.081587 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc744da-0e24-466c-b81c-c5ad7a92868f None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:12.082049 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc744da-0e24-466c-b81c-c5ad7a92868f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:12.082162 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc744da-0e24-466c-b81c-c5ad7a92868f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:12.114321 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-9cc744da-0e24-466c-b81c-c5ad7a92868f None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:12.115528 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9cc744da-0e24-466c-b81c-c5ad7a92868f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:12.202100 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 657/1345] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:10:12 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:10:12.240283 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac9bd98-20d9-47b2-8dbc-42aa04347b8c None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:12.253383 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac9bd98-20d9-47b2-8dbc-42aa04347b8c None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:12.257261 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60962fb1-e31f-4b7c-9a7c-6cca65d6aad3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:12.257922 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60962fb1-e31f-4b7c-9a7c-6cca65d6aad3 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:12.258208 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60962fb1-e31f-4b7c-9a7c-6cca65d6aad3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:12.258626 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60962fb1-e31f-4b7c-9a7c-6cca65d6aad3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:12.268913 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60962fb1-e31f-4b7c-9a7c-6cca65d6aad3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:12.270256 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60962fb1-e31f-4b7c-9a7c-6cca65d6aad3 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:12.281780 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 689/1346] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:10:12 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:10:16.263556 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e15f7-d0ac-4033-a701-4ae2a57fa215 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:16.264148 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e15f7-d0ac-4033-a701-4ae2a57fa215 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:16.264148 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e15f7-d0ac-4033-a701-4ae2a57fa215 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:16.265606 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 658/1347] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:10:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:10:16.271055 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b742d639-4f90-4b87-b573-827f1b761589 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:16.271479 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b742d639-4f90-4b87-b573-827f1b761589 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:16.271612 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b742d639-4f90-4b87-b573-827f1b761589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:16.289701 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-b742d639-4f90-4b87-b573-827f1b761589 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:16.290925 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-b742d639-4f90-4b87-b573-827f1b761589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:16.299213 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 690/1348] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:10:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:10:16.337170 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368e15f7-d0ac-4033-a701-4ae2a57fa215 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:16.348436 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368e15f7-d0ac-4033-a701-4ae2a57fa215 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:16.353689 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b9497c-0647-48c1-98d0-5613a266d7fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:16.354606 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b9497c-0647-48c1-98d0-5613a266d7fa service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:16.355010 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b9497c-0647-48c1-98d0-5613a266d7fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:16.355400 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b9497c-0647-48c1-98d0-5613a266d7fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:16.367205 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b9497c-0647-48c1-98d0-5613a266d7fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:16.368710 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b9497c-0647-48c1-98d0-5613a266d7fa service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:16.378722 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 659/1349] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:10:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:10:21.406587 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd735c5-66e3-439b-9797-53de94affa9c None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:21.407430 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd735c5-66e3-439b-9797-53de94affa9c None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:21.407916 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd735c5-66e3-439b-9797-53de94affa9c None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:21.409757 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 691/1350] 10.222.0.42 () {54 vars in 921 bytes} [Mon Jul 4 09:10:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:10:21.417491 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57dd280-cdee-4017-b2f5-4bded2dfddb6 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:21.418263 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57dd280-cdee-4017-b2f5-4bded2dfddb6 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:21.418700 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57dd280-cdee-4017-b2f5-4bded2dfddb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:21.498056 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-d57dd280-cdee-4017-b2f5-4bded2dfddb6 None None] MFA Rules not processed for user `46ec1a2091f1434cabc69066eb3b6725`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:21.499480 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d57dd280-cdee-4017-b2f5-4bded2dfddb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:21.527798 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:21.593885 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 660/1351] 10.222.0.42 () {58 vars in 1018 bytes} [Mon Jul 4 09:10:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:10:25.807900 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e905d3-ab1c-4e56-bc7a-4ae9bef06708 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:25.808478 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e905d3-ab1c-4e56-bc7a-4ae9bef06708 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:25.808478 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e905d3-ab1c-4e56-bc7a-4ae9bef06708 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:25.810095 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 692/1352] 10.222.0.42 () {54 vars in 921 bytes} [Mon Jul 4 09:10:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:10:25.815238 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a6c890-746f-425e-87bf-b6441f8ca9a8 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:25.816059 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a6c890-746f-425e-87bf-b6441f8ca9a8 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:25.816518 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a6c890-746f-425e-87bf-b6441f8ca9a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:25.837245 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-b8a6c890-746f-425e-87bf-b6441f8ca9a8 None None] MFA Rules not processed for user `46ec1a2091f1434cabc69066eb3b6725`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:25.838948 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b8a6c890-746f-425e-87bf-b6441f8ca9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:25.848989 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 661/1353] 10.222.0.42 () {58 vars in 1018 bytes} [Mon Jul 4 09:10:25 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:10:26.284318 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=72 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:27.165291 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bc4d18-fbc6-472f-8f6e-af7a02e4cab7 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:27.165980 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bc4d18-fbc6-472f-8f6e-af7a02e4cab7 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:27.165980 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bc4d18-fbc6-472f-8f6e-af7a02e4cab7 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:27.167192 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 693/1354] 10.222.0.42 () {54 vars in 921 bytes} [Mon Jul 4 09:10:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:10:27.172370 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0bb026-7079-4abd-9f3a-0cd97bbfa4d0 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:27.172799 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0bb026-7079-4abd-9f3a-0cd97bbfa4d0 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:27.173137 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0bb026-7079-4abd-9f3a-0cd97bbfa4d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:27.192004 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-1a0bb026-7079-4abd-9f3a-0cd97bbfa4d0 None None] MFA Rules not processed for user `46ec1a2091f1434cabc69066eb3b6725`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:27.193202 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-1a0bb026-7079-4abd-9f3a-0cd97bbfa4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:27.202281 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 662/1355] 10.222.0.42 () {58 vars in 1018 bytes} [Mon Jul 4 09:10:27 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:10:30.863014 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ada140-7662-4eb5-9c41-ae0913e78c12 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:30.863538 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ada140-7662-4eb5-9c41-ae0913e78c12 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:30.863538 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ada140-7662-4eb5-9c41-ae0913e78c12 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:30.865665 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 694/1356] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:10:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:10:30.871190 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27520971-6044-4879-9afc-e512c8709e2e None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:30.871664 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27520971-6044-4879-9afc-e512c8709e2e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:30.871761 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27520971-6044-4879-9afc-e512c8709e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:30.904888 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-27520971-6044-4879-9afc-e512c8709e2e None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:30.906328 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-27520971-6044-4879-9afc-e512c8709e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:30.914898 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 663/1357] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:10:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:10:30.972389 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84302a5-dd73-4b12-94d6-665acd011c58 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:30.972678 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84302a5-dd73-4b12-94d6-665acd011c58 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:30.972956 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84302a5-dd73-4b12-94d6-665acd011c58 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:30.974521 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 695/1358] 10.222.0.42 () {54 vars in 961 bytes} [Mon Jul 4 09:10:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:10:30.982659 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fdff59-2aad-42be-8a86-cd3e9bd89de2 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:30.983282 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fdff59-2aad-42be-8a86-cd3e9bd89de2 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:30.984050 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fdff59-2aad-42be-8a86-cd3e9bd89de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:31.040756 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-c4fdff59-2aad-42be-8a86-cd3e9bd89de2 None None] MFA Rules not processed for user `af3b6e252a8c434a99432bcece6493b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:31.041890 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c4fdff59-2aad-42be-8a86-cd3e9bd89de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:31.126406 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 664/1359] 10.222.0.42 () {58 vars in 1058 bytes} [Mon Jul 4 09:10:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:10:31.134464 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84302a5-dd73-4b12-94d6-665acd011c58 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:31.148784 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84302a5-dd73-4b12-94d6-665acd011c58 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:31.155513 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4409885b-4dfe-4a1d-b66a-ab46d3ca556b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3b6e252a8c434a99432bcece6493b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:31.156208 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4409885b-4dfe-4a1d-b66a-ab46d3ca556b service nova] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:31.156490 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4409885b-4dfe-4a1d-b66a-ab46d3ca556b service nova] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:31.156767 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4409885b-4dfe-4a1d-b66a-ab46d3ca556b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:31.165845 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4409885b-4dfe-4a1d-b66a-ab46d3ca556b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:31.167588 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4409885b-4dfe-4a1d-b66a-ab46d3ca556b service nova] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:31.178216 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 696/1360] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:10:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:10:33.393317 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e164b649-2bd8-42a5-9878-0f9e173b55e3 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:33.393879 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e164b649-2bd8-42a5-9878-0f9e173b55e3 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:33.393879 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e164b649-2bd8-42a5-9878-0f9e173b55e3 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:33.395246 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 665/1361] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:10:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:10:33.400688 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d41340-9be6-49e2-8318-3525351fe4f0 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:33.401147 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d41340-9be6-49e2-8318-3525351fe4f0 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:33.401230 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d41340-9be6-49e2-8318-3525351fe4f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:33.422038 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-49d41340-9be6-49e2-8318-3525351fe4f0 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:33.423257 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-49d41340-9be6-49e2-8318-3525351fe4f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:33.433755 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 697/1362] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:10:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:10:33.479378 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e164b649-2bd8-42a5-9878-0f9e173b55e3 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:33.494912 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e164b649-2bd8-42a5-9878-0f9e173b55e3 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:33.500540 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd5edfd-9f18-4566-b9fe-7ae242f81e4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3b6e252a8c434a99432bcece6493b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:33.501181 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd5edfd-9f18-4566-b9fe-7ae242f81e4f service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:33.501462 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd5edfd-9f18-4566-b9fe-7ae242f81e4f service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:33.501740 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd5edfd-9f18-4566-b9fe-7ae242f81e4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:33.510764 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd5edfd-9f18-4566-b9fe-7ae242f81e4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:33.512346 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd5edfd-9f18-4566-b9fe-7ae242f81e4f service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:33.522346 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 666/1363] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:10:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:10:35.845996 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f8a34-71b0-4101-a119-6a5143e3e53e None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:35.846489 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f8a34-71b0-4101-a119-6a5143e3e53e None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:35.846589 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f8a34-71b0-4101-a119-6a5143e3e53e None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:35.847995 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 698/1364] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:10:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:10:35.853331 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521dc4f-6ea0-4539-9378-03a159649ce9 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:35.853753 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521dc4f-6ea0-4539-9378-03a159649ce9 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:35.853867 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521dc4f-6ea0-4539-9378-03a159649ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:35.875366 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-a521dc4f-6ea0-4539-9378-03a159649ce9 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:35.876733 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a521dc4f-6ea0-4539-9378-03a159649ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:35.890274 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 667/1365] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:10:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:10:35.936539 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a73cb-65b0-4dd7-92e4-1c37c50a7f78 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:35.936748 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a73cb-65b0-4dd7-92e4-1c37c50a7f78 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:35.937016 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a73cb-65b0-4dd7-92e4-1c37c50a7f78 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:35.938400 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 699/1366] 10.222.0.42 () {54 vars in 961 bytes} [Mon Jul 4 09:10:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:10:35.945436 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3848e-0fc9-4777-bcbf-faef8b88e297 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:35.946009 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3848e-0fc9-4777-bcbf-faef8b88e297 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:35.946456 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3848e-0fc9-4777-bcbf-faef8b88e297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:35.965155 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-36c3848e-0fc9-4777-bcbf-faef8b88e297 None None] MFA Rules not processed for user `af3b6e252a8c434a99432bcece6493b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:35.966539 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-36c3848e-0fc9-4777-bcbf-faef8b88e297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:35.975601 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 668/1367] 10.222.0.42 () {58 vars in 1058 bytes} [Mon Jul 4 09:10:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:10:35.983635 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85a73cb-65b0-4dd7-92e4-1c37c50a7f78 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:35.998021 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85a73cb-65b0-4dd7-92e4-1c37c50a7f78 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:36.003708 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056bf9ad-f5c9-458b-ac51-e79947a6ab8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3b6e252a8c434a99432bcece6493b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:36.004438 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056bf9ad-f5c9-458b-ac51-e79947a6ab8c service nova] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:36.004780 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056bf9ad-f5c9-458b-ac51-e79947a6ab8c service nova] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:36.005114 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056bf9ad-f5c9-458b-ac51-e79947a6ab8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:36.013599 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056bf9ad-f5c9-458b-ac51-e79947a6ab8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:36.015325 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056bf9ad-f5c9-458b-ac51-e79947a6ab8c service nova] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:36.025338 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 700/1368] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:10:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:10:38.089237 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4992e61-bec2-4b25-9086-0956da0e7d83 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:38.089751 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4992e61-bec2-4b25-9086-0956da0e7d83 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:38.090249 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4992e61-bec2-4b25-9086-0956da0e7d83 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:38.091790 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 669/1369] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:10:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:10:38.097208 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a3624-37d9-4095-9e4a-16375da66376 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:38.097633 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a3624-37d9-4095-9e4a-16375da66376 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:38.097738 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a3624-37d9-4095-9e4a-16375da66376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:38.117322 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-9f7a3624-37d9-4095-9e4a-16375da66376 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:38.118681 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-9f7a3624-37d9-4095-9e4a-16375da66376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:38.127759 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 701/1370] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:10:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:10:38.171145 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4992e61-bec2-4b25-9086-0956da0e7d83 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:38.187613 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4992e61-bec2-4b25-9086-0956da0e7d83 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:38.193954 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a167c56c-3e52-4290-bc3b-03886833724b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3b6e252a8c434a99432bcece6493b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:38.194801 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a167c56c-3e52-4290-bc3b-03886833724b service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:38.195193 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a167c56c-3e52-4290-bc3b-03886833724b service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:38.195568 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a167c56c-3e52-4290-bc3b-03886833724b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:38.205721 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a167c56c-3e52-4290-bc3b-03886833724b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:38.207523 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a167c56c-3e52-4290-bc3b-03886833724b service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:38.219162 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 670/1371] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:10:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 09:10:38.863022 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf53b0-c53f-4f10-8d53-1e34db053949 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:38.863468 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf53b0-c53f-4f10-8d53-1e34db053949 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:38.863990 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf53b0-c53f-4f10-8d53-1e34db053949 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:38.865670 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 702/1372] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:10:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:10:38.870920 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e52737-824e-406d-8b8b-db2cbd1bb283 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:38.871177 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e52737-824e-406d-8b8b-db2cbd1bb283 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:38.871675 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e52737-824e-406d-8b8b-db2cbd1bb283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:38.891599 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-a0e52737-824e-406d-8b8b-db2cbd1bb283 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:38.893726 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a0e52737-824e-406d-8b8b-db2cbd1bb283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:38.902257 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 671/1373] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:10:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:10:39.206614 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9c5194-884e-4213-80c7-bc31cb3349be None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:39.207646 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9c5194-884e-4213-80c7-bc31cb3349be None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:39.208087 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9c5194-884e-4213-80c7-bc31cb3349be None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:39.210005 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 703/1374] 10.222.0.42 () {54 vars in 963 bytes} [Mon Jul 4 09:10:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:10:39.215171 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25813602-d3a4-470b-a067-668136cae3eb None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:39.216016 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25813602-d3a4-470b-a067-668136cae3eb None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:39.216452 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25813602-d3a4-470b-a067-668136cae3eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:39.223827 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:39.273827 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-25813602-d3a4-470b-a067-668136cae3eb None None] MFA Rules not processed for user `08f86373d65440da97c853fff3c1d0d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:39.275144 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-25813602-d3a4-470b-a067-668136cae3eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:39.338602 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 672/1375] 10.222.0.42 () {58 vars in 1060 bytes} [Mon Jul 4 09:10:39 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:10:39.347149 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9c5194-884e-4213-80c7-bc31cb3349be None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:39.360833 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9c5194-884e-4213-80c7-bc31cb3349be None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:39.365333 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6cbe1d-7cd7-4e93-ac4d-7fb99ea63e2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f86373d65440da97c853fff3c1d0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:39.366169 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6cbe1d-7cd7-4e93-ac4d-7fb99ea63e2e service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:39.366598 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6cbe1d-7cd7-4e93-ac4d-7fb99ea63e2e service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:39.367047 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6cbe1d-7cd7-4e93-ac4d-7fb99ea63e2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:39.378146 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6cbe1d-7cd7-4e93-ac4d-7fb99ea63e2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:39.379959 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6cbe1d-7cd7-4e93-ac4d-7fb99ea63e2e service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:39.401731 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 704/1376] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:10:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:10:40.285685 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98178bae-b011-4e20-ad10-5a963cd7f439 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:40.286254 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98178bae-b011-4e20-ad10-5a963cd7f439 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:40.286254 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98178bae-b011-4e20-ad10-5a963cd7f439 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:40.287779 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 673/1377] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:10:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:10:40.292784 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0456789-ec62-4b5b-931c-efa92c312eae None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:40.293228 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0456789-ec62-4b5b-931c-efa92c312eae None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:40.293382 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0456789-ec62-4b5b-931c-efa92c312eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:40.311096 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-a0456789-ec62-4b5b-931c-efa92c312eae None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:40.312404 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-a0456789-ec62-4b5b-931c-efa92c312eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:40.320270 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 705/1378] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:10:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:10:40.365548 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98178bae-b011-4e20-ad10-5a963cd7f439 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:40.380011 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98178bae-b011-4e20-ad10-5a963cd7f439 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:40.385281 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5106871b-0cb9-4f0a-a778-aadd669cf35e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3b6e252a8c434a99432bcece6493b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:40.385909 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5106871b-0cb9-4f0a-a778-aadd669cf35e service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:40.386189 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5106871b-0cb9-4f0a-a778-aadd669cf35e service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:40.386462 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5106871b-0cb9-4f0a-a778-aadd669cf35e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:40.395090 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5106871b-0cb9-4f0a-a778-aadd669cf35e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:40.396715 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5106871b-0cb9-4f0a-a778-aadd669cf35e service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:40.406623 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 674/1379] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:10:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:10:42.439764 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6187304-da5a-4c34-82a7-5fc879b41e1b None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:42.440381 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6187304-da5a-4c34-82a7-5fc879b41e1b None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:42.440381 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6187304-da5a-4c34-82a7-5fc879b41e1b None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:42.441756 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 706/1380] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:10:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:10:42.449805 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b11c5-5540-4606-90e9-ec0218a2c132 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:42.450718 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b11c5-5540-4606-90e9-ec0218a2c132 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:42.451187 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b11c5-5540-4606-90e9-ec0218a2c132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:42.472980 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-4a5b11c5-5540-4606-90e9-ec0218a2c132 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:42.474524 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-4a5b11c5-5540-4606-90e9-ec0218a2c132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:42.482751 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 675/1381] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:10:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:10:42.526449 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6187304-da5a-4c34-82a7-5fc879b41e1b None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:42.541383 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6187304-da5a-4c34-82a7-5fc879b41e1b None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:42.548136 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc11e6b8-e9ae-445c-8a1e-a7c234769a6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3b6e252a8c434a99432bcece6493b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:42.548780 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc11e6b8-e9ae-445c-8a1e-a7c234769a6c service nova] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:42.549063 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc11e6b8-e9ae-445c-8a1e-a7c234769a6c service nova] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:42.549337 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc11e6b8-e9ae-445c-8a1e-a7c234769a6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:42.557772 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc11e6b8-e9ae-445c-8a1e-a7c234769a6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:42.560057 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc11e6b8-e9ae-445c-8a1e-a7c234769a6c service nova] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:42.571203 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 707/1382] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:10:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:10:44.631691 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390f761-68df-4cad-bb1d-e8ca45922a2f None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:44.632308 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390f761-68df-4cad-bb1d-e8ca45922a2f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:44.632480 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390f761-68df-4cad-bb1d-e8ca45922a2f None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:44.634094 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 676/1383] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:10:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:10:44.639314 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f1dbf5-23b4-4433-945c-63575d3cf23e None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:44.639754 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f1dbf5-23b4-4433-945c-63575d3cf23e None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:44.639889 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f1dbf5-23b4-4433-945c-63575d3cf23e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:44.657513 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-e4f1dbf5-23b4-4433-945c-63575d3cf23e None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:44.658788 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-e4f1dbf5-23b4-4433-945c-63575d3cf23e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:44.666806 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 708/1384] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:10:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:10:44.708388 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b390f761-68df-4cad-bb1d-e8ca45922a2f None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:44.723781 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b390f761-68df-4cad-bb1d-e8ca45922a2f None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:44.729362 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07368a59-3f6f-439f-ad0e-2bf6ea75705e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3b6e252a8c434a99432bcece6493b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:44.730207 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07368a59-3f6f-439f-ad0e-2bf6ea75705e service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:44.730900 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07368a59-3f6f-439f-ad0e-2bf6ea75705e service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:44.731269 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07368a59-3f6f-439f-ad0e-2bf6ea75705e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:44.740423 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07368a59-3f6f-439f-ad0e-2bf6ea75705e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:44.742218 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07368a59-3f6f-439f-ad0e-2bf6ea75705e service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:44.752630 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 677/1385] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:10:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:10:46.785453 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e45c9-f388-4dd9-8c1e-a073c2eb9ed1 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:46.785980 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e45c9-f388-4dd9-8c1e-a073c2eb9ed1 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:46.786594 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e45c9-f388-4dd9-8c1e-a073c2eb9ed1 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:46.789991 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 709/1386] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:10:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:10:46.794719 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b7789-f6fa-4370-af75-8fa6e5265687 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:46.795102 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b7789-f6fa-4370-af75-8fa6e5265687 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:46.795373 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b7789-f6fa-4370-af75-8fa6e5265687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:46.812986 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-895b7789-f6fa-4370-af75-8fa6e5265687 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:46.815411 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-895b7789-f6fa-4370-af75-8fa6e5265687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:46.832047 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 678/1387] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:10:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:10:46.871302 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014e45c9-f388-4dd9-8c1e-a073c2eb9ed1 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:46.886045 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014e45c9-f388-4dd9-8c1e-a073c2eb9ed1 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:46.892797 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dde65ce-6535-4b5c-aa60-a254ae884aca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3b6e252a8c434a99432bcece6493b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:46.894394 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde65ce-6535-4b5c-aa60-a254ae884aca service nova] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:46.894394 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde65ce-6535-4b5c-aa60-a254ae884aca service nova] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:46.894394 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde65ce-6535-4b5c-aa60-a254ae884aca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:46.902905 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dde65ce-6535-4b5c-aa60-a254ae884aca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:46.904599 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dde65ce-6535-4b5c-aa60-a254ae884aca service nova] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:46.916418 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 710/1388] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:10:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:10:48.947279 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dccd74-c464-4016-bccf-d225bb77d149 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:48.947822 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dccd74-c464-4016-bccf-d225bb77d149 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:48.947822 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dccd74-c464-4016-bccf-d225bb77d149 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:48.949253 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 679/1389] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:10:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:10:48.954871 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f613f36f-be82-4506-806c-cb947d3bf04d None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:48.955521 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f613f36f-be82-4506-806c-cb947d3bf04d None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:48.955521 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f613f36f-be82-4506-806c-cb947d3bf04d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:48.975482 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-f613f36f-be82-4506-806c-cb947d3bf04d None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:48.976742 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-f613f36f-be82-4506-806c-cb947d3bf04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:48.985802 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 711/1390] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:10:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:10:49.059230 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dccd74-c464-4016-bccf-d225bb77d149 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:49.075031 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dccd74-c464-4016-bccf-d225bb77d149 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:49.081445 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df9998f-b2bf-4000-83f6-7f89d08623ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3b6e252a8c434a99432bcece6493b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:49.082092 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df9998f-b2bf-4000-83f6-7f89d08623ac service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:49.082386 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df9998f-b2bf-4000-83f6-7f89d08623ac service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:49.082699 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df9998f-b2bf-4000-83f6-7f89d08623ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:49.092342 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df9998f-b2bf-4000-83f6-7f89d08623ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:49.094156 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df9998f-b2bf-4000-83f6-7f89d08623ac service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:49.103990 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 680/1391] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:10:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:10:51.155916 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290ea0ae-c429-43a7-b8c0-d6174cf414ef None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:51.156472 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290ea0ae-c429-43a7-b8c0-d6174cf414ef None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:51.156472 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290ea0ae-c429-43a7-b8c0-d6174cf414ef None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:51.157749 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 712/1392] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:10:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:10:51.163223 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac70e20-0f5f-40b8-9770-43f91a1d05b1 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:51.163789 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac70e20-0f5f-40b8-9770-43f91a1d05b1 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:51.163789 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac70e20-0f5f-40b8-9770-43f91a1d05b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:51.182287 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-4ac70e20-0f5f-40b8-9770-43f91a1d05b1 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:51.183514 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-4ac70e20-0f5f-40b8-9770-43f91a1d05b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:51.191986 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 681/1393] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:10:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:10:51.242013 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290ea0ae-c429-43a7-b8c0-d6174cf414ef None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:51.256542 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290ea0ae-c429-43a7-b8c0-d6174cf414ef None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:51.261802 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59ff009-58e8-4fe4-b020-07b780b6c17e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3b6e252a8c434a99432bcece6493b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:51.262414 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59ff009-58e8-4fe4-b020-07b780b6c17e service nova] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:51.262687 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59ff009-58e8-4fe4-b020-07b780b6c17e service nova] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:51.263028 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59ff009-58e8-4fe4-b020-07b780b6c17e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:51.271224 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59ff009-58e8-4fe4-b020-07b780b6c17e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:51.272756 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59ff009-58e8-4fe4-b020-07b780b6c17e service nova] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:51.282460 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 713/1394] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:10:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:10:53.302771 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bddae7-e5d2-403c-a521-7bcbeb10bab9 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:53.303308 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bddae7-e5d2-403c-a521-7bcbeb10bab9 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:53.303308 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bddae7-e5d2-403c-a521-7bcbeb10bab9 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:53.305391 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 682/1395] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:10:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:10:53.310261 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456d293-4540-4fcd-ab06-bf7ee18e18dc None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:53.310780 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456d293-4540-4fcd-ab06-bf7ee18e18dc None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:53.310780 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456d293-4540-4fcd-ab06-bf7ee18e18dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:53.330793 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-5456d293-4540-4fcd-ab06-bf7ee18e18dc None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:53.332050 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-5456d293-4540-4fcd-ab06-bf7ee18e18dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:53.340247 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 714/1396] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:10:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:10:53.384562 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bddae7-e5d2-403c-a521-7bcbeb10bab9 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:53.399670 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bddae7-e5d2-403c-a521-7bcbeb10bab9 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:53.405828 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97abe4b-b6ce-4063-80a8-e30c39c7808e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3b6e252a8c434a99432bcece6493b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:53.406500 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97abe4b-b6ce-4063-80a8-e30c39c7808e service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:53.406784 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97abe4b-b6ce-4063-80a8-e30c39c7808e service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:53.407056 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97abe4b-b6ce-4063-80a8-e30c39c7808e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:53.416058 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97abe4b-b6ce-4063-80a8-e30c39c7808e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:53.417673 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97abe4b-b6ce-4063-80a8-e30c39c7808e service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:53.427966 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 683/1397] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:10:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:10:54.775019 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4a0062-60cf-4d28-a96c-76e0749dfbc1 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:54.775580 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4a0062-60cf-4d28-a96c-76e0749dfbc1 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:54.775580 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4a0062-60cf-4d28-a96c-76e0749dfbc1 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:54.777141 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 715/1398] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:10:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:10:54.782592 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e80f92c-9eab-4060-8269-15b304c762ae None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:54.783013 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e80f92c-9eab-4060-8269-15b304c762ae None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:54.783136 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e80f92c-9eab-4060-8269-15b304c762ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:54.801823 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-5e80f92c-9eab-4060-8269-15b304c762ae None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:54.803025 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-5e80f92c-9eab-4060-8269-15b304c762ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:54.812048 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 684/1399] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:10:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:10:54.868117 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1215234b-fd48-491b-bb59-357d30d1ee18 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:54.868591 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1215234b-fd48-491b-bb59-357d30d1ee18 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:54.868962 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1215234b-fd48-491b-bb59-357d30d1ee18 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:54.870302 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 716/1400] 10.222.0.42 () {54 vars in 962 bytes} [Mon Jul 4 09:10:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:10:54.875669 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e3f5b3-089e-47f6-a1a9-f0ee0de5a77b None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:54.876142 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e3f5b3-089e-47f6-a1a9-f0ee0de5a77b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:54.876471 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e3f5b3-089e-47f6-a1a9-f0ee0de5a77b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:54.928753 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-e2e3f5b3-089e-47f6-a1a9-f0ee0de5a77b None None] MFA Rules not processed for user `92e3804048824cde829e6273ce7c19b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:54.929940 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e2e3f5b3-089e-47f6-a1a9-f0ee0de5a77b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:54.965147 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:54.995465 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 685/1401] 10.222.0.42 () {58 vars in 1059 bytes} [Mon Jul 4 09:10:54 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:10:55.003254 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1215234b-fd48-491b-bb59-357d30d1ee18 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:55.014097 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1215234b-fd48-491b-bb59-357d30d1ee18 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:55.017901 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e686e6a8-1d88-47ad-a071-14c1591549ea service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92e3804048824cde829e6273ce7c19b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:55.018532 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e686e6a8-1d88-47ad-a071-14c1591549ea service glance] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:55.018819 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e686e6a8-1d88-47ad-a071-14c1591549ea service glance] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:55.019096 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e686e6a8-1d88-47ad-a071-14c1591549ea service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:55.028510 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e686e6a8-1d88-47ad-a071-14c1591549ea service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:55.029890 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e686e6a8-1d88-47ad-a071-14c1591549ea service glance] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:55.039666 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 717/1402] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:10:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:10:55.463190 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec374a6-397b-430e-949e-5c3af62264a7 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:55.463469 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec374a6-397b-430e-949e-5c3af62264a7 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:55.463742 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec374a6-397b-430e-949e-5c3af62264a7 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:55.465186 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 686/1403] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:10:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:10:55.470613 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83136459-1aac-4d09-9594-d037af5b6f6c None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:55.470876 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83136459-1aac-4d09-9594-d037af5b6f6c None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:55.471176 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83136459-1aac-4d09-9594-d037af5b6f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:55.490035 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-83136459-1aac-4d09-9594-d037af5b6f6c None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:55.491220 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-83136459-1aac-4d09-9594-d037af5b6f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:55.500227 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 718/1404] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:10:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:10:55.543676 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec374a6-397b-430e-949e-5c3af62264a7 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:55.558120 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec374a6-397b-430e-949e-5c3af62264a7 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:55.563765 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c8286-75bd-4f75-b6f2-684fc105d0c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3b6e252a8c434a99432bcece6493b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:55.564462 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c8286-75bd-4f75-b6f2-684fc105d0c9 service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:55.564744 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c8286-75bd-4f75-b6f2-684fc105d0c9 service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:55.565019 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c8286-75bd-4f75-b6f2-684fc105d0c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:55.573563 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1c8286-75bd-4f75-b6f2-684fc105d0c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:55.575337 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1c8286-75bd-4f75-b6f2-684fc105d0c9 service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:55.586265 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 687/1405] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:10:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:10:55.758736 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06837094-4890-4d92-bf4a-e27afe9fda46 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:55.758997 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06837094-4890-4d92-bf4a-e27afe9fda46 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:55.759277 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06837094-4890-4d92-bf4a-e27afe9fda46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:55.812367 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-06837094-4890-4d92-bf4a-e27afe9fda46 None None] MFA Rules not processed for user `bd758d5b21684027b0d199021df0ad2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:55.814348 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-06837094-4890-4d92-bf4a-e27afe9fda46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:55.868896 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:55.879787 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 719/1406] 10.222.0.42 () {58 vars in 1009 bytes} [Mon Jul 4 09:10:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:10:55.925900 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46992661-9963-40fa-9925-5ec9d4076aa3 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:55.926347 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46992661-9963-40fa-9925-5ec9d4076aa3 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:55.926462 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46992661-9963-40fa-9925-5ec9d4076aa3 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:55.927915 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 688/1407] 10.222.0.42 () {54 vars in 942 bytes} [Mon Jul 4 09:10:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:10:55.934268 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd43d140-83cb-4f64-8ff8-ac9a78be85d4 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:55.934577 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd43d140-83cb-4f64-8ff8-ac9a78be85d4 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:55.934853 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd43d140-83cb-4f64-8ff8-ac9a78be85d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:55.986925 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-dd43d140-83cb-4f64-8ff8-ac9a78be85d4 None None] MFA Rules not processed for user `59d8698c45fb46259765eb3c8de2297f`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:55.988255 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-dd43d140-83cb-4f64-8ff8-ac9a78be85d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:56.064869 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 720/1408] 10.222.0.42 () {58 vars in 1039 bytes} [Mon Jul 4 09:10:55 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:10:56.074836 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46992661-9963-40fa-9925-5ec9d4076aa3 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:56.090440 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46992661-9963-40fa-9925-5ec9d4076aa3 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:56.096188 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bedd7d-5b5b-48dd-9ecd-8f34f4394ace service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59d8698c45fb46259765eb3c8de2297f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:56.096804 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bedd7d-5b5b-48dd-9ecd-8f34f4394ace service swift] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:56.097081 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bedd7d-5b5b-48dd-9ecd-8f34f4394ace service swift] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:56.097350 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bedd7d-5b5b-48dd-9ecd-8f34f4394ace service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:56.105906 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bedd7d-5b5b-48dd-9ecd-8f34f4394ace service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:56.107502 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bedd7d-5b5b-48dd-9ecd-8f34f4394ace service swift] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:56.115551 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 689/1409] 10.222.0.42 () {60 vars in 1384 bytes} [Mon Jul 4 09:10:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 04 09:11:06.061465 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=47 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:06.112391 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=22 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:18.169970 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325de8ce-9a7d-459b-bee2-88aa3fc64ede None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:18.170515 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325de8ce-9a7d-459b-bee2-88aa3fc64ede None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:18.170611 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325de8ce-9a7d-459b-bee2-88aa3fc64ede None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:18.172846 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 721/1410] 10.222.0.42 () {54 vars in 918 bytes} [Mon Jul 4 09:11:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:11:18.178461 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbcece2-c9dc-435d-96d7-32df74151481 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:18.178930 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbcece2-c9dc-435d-96d7-32df74151481 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:18.179037 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbcece2-c9dc-435d-96d7-32df74151481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:18.197588 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-6bbcece2-c9dc-435d-96d7-32df74151481 None None] MFA Rules not processed for user `46ec1a2091f1434cabc69066eb3b6725`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:11:18.198800 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6bbcece2-c9dc-435d-96d7-32df74151481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:11:18.207999 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 690/1411] 10.222.0.42 () {58 vars in 1015 bytes} [Mon Jul 4 09:11:18 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:11:18.222335 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53818c6a-7e36-4e9e-8952-5a33b96a713c None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:18.222658 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53818c6a-7e36-4e9e-8952-5a33b96a713c None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:18.222937 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53818c6a-7e36-4e9e-8952-5a33b96a713c None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:18.224383 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 722/1412] 10.222.0.42 () {54 vars in 918 bytes} [Mon Jul 4 09:11:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:11:18.229222 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f635963-aa76-4511-acb2-2edd4a4721b7 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:18.229510 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f635963-aa76-4511-acb2-2edd4a4721b7 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:18.229798 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f635963-aa76-4511-acb2-2edd4a4721b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:18.249023 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-1f635963-aa76-4511-acb2-2edd4a4721b7 None None] MFA Rules not processed for user `af3b6e252a8c434a99432bcece6493b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:11:18.250202 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-1f635963-aa76-4511-acb2-2edd4a4721b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:11:18.260294 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 691/1413] 10.222.0.42 () {58 vars in 1015 bytes} [Mon Jul 4 09:11:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:11:20.777164 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aae83f-09dc-4dbb-85e6-a64ba7cc01d5 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:20.778056 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aae83f-09dc-4dbb-85e6-a64ba7cc01d5 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:20.778056 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aae83f-09dc-4dbb-85e6-a64ba7cc01d5 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:20.780246 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 723/1414] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 4 09:11:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:11:20.787218 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36541324-ab4b-4dd3-9b06-e3b54c9d9258 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:20.787683 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36541324-ab4b-4dd3-9b06-e3b54c9d9258 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:20.787781 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36541324-ab4b-4dd3-9b06-e3b54c9d9258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:20.816033 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-36541324-ab4b-4dd3-9b06-e3b54c9d9258 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:11:20.817306 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-36541324-ab4b-4dd3-9b06-e3b54c9d9258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:11:20.826853 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 692/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 4 09:11:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:11:20.875905 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aae83f-09dc-4dbb-85e6-a64ba7cc01d5 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:20.894365 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aae83f-09dc-4dbb-85e6-a64ba7cc01d5 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:20.899539 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f27bdf5-8784-4814-bd86-b7f8bb254de1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3b6e252a8c434a99432bcece6493b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:20.900253 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27bdf5-8784-4814-bd86-b7f8bb254de1 service nova] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:20.900540 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27bdf5-8784-4814-bd86-b7f8bb254de1 service nova] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:20.900815 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27bdf5-8784-4814-bd86-b7f8bb254de1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:20.909662 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f27bdf5-8784-4814-bd86-b7f8bb254de1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:20.911249 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f27bdf5-8784-4814-bd86-b7f8bb254de1 service nova] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:20.921169 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 724/1416] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:11:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:11:21.847059 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ba555-6772-4d7b-a481-ee148d93a91f None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:21.847960 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ba555-6772-4d7b-a481-ee148d93a91f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:21.847960 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ba555-6772-4d7b-a481-ee148d93a91f None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:21.850300 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 693/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 4 09:11:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:11:21.856658 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b57a2c-5ee0-48c2-9f0b-508c67a02c13 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:21.857394 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b57a2c-5ee0-48c2-9f0b-508c67a02c13 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:21.857552 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b57a2c-5ee0-48c2-9f0b-508c67a02c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:21.884009 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-e0b57a2c-5ee0-48c2-9f0b-508c67a02c13 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:11:21.885244 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-e0b57a2c-5ee0-48c2-9f0b-508c67a02c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:11:21.894889 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 725/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 4 09:11:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:11:22.045772 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0ba555-6772-4d7b-a481-ee148d93a91f None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:22.062716 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0ba555-6772-4d7b-a481-ee148d93a91f None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:22.069269 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8890e82b-7a2b-4293-b4e4-6cbabb687b68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3b6e252a8c434a99432bcece6493b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:22.070002 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8890e82b-7a2b-4293-b4e4-6cbabb687b68 service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:22.070346 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8890e82b-7a2b-4293-b4e4-6cbabb687b68 service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:22.070668 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8890e82b-7a2b-4293-b4e4-6cbabb687b68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:22.081241 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8890e82b-7a2b-4293-b4e4-6cbabb687b68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:22.083906 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8890e82b-7a2b-4293-b4e4-6cbabb687b68 service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:22.096256 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 694/1419] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:11:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:11:22.976026 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6e762-41c0-4958-9e6b-b76acd75b3f7 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:22.976905 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6e762-41c0-4958-9e6b-b76acd75b3f7 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:22.976905 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6e762-41c0-4958-9e6b-b76acd75b3f7 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:22.979118 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 726/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 4 09:11:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:11:22.984684 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec9f6ff-c1e9-489b-9518-607d6913765e None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:22.985106 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec9f6ff-c1e9-489b-9518-607d6913765e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:22.985232 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec9f6ff-c1e9-489b-9518-607d6913765e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:23.008778 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-7ec9f6ff-c1e9-489b-9518-607d6913765e None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:11:23.009983 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-7ec9f6ff-c1e9-489b-9518-607d6913765e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:11:23.018387 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 695/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 4 09:11:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:11:23.170434 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c6e762-41c0-4958-9e6b-b76acd75b3f7 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:23.193929 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c6e762-41c0-4958-9e6b-b76acd75b3f7 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:23.200971 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fdb120-5b56-4c23-bf5d-70864453eeb7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3b6e252a8c434a99432bcece6493b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:23.201867 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fdb120-5b56-4c23-bf5d-70864453eeb7 service nova] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:23.202204 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fdb120-5b56-4c23-bf5d-70864453eeb7 service nova] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:23.202569 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fdb120-5b56-4c23-bf5d-70864453eeb7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:23.211771 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fdb120-5b56-4c23-bf5d-70864453eeb7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:23.213420 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fdb120-5b56-4c23-bf5d-70864453eeb7 service nova] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:23.223293 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 727/1422] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:11:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:11:24.071214 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65e537-4d97-4b90-b2e7-0efb34ea712a None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:24.072188 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65e537-4d97-4b90-b2e7-0efb34ea712a None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:24.072188 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65e537-4d97-4b90-b2e7-0efb34ea712a None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:24.074524 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 696/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 4 09:11:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:11:24.080045 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0115fb6b-cab4-4f35-85a6-aa4fc14915bc None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:24.080522 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0115fb6b-cab4-4f35-85a6-aa4fc14915bc None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:24.080617 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0115fb6b-cab4-4f35-85a6-aa4fc14915bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:24.100474 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-0115fb6b-cab4-4f35-85a6-aa4fc14915bc None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:11:24.101684 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-0115fb6b-cab4-4f35-85a6-aa4fc14915bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:11:24.111219 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 728/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 4 09:11:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:11:24.258846 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab65e537-4d97-4b90-b2e7-0efb34ea712a None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:24.273344 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab65e537-4d97-4b90-b2e7-0efb34ea712a None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:24.279054 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec4bba2-45d5-4254-99d2-43f7e77b0575 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3b6e252a8c434a99432bcece6493b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:24.279691 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec4bba2-45d5-4254-99d2-43f7e77b0575 service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:24.280013 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec4bba2-45d5-4254-99d2-43f7e77b0575 service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:24.280292 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec4bba2-45d5-4254-99d2-43f7e77b0575 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:24.291005 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec4bba2-45d5-4254-99d2-43f7e77b0575 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:24.292625 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec4bba2-45d5-4254-99d2-43f7e77b0575 service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:24.302614 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 697/1425] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:11:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:11:25.150624 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75270c3-95bc-46a3-8f31-48b136059923 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:25.151553 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75270c3-95bc-46a3-8f31-48b136059923 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:25.151553 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75270c3-95bc-46a3-8f31-48b136059923 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:25.153809 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 729/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 4 09:11:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:11:25.158964 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5100fead-937c-4a9c-a844-96709a49d380 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:25.159408 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5100fead-937c-4a9c-a844-96709a49d380 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:25.159592 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5100fead-937c-4a9c-a844-96709a49d380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:25.178172 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-5100fead-937c-4a9c-a844-96709a49d380 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:11:25.179362 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-5100fead-937c-4a9c-a844-96709a49d380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:11:25.187633 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 698/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 4 09:11:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:11:25.335230 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75270c3-95bc-46a3-8f31-48b136059923 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:25.356765 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75270c3-95bc-46a3-8f31-48b136059923 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:25.362662 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9215cd-821d-4438-a56d-47cb14f8dd6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3b6e252a8c434a99432bcece6493b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:25.363295 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9215cd-821d-4438-a56d-47cb14f8dd6b service nova] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:25.363572 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9215cd-821d-4438-a56d-47cb14f8dd6b service nova] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:25.363844 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9215cd-821d-4438-a56d-47cb14f8dd6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:25.371958 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9215cd-821d-4438-a56d-47cb14f8dd6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:25.373542 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9215cd-821d-4438-a56d-47cb14f8dd6b service nova] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:25.382798 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 730/1428] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:11:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:11:26.222300 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b7cab-8092-44ac-8fcc-40265f37664f None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:26.222897 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b7cab-8092-44ac-8fcc-40265f37664f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:26.222897 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b7cab-8092-44ac-8fcc-40265f37664f None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:26.224289 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 699/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 4 09:11:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:11:26.229462 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b69112-dcc9-4e13-8634-9c9f682256d7 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:26.230275 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b69112-dcc9-4e13-8634-9c9f682256d7 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:26.230386 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b69112-dcc9-4e13-8634-9c9f682256d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:26.249984 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-93b69112-dcc9-4e13-8634-9c9f682256d7 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:11:26.251214 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-93b69112-dcc9-4e13-8634-9c9f682256d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:11:26.260069 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 731/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 4 09:11:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:11:26.416945 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b7cab-8092-44ac-8fcc-40265f37664f None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:26.436584 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b7cab-8092-44ac-8fcc-40265f37664f None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:26.444137 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff26552c-3238-4336-b2b7-614f576f7218 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3b6e252a8c434a99432bcece6493b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:26.444775 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26552c-3238-4336-b2b7-614f576f7218 service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:26.445063 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26552c-3238-4336-b2b7-614f576f7218 service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:26.445320 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26552c-3238-4336-b2b7-614f576f7218 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:26.454697 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff26552c-3238-4336-b2b7-614f576f7218 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:26.456342 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff26552c-3238-4336-b2b7-614f576f7218 service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:26.466936 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 700/1431] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:11:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:11:27.265534 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad34235f-d762-4baa-ad8f-d73cf32c14a5 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:27.266435 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad34235f-d762-4baa-ad8f-d73cf32c14a5 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:27.266435 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad34235f-d762-4baa-ad8f-d73cf32c14a5 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:27.268506 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 732/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 4 09:11:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:11:27.276801 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91f00e-7232-4b95-9fd7-1bfbcb27bf7e None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:27.277226 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91f00e-7232-4b95-9fd7-1bfbcb27bf7e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:27.277342 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91f00e-7232-4b95-9fd7-1bfbcb27bf7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:27.297996 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-fc91f00e-7232-4b95-9fd7-1bfbcb27bf7e None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:11:27.299203 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-fc91f00e-7232-4b95-9fd7-1bfbcb27bf7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:11:27.307560 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 701/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 4 09:11:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:11:27.463769 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad34235f-d762-4baa-ad8f-d73cf32c14a5 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:27.482605 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad34235f-d762-4baa-ad8f-d73cf32c14a5 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:27.488736 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b28cb-d18e-4fee-ab55-a668b81ad93a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3b6e252a8c434a99432bcece6493b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:27.489373 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b28cb-d18e-4fee-ab55-a668b81ad93a service nova] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:27.489655 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b28cb-d18e-4fee-ab55-a668b81ad93a service nova] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:27.489927 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b28cb-d18e-4fee-ab55-a668b81ad93a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:27.498233 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68b28cb-d18e-4fee-ab55-a668b81ad93a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:27.499828 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68b28cb-d18e-4fee-ab55-a668b81ad93a service nova] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:27.509425 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 733/1434] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:11:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:11:28.326280 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e4415-5214-4048-87eb-d3b34aaa5343 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:28.327258 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e4415-5214-4048-87eb-d3b34aaa5343 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:28.327258 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e4415-5214-4048-87eb-d3b34aaa5343 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:28.329275 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 702/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 4 09:11:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:11:28.334287 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f571675a-73e6-40cf-803a-5922c836d32c None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:28.334736 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f571675a-73e6-40cf-803a-5922c836d32c None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:28.334837 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f571675a-73e6-40cf-803a-5922c836d32c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:28.354263 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-f571675a-73e6-40cf-803a-5922c836d32c None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:11:28.355824 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-f571675a-73e6-40cf-803a-5922c836d32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:11:28.365037 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 734/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 4 09:11:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:11:28.514388 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0e4415-5214-4048-87eb-d3b34aaa5343 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:28.531817 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0e4415-5214-4048-87eb-d3b34aaa5343 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:28.538041 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9af8ec0-205f-4662-addc-54b03407eba7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3b6e252a8c434a99432bcece6493b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:28.538678 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9af8ec0-205f-4662-addc-54b03407eba7 service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:28.538959 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9af8ec0-205f-4662-addc-54b03407eba7 service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:28.539234 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9af8ec0-205f-4662-addc-54b03407eba7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:28.548221 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9af8ec0-205f-4662-addc-54b03407eba7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:28.549837 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9af8ec0-205f-4662-addc-54b03407eba7 service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:28.559215 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 703/1437] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:11:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:11:29.362960 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46075ef0-8930-42b7-b578-524f5b8e066b None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:29.363528 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46075ef0-8930-42b7-b578-524f5b8e066b None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:29.363528 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46075ef0-8930-42b7-b578-524f5b8e066b None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:29.364949 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 735/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 4 09:11:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:11:29.371126 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c90c4-cd34-45ac-8f04-adede078c0cd None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:29.371923 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c90c4-cd34-45ac-8f04-adede078c0cd None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:29.372035 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c90c4-cd34-45ac-8f04-adede078c0cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:29.397947 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-576c90c4-cd34-45ac-8f04-adede078c0cd None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:11:29.399147 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-576c90c4-cd34-45ac-8f04-adede078c0cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:11:29.407805 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 704/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 4 09:11:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:11:29.564739 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46075ef0-8930-42b7-b578-524f5b8e066b None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:29.582133 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46075ef0-8930-42b7-b578-524f5b8e066b None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:29.588422 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb1f355-bb90-4f2d-97e2-bb8fd4b65a62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3b6e252a8c434a99432bcece6493b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:29.589061 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb1f355-bb90-4f2d-97e2-bb8fd4b65a62 service nova] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:29.589354 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb1f355-bb90-4f2d-97e2-bb8fd4b65a62 service nova] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:29.589627 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb1f355-bb90-4f2d-97e2-bb8fd4b65a62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:29.598619 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb1f355-bb90-4f2d-97e2-bb8fd4b65a62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:29.600293 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb1f355-bb90-4f2d-97e2-bb8fd4b65a62 service nova] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:29.611212 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 736/1440] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:11:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:11:31.520868 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261f0c4-d434-48c6-88a6-f4b24685ade8 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:31.521420 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261f0c4-d434-48c6-88a6-f4b24685ade8 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:31.521790 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261f0c4-d434-48c6-88a6-f4b24685ade8 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:31.524081 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 705/1441] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 4 09:11:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:11:31.533237 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95b854-8cf3-4c2f-af63-ac8818b030e3 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:31.533708 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95b854-8cf3-4c2f-af63-ac8818b030e3 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:31.533810 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95b854-8cf3-4c2f-af63-ac8818b030e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:31.556943 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-9a95b854-8cf3-4c2f-af63-ac8818b030e3 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:11:31.558091 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-9a95b854-8cf3-4c2f-af63-ac8818b030e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:11:31.566156 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 737/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 4 09:11:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:11:31.605934 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7261f0c4-d434-48c6-88a6-f4b24685ade8 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:31.609220 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-7261f0c4-d434-48c6-88a6-f4b24685ade8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:11:31.624480 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7261f0c4-d434-48c6-88a6-f4b24685ade8 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:31.628810 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f5e387-8343-49cf-ae8c-dbee1af9eb71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:31.629448 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f5e387-8343-49cf-ae8c-dbee1af9eb71 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:31.629725 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f5e387-8343-49cf-ae8c-dbee1af9eb71 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:31.629996 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f5e387-8343-49cf-ae8c-dbee1af9eb71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:31.639583 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f5e387-8343-49cf-ae8c-dbee1af9eb71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:31.641173 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f5e387-8343-49cf-ae8c-dbee1af9eb71 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:31.650604 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 706/1443] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:11:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:11:33.833278 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e5712-50d1-40c4-bbdd-4f897c206588 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:33.834187 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e5712-50d1-40c4-bbdd-4f897c206588 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:33.834187 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e5712-50d1-40c4-bbdd-4f897c206588 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:33.836480 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 738/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 4 09:11:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:11:33.843012 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478027f-6b14-47f5-a293-265b4f64e91b None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:33.843752 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478027f-6b14-47f5-a293-265b4f64e91b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:33.844161 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478027f-6b14-47f5-a293-265b4f64e91b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:33.868922 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-9478027f-6b14-47f5-a293-265b4f64e91b None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:11:33.870125 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9478027f-6b14-47f5-a293-265b4f64e91b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:11:33.879236 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 707/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 4 09:11:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:11:33.918414 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e5712-50d1-40c4-bbdd-4f897c206588 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:33.931346 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e5712-50d1-40c4-bbdd-4f897c206588 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:33.935904 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abb3658-3962-4949-999b-fc2e7dffb38e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:33.936556 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb3658-3962-4949-999b-fc2e7dffb38e service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:33.936844 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb3658-3962-4949-999b-fc2e7dffb38e service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:33.937093 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb3658-3962-4949-999b-fc2e7dffb38e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:33.951646 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abb3658-3962-4949-999b-fc2e7dffb38e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:33.953155 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abb3658-3962-4949-999b-fc2e7dffb38e service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:33.962877 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 739/1446] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:11:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:11:36.333486 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e50bc-694d-4586-9d7e-61e5ef3aa98f None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:36.334118 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e50bc-694d-4586-9d7e-61e5ef3aa98f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:36.334118 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e50bc-694d-4586-9d7e-61e5ef3aa98f None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:36.335464 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 708/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 4 09:11:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:11:36.342215 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c528a-5779-413d-bab1-38bdabbae7a1 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:36.342678 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c528a-5779-413d-bab1-38bdabbae7a1 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:36.342819 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c528a-5779-413d-bab1-38bdabbae7a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:36.361951 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-2b4c528a-5779-413d-bab1-38bdabbae7a1 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:11:36.363153 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-2b4c528a-5779-413d-bab1-38bdabbae7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:11:36.372226 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 740/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 4 09:11:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:11:36.411234 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454e50bc-694d-4586-9d7e-61e5ef3aa98f None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:36.423431 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454e50bc-694d-4586-9d7e-61e5ef3aa98f None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:36.427810 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f438ac3-dd93-4db0-b33b-11b6e295c98f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:36.428472 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f438ac3-dd93-4db0-b33b-11b6e295c98f service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:36.428761 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f438ac3-dd93-4db0-b33b-11b6e295c98f service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:36.429026 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f438ac3-dd93-4db0-b33b-11b6e295c98f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:36.438830 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f438ac3-dd93-4db0-b33b-11b6e295c98f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:36.440332 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f438ac3-dd93-4db0-b33b-11b6e295c98f service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:36.449948 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 709/1449] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:11:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:11:38.615560 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603b71a-e73c-40eb-887c-7ceb1d964a12 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:38.616512 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603b71a-e73c-40eb-887c-7ceb1d964a12 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:38.616512 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603b71a-e73c-40eb-887c-7ceb1d964a12 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:38.618449 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 741/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 4 09:11:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:11:38.624020 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93044e4-78bf-4008-a240-16eaceb4e473 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:38.624501 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93044e4-78bf-4008-a240-16eaceb4e473 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:38.624609 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93044e4-78bf-4008-a240-16eaceb4e473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:38.644424 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-a93044e4-78bf-4008-a240-16eaceb4e473 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:11:38.645647 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a93044e4-78bf-4008-a240-16eaceb4e473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:11:38.654703 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 710/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 4 09:11:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:11:38.693637 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f603b71a-e73c-40eb-887c-7ceb1d964a12 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:38.711934 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f603b71a-e73c-40eb-887c-7ceb1d964a12 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:38.718234 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5139608-d350-43f4-9c5c-ab73721cf16e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:38.719111 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5139608-d350-43f4-9c5c-ab73721cf16e service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:38.719389 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5139608-d350-43f4-9c5c-ab73721cf16e service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:38.719654 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5139608-d350-43f4-9c5c-ab73721cf16e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:38.730457 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5139608-d350-43f4-9c5c-ab73721cf16e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:38.731954 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5139608-d350-43f4-9c5c-ab73721cf16e service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:38.741938 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 742/1452] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:11:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:11:40.816656 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2b75b-ed36-4afa-bea5-1d41a0aac8cf None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:40.817542 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2b75b-ed36-4afa-bea5-1d41a0aac8cf None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:40.817542 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2b75b-ed36-4afa-bea5-1d41a0aac8cf None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:40.819769 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 711/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 4 09:11:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:11:40.827838 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9b48c-2d7c-4f07-84f4-e409e1a9354b None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:40.828325 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9b48c-2d7c-4f07-84f4-e409e1a9354b None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:40.828432 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9b48c-2d7c-4f07-84f4-e409e1a9354b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:40.848997 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-cea9b48c-2d7c-4f07-84f4-e409e1a9354b None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:11:40.850242 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-cea9b48c-2d7c-4f07-84f4-e409e1a9354b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:11:40.860137 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 743/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 4 09:11:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:11:40.898175 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae2b75b-ed36-4afa-bea5-1d41a0aac8cf None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:40.910445 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae2b75b-ed36-4afa-bea5-1d41a0aac8cf None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:40.914386 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9df7188-1597-4f96-afc3-940de04e5a59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:40.915013 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df7188-1597-4f96-afc3-940de04e5a59 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:40.915295 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df7188-1597-4f96-afc3-940de04e5a59 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:40.915571 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df7188-1597-4f96-afc3-940de04e5a59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:40.925378 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9df7188-1597-4f96-afc3-940de04e5a59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:40.926868 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9df7188-1597-4f96-afc3-940de04e5a59 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:40.936893 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 712/1455] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:11:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:11:43.059993 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d76e9-b060-418b-aa15-2c4ba16bda71 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:43.060609 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d76e9-b060-418b-aa15-2c4ba16bda71 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:43.060609 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d76e9-b060-418b-aa15-2c4ba16bda71 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:43.062026 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 744/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 4 09:11:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:11:43.068694 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540f7c0-10ce-414b-8294-3a5f3fe5d52d None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:43.069344 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540f7c0-10ce-414b-8294-3a5f3fe5d52d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:43.069456 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540f7c0-10ce-414b-8294-3a5f3fe5d52d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:43.096456 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-7540f7c0-10ce-414b-8294-3a5f3fe5d52d None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:11:43.097670 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-7540f7c0-10ce-414b-8294-3a5f3fe5d52d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:11:43.107361 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 713/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 4 09:11:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:11:43.146169 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24d76e9-b060-418b-aa15-2c4ba16bda71 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:43.161693 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24d76e9-b060-418b-aa15-2c4ba16bda71 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:43.165937 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35189b6-448b-4881-a5b6-16ac2dcd9317 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:43.166587 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35189b6-448b-4881-a5b6-16ac2dcd9317 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:43.166880 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35189b6-448b-4881-a5b6-16ac2dcd9317 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:43.167145 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35189b6-448b-4881-a5b6-16ac2dcd9317 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:43.177299 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35189b6-448b-4881-a5b6-16ac2dcd9317 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:43.178749 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35189b6-448b-4881-a5b6-16ac2dcd9317 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:43.188347 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 745/1458] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:11:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:11:45.324108 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c352ec2-673b-4473-8753-2670c56607c8 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:45.324847 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c352ec2-673b-4473-8753-2670c56607c8 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:45.324982 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c352ec2-673b-4473-8753-2670c56607c8 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:45.326344 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 714/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 4 09:11:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:11:45.332140 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86dd3b6-fb1e-4eba-84a3-dc81dd0e4c38 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:45.332622 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86dd3b6-fb1e-4eba-84a3-dc81dd0e4c38 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:45.332732 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86dd3b6-fb1e-4eba-84a3-dc81dd0e4c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:45.351756 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-c86dd3b6-fb1e-4eba-84a3-dc81dd0e4c38 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:11:45.352994 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-c86dd3b6-fb1e-4eba-84a3-dc81dd0e4c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:11:45.362086 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 746/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 4 09:11:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:11:45.402782 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c352ec2-673b-4473-8753-2670c56607c8 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:45.417205 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c352ec2-673b-4473-8753-2670c56607c8 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:45.421613 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8045b9c-79af-4f6f-b712-ad3db828c076 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:45.422252 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8045b9c-79af-4f6f-b712-ad3db828c076 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:45.422539 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8045b9c-79af-4f6f-b712-ad3db828c076 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:45.422805 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8045b9c-79af-4f6f-b712-ad3db828c076 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:45.432907 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8045b9c-79af-4f6f-b712-ad3db828c076 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:45.434379 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8045b9c-79af-4f6f-b712-ad3db828c076 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:45.444088 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 715/1461] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:11:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:11:47.542261 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0cc5a9-c251-4553-b21c-430d1b63370c None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:47.543196 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0cc5a9-c251-4553-b21c-430d1b63370c None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:47.543196 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0cc5a9-c251-4553-b21c-430d1b63370c None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:47.545413 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 747/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 4 09:11:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:11:47.553577 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7abb2-659c-4ed3-99f7-3c7f551183f0 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:47.553998 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7abb2-659c-4ed3-99f7-3c7f551183f0 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:47.554093 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7abb2-659c-4ed3-99f7-3c7f551183f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:47.560968 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=79 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:47.574783 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-6bf7abb2-659c-4ed3-99f7-3c7f551183f0 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:11:47.576033 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6bf7abb2-659c-4ed3-99f7-3c7f551183f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:11:47.586881 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 716/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 4 09:11:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:11:47.634245 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0cc5a9-c251-4553-b21c-430d1b63370c None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:47.641101 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=73 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:47.648342 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0cc5a9-c251-4553-b21c-430d1b63370c None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:47.652095 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add7935f-2a89-46b5-8942-820a84296888 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:47.652726 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7935f-2a89-46b5-8942-820a84296888 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:47.653011 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7935f-2a89-46b5-8942-820a84296888 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:47.653287 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7935f-2a89-46b5-8942-820a84296888 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:47.663209 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add7935f-2a89-46b5-8942-820a84296888 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:47.664701 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add7935f-2a89-46b5-8942-820a84296888 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:47.674653 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 748/1464] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:11:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:11:49.721979 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78d025-7fa9-4993-856b-63f1a5a5cab7 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:49.722585 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78d025-7fa9-4993-856b-63f1a5a5cab7 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:49.722585 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78d025-7fa9-4993-856b-63f1a5a5cab7 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:49.723935 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 717/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 4 09:11:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:11:49.729854 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d5e359-b8dd-40de-a5af-4017a07244ad None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:49.730629 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d5e359-b8dd-40de-a5af-4017a07244ad None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:49.730629 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d5e359-b8dd-40de-a5af-4017a07244ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:49.750748 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-08d5e359-b8dd-40de-a5af-4017a07244ad None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:11:49.751992 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-08d5e359-b8dd-40de-a5af-4017a07244ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:11:49.761566 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 749/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 4 09:11:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:11:49.802249 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e78d025-7fa9-4993-856b-63f1a5a5cab7 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:49.819072 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e78d025-7fa9-4993-856b-63f1a5a5cab7 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:49.823449 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb24fa-1238-4ded-9ff3-cf28aed366a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:49.824132 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb24fa-1238-4ded-9ff3-cf28aed366a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:49.824413 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb24fa-1238-4ded-9ff3-cf28aed366a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:49.824691 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb24fa-1238-4ded-9ff3-cf28aed366a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:49.835383 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeb24fa-1238-4ded-9ff3-cf28aed366a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:49.837196 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeb24fa-1238-4ded-9ff3-cf28aed366a8 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:49.848289 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 718/1467] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:11:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:11:51.920022 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f1a89-68cb-43fd-8170-a7521b9e2602 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:51.920526 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f1a89-68cb-43fd-8170-a7521b9e2602 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:51.920526 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f1a89-68cb-43fd-8170-a7521b9e2602 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:51.922085 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 750/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 4 09:11:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:11:51.929947 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72447d-57e5-4cbd-9efa-373a4c944465 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:51.930407 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72447d-57e5-4cbd-9efa-373a4c944465 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:51.930514 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72447d-57e5-4cbd-9efa-373a4c944465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:51.950868 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-0d72447d-57e5-4cbd-9efa-373a4c944465 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:11:51.952104 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0d72447d-57e5-4cbd-9efa-373a4c944465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:11:51.961324 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 719/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 4 09:11:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:11:51.997759 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7f1a89-68cb-43fd-8170-a7521b9e2602 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:52.010688 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7f1a89-68cb-43fd-8170-a7521b9e2602 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:52.015235 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a09bd5-ef41-42e0-b83e-b70f050965f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:52.015923 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a09bd5-ef41-42e0-b83e-b70f050965f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:52.016190 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a09bd5-ef41-42e0-b83e-b70f050965f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:52.016466 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a09bd5-ef41-42e0-b83e-b70f050965f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:52.026307 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a09bd5-ef41-42e0-b83e-b70f050965f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:52.027759 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a09bd5-ef41-42e0-b83e-b70f050965f0 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:52.037438 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 751/1470] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:11:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 09:12:01.945475 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=11 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:12:02.033190 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=14 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:12:11.933765 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a03c520-c441-44c6-b3a9-fd43d90b27b5 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:11.934304 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a03c520-c441-44c6-b3a9-fd43d90b27b5 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:11.934304 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a03c520-c441-44c6-b3a9-fd43d90b27b5 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:11.935754 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 720/1471] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:12:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:12:11.944691 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a78f90-fb9e-4ae1-91b2-d2cbb34fe3cb None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:11.945124 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a78f90-fb9e-4ae1-91b2-d2cbb34fe3cb None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:11.945268 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a78f90-fb9e-4ae1-91b2-d2cbb34fe3cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:11.967059 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-29a78f90-fb9e-4ae1-91b2-d2cbb34fe3cb None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:12:11.968377 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-29a78f90-fb9e-4ae1-91b2-d2cbb34fe3cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:12:11.976916 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 752/1472] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:12:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:12:12.063218 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6daaa91-2fbf-4cb4-b6b8-f1af2fc53e08 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:12.063511 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6daaa91-2fbf-4cb4-b6b8-f1af2fc53e08 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:12.063785 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6daaa91-2fbf-4cb4-b6b8-f1af2fc53e08 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:12.065218 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 721/1473] 10.222.0.42 () {54 vars in 962 bytes} [Mon Jul 4 09:12:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:12:12.071691 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4acb32-a502-45fd-9797-03f85285df79 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:12.072032 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4acb32-a502-45fd-9797-03f85285df79 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:12.072313 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4acb32-a502-45fd-9797-03f85285df79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:12.091205 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-2c4acb32-a502-45fd-9797-03f85285df79 None None] MFA Rules not processed for user `92e3804048824cde829e6273ce7c19b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:12:12.092456 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-2c4acb32-a502-45fd-9797-03f85285df79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:12:12.100339 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 753/1474] 10.222.0.42 () {58 vars in 1059 bytes} [Mon Jul 4 09:12:12 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:12:12.108188 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6daaa91-2fbf-4cb4-b6b8-f1af2fc53e08 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:12:12.124210 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6daaa91-2fbf-4cb4-b6b8-f1af2fc53e08 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:12:12.131206 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b6139a-bfd9-49ad-851e-ef5da1d7ee28 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92e3804048824cde829e6273ce7c19b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:12:12.132360 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b6139a-bfd9-49ad-851e-ef5da1d7ee28 service glance] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:12.132780 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b6139a-bfd9-49ad-851e-ef5da1d7ee28 service glance] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:12.133177 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b6139a-bfd9-49ad-851e-ef5da1d7ee28 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:12.146017 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b6139a-bfd9-49ad-851e-ef5da1d7ee28 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:12:12.147422 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b6139a-bfd9-49ad-851e-ef5da1d7ee28 service glance] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:12:12.157510 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 722/1475] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:12:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:12:14.289211 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de413e6a-801c-4abb-8492-c1aea706c069 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:14.289782 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de413e6a-801c-4abb-8492-c1aea706c069 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:14.289782 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de413e6a-801c-4abb-8492-c1aea706c069 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:14.291161 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 754/1476] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:12:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:12:14.297011 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2232155f-0e24-4976-a76d-41e7ff5014b0 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:14.297461 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2232155f-0e24-4976-a76d-41e7ff5014b0 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:14.297555 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2232155f-0e24-4976-a76d-41e7ff5014b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:14.316361 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-2232155f-0e24-4976-a76d-41e7ff5014b0 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:12:14.317539 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-2232155f-0e24-4976-a76d-41e7ff5014b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:12:14.328205 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 723/1477] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:12:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:12:14.352009 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de413e6a-801c-4abb-8492-c1aea706c069 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:12:14.369190 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de413e6a-801c-4abb-8492-c1aea706c069 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:12:14.373768 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508ff542-1480-4889-98bc-222e2657418c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:12:14.374447 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ff542-1480-4889-98bc-222e2657418c admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:14.374731 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ff542-1480-4889-98bc-222e2657418c admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:14.375362 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ff542-1480-4889-98bc-222e2657418c admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:14.376139 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508ff542-1480-4889-98bc-222e2657418c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:12:14.377940 dv-cinder-844563-4-smb devstack@keystone.service[80182]: WARNING py.warnings [None req-508ff542-1480-4889-98bc-222e2657418c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 04 09:12:14.377940 dv-cinder-844563-4-smb devstack@keystone.service[80182]: warnings.warn(msg) Jul 04 09:12:14.377940 dv-cinder-844563-4-smb devstack@keystone.service[80182]: Jul 04 09:12:14.379083 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508ff542-1480-4889-98bc-222e2657418c admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:12:14.399248 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 755/1478] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jul 4 09:12:14 2022] GET /identity/v3/projects => generated 2553 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:12:16.441364 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e3449-54f8-4382-b556-c10d753f1f4b None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:16.442274 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e3449-54f8-4382-b556-c10d753f1f4b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:16.442274 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e3449-54f8-4382-b556-c10d753f1f4b None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:16.444516 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 724/1479] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:12:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:12:16.449989 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c29abe-416d-4c48-8521-04b9a4b62b1e None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:16.450431 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c29abe-416d-4c48-8521-04b9a4b62b1e None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:16.450548 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c29abe-416d-4c48-8521-04b9a4b62b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:16.468863 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-d1c29abe-416d-4c48-8521-04b9a4b62b1e None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:12:16.470066 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-d1c29abe-416d-4c48-8521-04b9a4b62b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:12:16.478476 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 756/1480] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:12:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:12:16.529727 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2e3449-54f8-4382-b556-c10d753f1f4b None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:12:16.548913 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2e3449-54f8-4382-b556-c10d753f1f4b None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:12:16.554564 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583504ee-0265-4f6b-b4fa-e9e351753c0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3b6e252a8c434a99432bcece6493b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:12:16.555200 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583504ee-0265-4f6b-b4fa-e9e351753c0c service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:16.555486 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583504ee-0265-4f6b-b4fa-e9e351753c0c service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:16.555757 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583504ee-0265-4f6b-b4fa-e9e351753c0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:16.564580 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583504ee-0265-4f6b-b4fa-e9e351753c0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:12:16.566211 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583504ee-0265-4f6b-b4fa-e9e351753c0c service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:12:16.576531 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 725/1481] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:12:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:12:18.790240 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd742f-c999-47a6-aafb-b44e12a4bb36 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:18.790839 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd742f-c999-47a6-aafb-b44e12a4bb36 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:18.790839 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd742f-c999-47a6-aafb-b44e12a4bb36 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:18.792214 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 757/1482] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:12:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:12:18.798599 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b186a-8ac3-40e0-83db-29940c1a5216 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:18.799318 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b186a-8ac3-40e0-83db-29940c1a5216 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:18.799477 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b186a-8ac3-40e0-83db-29940c1a5216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:18.829393 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-215b186a-8ac3-40e0-83db-29940c1a5216 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:12:18.830617 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-215b186a-8ac3-40e0-83db-29940c1a5216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:12:18.838876 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 726/1483] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:12:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:12:18.875492 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbd742f-c999-47a6-aafb-b44e12a4bb36 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:12:18.888621 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbd742f-c999-47a6-aafb-b44e12a4bb36 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:12:18.892855 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9024c619-83fc-45d2-ae79-d9ec3448b0ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:12:18.893506 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024c619-83fc-45d2-ae79-d9ec3448b0ca service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:18.893794 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024c619-83fc-45d2-ae79-d9ec3448b0ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:18.894067 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024c619-83fc-45d2-ae79-d9ec3448b0ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:18.903775 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9024c619-83fc-45d2-ae79-d9ec3448b0ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:12:18.905360 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9024c619-83fc-45d2-ae79-d9ec3448b0ca service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:12:18.914979 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 758/1484] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:12:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:12:20.999909 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e511b41d-cf6d-4611-9af4-1698d8cde54d None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:21.000510 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e511b41d-cf6d-4611-9af4-1698d8cde54d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:21.000510 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e511b41d-cf6d-4611-9af4-1698d8cde54d None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:21.001867 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 727/1485] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:12:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:12:21.008521 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f202c9b-7965-46b4-91b6-4f8378019b1b None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:21.009238 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f202c9b-7965-46b4-91b6-4f8378019b1b None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:21.009383 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f202c9b-7965-46b4-91b6-4f8378019b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:21.029099 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-7f202c9b-7965-46b4-91b6-4f8378019b1b None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:12:21.030333 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-7f202c9b-7965-46b4-91b6-4f8378019b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:12:21.038744 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 759/1486] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:12:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:12:21.076592 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e511b41d-cf6d-4611-9af4-1698d8cde54d None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:12:21.090253 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e511b41d-cf6d-4611-9af4-1698d8cde54d None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:12:21.094464 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a918d-39cc-4948-8272-b68544e9d4c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:12:21.095099 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a918d-39cc-4948-8272-b68544e9d4c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:21.095378 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a918d-39cc-4948-8272-b68544e9d4c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:21.095651 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a918d-39cc-4948-8272-b68544e9d4c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:21.105912 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527a918d-39cc-4948-8272-b68544e9d4c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:12:21.107352 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527a918d-39cc-4948-8272-b68544e9d4c7 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:12:21.117008 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 728/1487] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:12:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:12:23.425794 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0568c4b4-fe86-4b83-941a-0301002e5fbd None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:23.426443 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0568c4b4-fe86-4b83-941a-0301002e5fbd None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:23.426443 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0568c4b4-fe86-4b83-941a-0301002e5fbd None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:23.428035 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 760/1488] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:12:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:12:23.437039 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa27d9c4-717e-476b-8053-621d9748563f None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:23.437573 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa27d9c4-717e-476b-8053-621d9748563f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:23.437573 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa27d9c4-717e-476b-8053-621d9748563f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:23.462915 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-aa27d9c4-717e-476b-8053-621d9748563f None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:12:23.464892 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-aa27d9c4-717e-476b-8053-621d9748563f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:12:23.474784 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 729/1489] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:12:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:12:23.520538 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0568c4b4-fe86-4b83-941a-0301002e5fbd None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:12:23.534546 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0568c4b4-fe86-4b83-941a-0301002e5fbd None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:12:23.538570 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc416b36-5ce9-47be-a0af-6ad783cf4304 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:12:23.539206 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc416b36-5ce9-47be-a0af-6ad783cf4304 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:23.539491 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc416b36-5ce9-47be-a0af-6ad783cf4304 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:23.539761 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc416b36-5ce9-47be-a0af-6ad783cf4304 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:23.551488 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc416b36-5ce9-47be-a0af-6ad783cf4304 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:12:23.553007 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc416b36-5ce9-47be-a0af-6ad783cf4304 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:12:23.563338 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 761/1490] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:12:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:12:25.822874 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ed6a9-df9b-4d13-af57-0540dcf42bb6 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:25.823737 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ed6a9-df9b-4d13-af57-0540dcf42bb6 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:25.823737 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ed6a9-df9b-4d13-af57-0540dcf42bb6 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:25.825813 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 730/1491] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jul 4 09:12:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:12:25.833366 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58beaf1f-b89d-4725-b7d7-f1418531b127 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:25.833775 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58beaf1f-b89d-4725-b7d7-f1418531b127 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:25.833922 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58beaf1f-b89d-4725-b7d7-f1418531b127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:25.855156 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-58beaf1f-b89d-4725-b7d7-f1418531b127 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:12:25.856398 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-58beaf1f-b89d-4725-b7d7-f1418531b127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:12:25.864946 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 762/1492] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jul 4 09:12:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:12:25.907660 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3ed6a9-df9b-4d13-af57-0540dcf42bb6 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:12:25.920811 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3ed6a9-df9b-4d13-af57-0540dcf42bb6 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:12:25.925334 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168a2dea-6ac3-413f-bf4e-0f5b113e3490 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:12:25.926006 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a2dea-6ac3-413f-bf4e-0f5b113e3490 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:25.926289 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a2dea-6ac3-413f-bf4e-0f5b113e3490 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:25.926540 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a2dea-6ac3-413f-bf4e-0f5b113e3490 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:25.937169 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168a2dea-6ac3-413f-bf4e-0f5b113e3490 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:12:25.938652 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168a2dea-6ac3-413f-bf4e-0f5b113e3490 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:12:25.948321 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 731/1493] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:12:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:12:35.849198 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=33 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:12:35.944075 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=33 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:13:51.860173 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfa97ca-c9b3-4bc4-b2f1-5bbd29ed6625 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:13:51.860792 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfa97ca-c9b3-4bc4-b2f1-5bbd29ed6625 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:13:51.860792 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfa97ca-c9b3-4bc4-b2f1-5bbd29ed6625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:13:51.883622 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-dbfa97ca-c9b3-4bc4-b2f1-5bbd29ed6625 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:13:51.884865 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-dbfa97ca-c9b3-4bc4-b2f1-5bbd29ed6625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:13:51.893506 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 763/1494] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:13:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:13:51.901794 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f64a9b3-28c4-403b-97d5-112dff216a44 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:13:51.902216 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f64a9b3-28c4-403b-97d5-112dff216a44 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:13:51.902354 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f64a9b3-28c4-403b-97d5-112dff216a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:13:51.921740 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-0f64a9b3-28c4-403b-97d5-112dff216a44 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:13:51.922925 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0f64a9b3-28c4-403b-97d5-112dff216a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:13:51.931816 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 732/1495] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:13:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:13:51.936329 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfa97ca-c9b3-4bc4-b2f1-5bbd29ed6625 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:13:51.946087 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfa97ca-c9b3-4bc4-b2f1-5bbd29ed6625 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:13:51.951154 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cdba63-6253-413a-81fa-882de0e1f3d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:13:51.951798 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cdba63-6253-413a-81fa-882de0e1f3d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:13:51.952107 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cdba63-6253-413a-81fa-882de0e1f3d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:13:51.952384 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cdba63-6253-413a-81fa-882de0e1f3d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:13:51.953120 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cdba63-6253-413a-81fa-882de0e1f3d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:13:51.953427 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cdba63-6253-413a-81fa-882de0e1f3d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:13:51.954439 dv-cinder-844563-4-smb devstack@keystone.service[80182]: WARNING py.warnings [None req-e6cdba63-6253-413a-81fa-882de0e1f3d9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 04 09:13:51.954439 dv-cinder-844563-4-smb devstack@keystone.service[80182]: warnings.warn(msg) Jul 04 09:13:51.954439 dv-cinder-844563-4-smb devstack@keystone.service[80182]: Jul 04 09:13:51.955328 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cdba63-6253-413a-81fa-882de0e1f3d9 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:13:51.967205 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 764/1496] 10.222.0.42 () {58 vars in 1152 bytes} [Mon Jul 4 09:13:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:13:51.975196 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f64a9b3-28c4-403b-97d5-112dff216a44 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:13:51.984980 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f64a9b3-28c4-403b-97d5-112dff216a44 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:13:51.990784 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b42d11-1acf-4891-968e-edc0f889ae7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:13:51.991424 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b42d11-1acf-4891-968e-edc0f889ae7e admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:13:51.991701 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b42d11-1acf-4891-968e-edc0f889ae7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:13:51.991999 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b42d11-1acf-4891-968e-edc0f889ae7e admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:13:51.992683 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b42d11-1acf-4891-968e-edc0f889ae7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:13:51.994485 dv-cinder-844563-4-smb devstack@keystone.service[80181]: WARNING py.warnings [None req-52b42d11-1acf-4891-968e-edc0f889ae7e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 04 09:13:51.994485 dv-cinder-844563-4-smb devstack@keystone.service[80181]: warnings.warn(msg) Jul 04 09:13:51.994485 dv-cinder-844563-4-smb devstack@keystone.service[80181]: Jul 04 09:13:51.995690 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b42d11-1acf-4891-968e-edc0f889ae7e admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:13:52.034956 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 733/1497] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:13:51 2022] POST /identity/v3/projects => generated 379 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:13:52.040718 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cdba63-6253-413a-81fa-882de0e1f3d9 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:13:52.050786 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cdba63-6253-413a-81fa-882de0e1f3d9 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:13:52.107583 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38b8ad0-ed2f-43f0-b0fc-d5cc28b537f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:13:52.108295 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b8ad0-ed2f-43f0-b0fc-d5cc28b537f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:13:52.108579 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b8ad0-ed2f-43f0-b0fc-d5cc28b537f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:13:52.108849 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b8ad0-ed2f-43f0-b0fc-d5cc28b537f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:13:52.109560 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38b8ad0-ed2f-43f0-b0fc-d5cc28b537f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:13:52.110659 dv-cinder-844563-4-smb devstack@keystone.service[80182]: WARNING py.warnings [None req-a38b8ad0-ed2f-43f0-b0fc-d5cc28b537f8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 04 09:13:52.110659 dv-cinder-844563-4-smb devstack@keystone.service[80182]: warnings.warn(msg) Jul 04 09:13:52.110659 dv-cinder-844563-4-smb devstack@keystone.service[80182]: Jul 04 09:13:52.111813 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38b8ad0-ed2f-43f0-b0fc-d5cc28b537f8 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:13:52.134793 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 765/1498] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:13:52 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:13:52.138974 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b42d11-1acf-4891-968e-edc0f889ae7e admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:13:52.149503 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b42d11-1acf-4891-968e-edc0f889ae7e admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:13:52.154072 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77e5bcd-91b0-4a70-b16a-262009fd5dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:13:52.154716 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e5bcd-91b0-4a70-b16a-262009fd5dcb admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:13:52.154994 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e5bcd-91b0-4a70-b16a-262009fd5dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:13:52.155267 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e5bcd-91b0-4a70-b16a-262009fd5dcb admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:13:52.156032 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77e5bcd-91b0-4a70-b16a-262009fd5dcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:13:52.157070 dv-cinder-844563-4-smb devstack@keystone.service[80181]: WARNING py.warnings [None req-d77e5bcd-91b0-4a70-b16a-262009fd5dcb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 04 09:13:52.157070 dv-cinder-844563-4-smb devstack@keystone.service[80181]: warnings.warn(msg) Jul 04 09:13:52.157070 dv-cinder-844563-4-smb devstack@keystone.service[80181]: Jul 04 09:13:52.157951 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77e5bcd-91b0-4a70-b16a-262009fd5dcb admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:13:52.170751 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 734/1499] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:13:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:13:52.174787 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38b8ad0-ed2f-43f0-b0fc-d5cc28b537f8 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:13:52.184873 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38b8ad0-ed2f-43f0-b0fc-d5cc28b537f8 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:13:52.189828 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd1767d-1dfc-49a6-af65-ba5585c117d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:13:52.190490 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd1767d-1dfc-49a6-af65-ba5585c117d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:13:52.190775 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd1767d-1dfc-49a6-af65-ba5585c117d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:13:52.191052 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd1767d-1dfc-49a6-af65-ba5585c117d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:13:52.191783 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd1767d-1dfc-49a6-af65-ba5585c117d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:13:52.192836 dv-cinder-844563-4-smb devstack@keystone.service[80182]: WARNING py.warnings [None req-1bd1767d-1dfc-49a6-af65-ba5585c117d6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 04 09:13:52.192836 dv-cinder-844563-4-smb devstack@keystone.service[80182]: warnings.warn(msg) Jul 04 09:13:52.192836 dv-cinder-844563-4-smb devstack@keystone.service[80182]: Jul 04 09:13:52.193735 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd1767d-1dfc-49a6-af65-ba5585c117d6 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:13:52.207068 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 766/1500] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:13:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:13:52.211231 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77e5bcd-91b0-4a70-b16a-262009fd5dcb admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:13:52.221645 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77e5bcd-91b0-4a70-b16a-262009fd5dcb admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:13:52.226654 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a13634-d2fe-4ff5-b7cc-c4250cedeb3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:13:52.227526 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a13634-d2fe-4ff5-b7cc-c4250cedeb3d admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:13:52.228261 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a13634-d2fe-4ff5-b7cc-c4250cedeb3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:13:52.228547 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a13634-d2fe-4ff5-b7cc-c4250cedeb3d admin admin] PATH_INFO: `/v3/projects/0491ebcb485e434794dbf28857f270a1/users/8f65390be4464123902e7701c7167e72/roles/81634e7812344f84afcb29b0dba2687c` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:13:52.244721 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a13634-d2fe-4ff5-b7cc-c4250cedeb3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0491ebcb485e434794dbf28857f270a1, user_id=8f65390be4464123902e7701c7167e72, role_id=81634e7812344f84afcb29b0dba2687c)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:13:52.245769 dv-cinder-844563-4-smb devstack@keystone.service[80181]: WARNING py.warnings [None req-f7a13634-d2fe-4ff5-b7cc-c4250cedeb3d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 04 09:13:52.245769 dv-cinder-844563-4-smb devstack@keystone.service[80181]: warnings.warn(msg) Jul 04 09:13:52.245769 dv-cinder-844563-4-smb devstack@keystone.service[80181]: Jul 04 09:13:52.247682 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a13634-d2fe-4ff5-b7cc-c4250cedeb3d admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:13:52.263100 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 735/1501] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:13:52 2022] PUT /identity/v3/projects/0491ebcb485e434794dbf28857f270a1/users/8f65390be4464123902e7701c7167e72/roles/81634e7812344f84afcb29b0dba2687c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:13:52.275274 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5bfa52-a9b3-408f-ac43-44b97c829784 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:13:52.275581 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5bfa52-a9b3-408f-ac43-44b97c829784 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:13:52.275858 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5bfa52-a9b3-408f-ac43-44b97c829784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:13:52.302047 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-1f5bfa52-a9b3-408f-ac43-44b97c829784 None None] MFA Rules not processed for user `8f65390be4464123902e7701c7167e72`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:13:52.303239 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-1f5bfa52-a9b3-408f-ac43-44b97c829784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:13:52.368861 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 767/1502] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:13:52 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:13:52.382203 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd37493-e315-4874-b695-ef8ea0ecb3dc None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:13:52.382490 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd37493-e315-4874-b695-ef8ea0ecb3dc None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:13:52.382766 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd37493-e315-4874-b695-ef8ea0ecb3dc None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:13:52.384185 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 736/1503] 10.222.0.42 () {54 vars in 963 bytes} [Mon Jul 4 09:13:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:13:52.389225 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac23c1-5c63-410d-8f36-b6faf61f97c8 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:13:52.389507 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac23c1-5c63-410d-8f36-b6faf61f97c8 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:13:52.389781 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac23c1-5c63-410d-8f36-b6faf61f97c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:13:52.407535 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-d2ac23c1-5c63-410d-8f36-b6faf61f97c8 None None] MFA Rules not processed for user `08f86373d65440da97c853fff3c1d0d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:13:52.408744 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-d2ac23c1-5c63-410d-8f36-b6faf61f97c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:13:52.454239 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:13:52.462920 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 768/1504] 10.222.0.42 () {58 vars in 1060 bytes} [Mon Jul 4 09:13:52 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:13:52.471050 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd37493-e315-4874-b695-ef8ea0ecb3dc None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:13:52.484012 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd37493-e315-4874-b695-ef8ea0ecb3dc None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:13:52.488543 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b6dae3-0f40-4848-94a4-0709c66c5361 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f86373d65440da97c853fff3c1d0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:13:52.489195 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b6dae3-0f40-4848-94a4-0709c66c5361 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:13:52.489472 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b6dae3-0f40-4848-94a4-0709c66c5361 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:13:52.489742 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b6dae3-0f40-4848-94a4-0709c66c5361 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:13:52.498583 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b6dae3-0f40-4848-94a4-0709c66c5361 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:13:52.500114 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b6dae3-0f40-4848-94a4-0709c66c5361 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:13:52.512406 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 737/1505] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:13:52 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:13:52.554099 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817e6f5-c435-4ce7-83e8-335e18c72bb1 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:13:52.554392 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817e6f5-c435-4ce7-83e8-335e18c72bb1 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:13:52.554670 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817e6f5-c435-4ce7-83e8-335e18c72bb1 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:13:52.556023 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 769/1506] 10.222.0.42 () {52 vars in 829 bytes} [Mon Jul 4 09:13:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:13:52.560383 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b6dae3-0f40-4848-94a4-0709c66c5361 service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:13:52.630752 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b6dae3-0f40-4848-94a4-0709c66c5361 service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:13:52.635657 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf7b08b-a3a8-498a-86bc-b88cf11d6b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:13:52.636571 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7b08b-a3a8-498a-86bc-b88cf11d6b0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:13:52.636858 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7b08b-a3a8-498a-86bc-b88cf11d6b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:13:52.637134 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7b08b-a3a8-498a-86bc-b88cf11d6b0d admin admin] PATH_INFO: `/v3/users/8f65390be4464123902e7701c7167e72` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:13:52.638452 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf7b08b-a3a8-498a-86bc-b88cf11d6b0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f65390be4464123902e7701c7167e72)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:13:52.639493 dv-cinder-844563-4-smb devstack@keystone.service[80181]: WARNING py.warnings [None req-3cf7b08b-a3a8-498a-86bc-b88cf11d6b0d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 04 09:13:52.639493 dv-cinder-844563-4-smb devstack@keystone.service[80181]: warnings.warn(msg) Jul 04 09:13:52.639493 dv-cinder-844563-4-smb devstack@keystone.service[80181]: Jul 04 09:13:52.640762 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf7b08b-a3a8-498a-86bc-b88cf11d6b0d admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:13:52.713874 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3cf7b08b-a3a8-498a-86bc-b88cf11d6b0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f65390be4464123902e7701c7167e72'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:13:52.714520 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3cf7b08b-a3a8-498a-86bc-b88cf11d6b0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f65390be4464123902e7701c7167e72'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:13:52.725637 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3cf7b08b-a3a8-498a-86bc-b88cf11d6b0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f65390be4464123902e7701c7167e72'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:13:52.726352 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3cf7b08b-a3a8-498a-86bc-b88cf11d6b0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f65390be4464123902e7701c7167e72'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:13:52.745915 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3cf7b08b-a3a8-498a-86bc-b88cf11d6b0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f65390be4464123902e7701c7167e72'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:13:52.755043 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:13:52.767051 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 738/1507] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:13:52 2022] DELETE /identity/v3/users/8f65390be4464123902e7701c7167e72 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:13:52.771639 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5efed5-6e83-417a-8662-5fd95b925e4a None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:13:52.771972 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5efed5-6e83-417a-8662-5fd95b925e4a None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:13:52.772273 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5efed5-6e83-417a-8662-5fd95b925e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:13:52.789878 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-6f5efed5-6e83-417a-8662-5fd95b925e4a None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:13:52.791102 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-6f5efed5-6e83-417a-8662-5fd95b925e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:13:52.857755 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 770/1508] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:13:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:13:52.867445 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf7b08b-a3a8-498a-86bc-b88cf11d6b0d admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:13:52.868937 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3cf7b08b-a3a8-498a-86bc-b88cf11d6b0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:13:52.929042 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf7b08b-a3a8-498a-86bc-b88cf11d6b0d admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:13:52.933262 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7631092d-cb1b-41b2-a32e-029b5548be15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:13:52.933910 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7631092d-cb1b-41b2-a32e-029b5548be15 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:13:52.934194 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7631092d-cb1b-41b2-a32e-029b5548be15 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:13:52.934470 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7631092d-cb1b-41b2-a32e-029b5548be15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:13:52.944127 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7631092d-cb1b-41b2-a32e-029b5548be15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:13:52.945607 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7631092d-cb1b-41b2-a32e-029b5548be15 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:13:52.955350 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 739/1509] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:13:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:13:53.310266 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5efed5-6e83-417a-8662-5fd95b925e4a None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:13:53.311948 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-6f5efed5-6e83-417a-8662-5fd95b925e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:13:53.324289 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5efed5-6e83-417a-8662-5fd95b925e4a None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:13:53.329596 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731c1e53-252c-47b5-a647-da7f9554eb16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:13:53.333567 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c1e53-252c-47b5-a647-da7f9554eb16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:13:53.333851 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c1e53-252c-47b5-a647-da7f9554eb16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:13:53.334124 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c1e53-252c-47b5-a647-da7f9554eb16 admin admin] PATH_INFO: `/v3/projects/0491ebcb485e434794dbf28857f270a1` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:13:53.335367 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731c1e53-252c-47b5-a647-da7f9554eb16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0491ebcb485e434794dbf28857f270a1)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:13:53.336429 dv-cinder-844563-4-smb devstack@keystone.service[80182]: WARNING py.warnings [None req-731c1e53-252c-47b5-a647-da7f9554eb16 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 04 09:13:53.336429 dv-cinder-844563-4-smb devstack@keystone.service[80182]: warnings.warn(msg) Jul 04 09:13:53.336429 dv-cinder-844563-4-smb devstack@keystone.service[80182]: Jul 04 09:13:53.337594 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731c1e53-252c-47b5-a647-da7f9554eb16 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:13:53.398868 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-731c1e53-252c-47b5-a647-da7f9554eb16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0491ebcb485e434794dbf28857f270a1', 'request_id': 'req-731c1e53-252c-47b5-a647-da7f9554eb16'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:13:53.411042 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-731c1e53-252c-47b5-a647-da7f9554eb16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0491ebcb485e434794dbf28857f270a1', 'request_id': 'req-731c1e53-252c-47b5-a647-da7f9554eb16'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:13:53.421471 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-731c1e53-252c-47b5-a647-da7f9554eb16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0491ebcb485e434794dbf28857f270a1', 'request_id': 'req-731c1e53-252c-47b5-a647-da7f9554eb16'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:13:53.441501 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-731c1e53-252c-47b5-a647-da7f9554eb16 admin admin] The token cache is being invalidate because project 0491ebcb485e434794dbf28857f270a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:13:53.441912 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-731c1e53-252c-47b5-a647-da7f9554eb16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:13:53.443168 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-731c1e53-252c-47b5-a647-da7f9554eb16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:13:53.444875 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 771/1510] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:13:53 2022] DELETE /identity/v3/projects/0491ebcb485e434794dbf28857f270a1 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:14:02.950976 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=29 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:14:03.437635 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:15:38.802436 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5111d3-34cb-44af-8a28-3aa0a0ebe063 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:15:38.803376 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5111d3-34cb-44af-8a28-3aa0a0ebe063 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:15:38.803376 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5111d3-34cb-44af-8a28-3aa0a0ebe063 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:15:38.805642 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 740/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 4 09:15:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:15:38.811733 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c27e4b-666a-4860-932b-413cef1ba4dc None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:15:38.812503 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c27e4b-666a-4860-932b-413cef1ba4dc None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:15:38.812631 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c27e4b-666a-4860-932b-413cef1ba4dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:15:38.831737 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-27c27e4b-666a-4860-932b-413cef1ba4dc None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:15:38.833099 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-27c27e4b-666a-4860-932b-413cef1ba4dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:15:38.901019 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 772/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 4 09:15:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:15:39.059128 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5111d3-34cb-44af-8a28-3aa0a0ebe063 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:15:39.062260 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-8a5111d3-34cb-44af-8a28-3aa0a0ebe063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:15:39.152570 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5111d3-34cb-44af-8a28-3aa0a0ebe063 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:15:39.158977 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30befadc-228a-4816-86e8-c1d8f7fd54c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3b6e252a8c434a99432bcece6493b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:15:39.159645 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30befadc-228a-4816-86e8-c1d8f7fd54c4 service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:15:39.159942 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30befadc-228a-4816-86e8-c1d8f7fd54c4 service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:15:39.160240 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30befadc-228a-4816-86e8-c1d8f7fd54c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:15:39.168865 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30befadc-228a-4816-86e8-c1d8f7fd54c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:15:39.170552 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30befadc-228a-4816-86e8-c1d8f7fd54c4 service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:15:39.180749 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 741/1513] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:15:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:15:40.010691 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f3026-dded-4dd9-abf6-c9aed3593877 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:15:40.011284 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f3026-dded-4dd9-abf6-c9aed3593877 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:15:40.011284 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f3026-dded-4dd9-abf6-c9aed3593877 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:15:40.012666 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 773/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 4 09:15:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:15:40.018682 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0405a5-0aa6-4fdd-88cb-fd858267c007 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:15:40.019375 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0405a5-0aa6-4fdd-88cb-fd858267c007 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:15:40.019569 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0405a5-0aa6-4fdd-88cb-fd858267c007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:15:40.046504 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-5f0405a5-0aa6-4fdd-88cb-fd858267c007 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:15:40.048430 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-5f0405a5-0aa6-4fdd-88cb-fd858267c007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:15:40.057252 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 742/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 4 09:15:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:15:40.209448 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f3026-dded-4dd9-abf6-c9aed3593877 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:15:40.224010 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f3026-dded-4dd9-abf6-c9aed3593877 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:15:40.229617 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c320be66-04a3-48e4-9176-39b31b62b495 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3b6e252a8c434a99432bcece6493b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:15:40.230254 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c320be66-04a3-48e4-9176-39b31b62b495 service nova] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:15:40.230552 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c320be66-04a3-48e4-9176-39b31b62b495 service nova] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:15:40.230814 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c320be66-04a3-48e4-9176-39b31b62b495 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:15:40.239050 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c320be66-04a3-48e4-9176-39b31b62b495 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:15:40.240692 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c320be66-04a3-48e4-9176-39b31b62b495 service nova] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:15:40.250290 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 774/1516] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:15:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:15:40.431423 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce45643e-b327-4fe9-afad-46e2f8b0bb9d None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:15:40.431632 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce45643e-b327-4fe9-afad-46e2f8b0bb9d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:15:40.431901 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce45643e-b327-4fe9-afad-46e2f8b0bb9d None None] PATH_INFO: `/v3` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:15:40.433368 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 743/1517] 10.222.0.70 () {54 vars in 925 bytes} [Mon Jul 4 09:15:40 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:15:40.440321 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d8a683-8b9f-4ded-876c-4ce75ee5b10a None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:15:40.440690 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d8a683-8b9f-4ded-876c-4ce75ee5b10a None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:15:40.440977 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d8a683-8b9f-4ded-876c-4ce75ee5b10a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:15:40.460536 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-c8d8a683-8b9f-4ded-876c-4ce75ee5b10a None None] MFA Rules not processed for user `46ec1a2091f1434cabc69066eb3b6725`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:15:40.461770 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-c8d8a683-8b9f-4ded-876c-4ce75ee5b10a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:15:40.527905 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 775/1518] 10.222.0.70 () {58 vars in 1015 bytes} [Mon Jul 4 09:15:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:15:44.302717 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb79d804-1086-4597-ab43-54d9f8cc6442 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:15:44.303182 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb79d804-1086-4597-ab43-54d9f8cc6442 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:15:44.303293 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb79d804-1086-4597-ab43-54d9f8cc6442 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:15:44.304719 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 744/1519] 10.222.0.42 () {54 vars in 960 bytes} [Mon Jul 4 09:15:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:15:44.309732 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794229bb-8b30-44e6-8470-77a75a7be069 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:15:44.310223 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794229bb-8b30-44e6-8470-77a75a7be069 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:15:44.310331 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794229bb-8b30-44e6-8470-77a75a7be069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:15:44.329213 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-794229bb-8b30-44e6-8470-77a75a7be069 None None] MFA Rules not processed for user `46ec1a2091f1434cabc69066eb3b6725`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:15:44.330425 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-794229bb-8b30-44e6-8470-77a75a7be069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:15:44.340458 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 776/1520] 10.222.0.42 () {58 vars in 1057 bytes} [Mon Jul 4 09:15:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:15:44.348055 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb79d804-1086-4597-ab43-54d9f8cc6442 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:15:44.362768 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb79d804-1086-4597-ab43-54d9f8cc6442 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:15:44.367854 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c2abed-c865-43c0-9406-24d017de85a3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46ec1a2091f1434cabc69066eb3b6725', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:15:44.368510 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2abed-c865-43c0-9406-24d017de85a3 service placement] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:15:44.368791 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2abed-c865-43c0-9406-24d017de85a3 service placement] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:15:44.369070 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2abed-c865-43c0-9406-24d017de85a3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:15:44.377560 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c2abed-c865-43c0-9406-24d017de85a3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:15:44.379170 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c2abed-c865-43c0-9406-24d017de85a3 service placement] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:15:44.388983 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 745/1521] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:15:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:15:51.490472 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5492d6-e6fc-4247-871e-903b299614f3 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:15:51.490993 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5492d6-e6fc-4247-871e-903b299614f3 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:15:51.490993 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5492d6-e6fc-4247-871e-903b299614f3 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:15:51.492495 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 777/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 4 09:15:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:15:51.497372 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f41b42f-e21f-4b78-af03-5bf664ad9855 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:15:51.497813 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f41b42f-e21f-4b78-af03-5bf664ad9855 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:15:51.497924 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f41b42f-e21f-4b78-af03-5bf664ad9855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:15:51.517243 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-1f41b42f-e21f-4b78-af03-5bf664ad9855 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:15:51.518431 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-1f41b42f-e21f-4b78-af03-5bf664ad9855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:15:51.526823 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 746/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 4 09:15:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:15:51.683777 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5492d6-e6fc-4247-871e-903b299614f3 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:15:51.699961 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5492d6-e6fc-4247-871e-903b299614f3 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:15:51.705476 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7918d2-9df3-4d59-b3c8-794ef35e906f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3b6e252a8c434a99432bcece6493b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:15:51.706138 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7918d2-9df3-4d59-b3c8-794ef35e906f service nova] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:15:51.706424 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7918d2-9df3-4d59-b3c8-794ef35e906f service nova] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:15:51.706707 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7918d2-9df3-4d59-b3c8-794ef35e906f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:15:51.715327 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7918d2-9df3-4d59-b3c8-794ef35e906f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:15:51.717042 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7918d2-9df3-4d59-b3c8-794ef35e906f service nova] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:15:51.727737 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 778/1524] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:15:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:15:52.541187 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbea791-d5f3-4bc1-94f9-145a6d7a07dd None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:15:52.541753 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbea791-d5f3-4bc1-94f9-145a6d7a07dd None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:15:52.541753 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbea791-d5f3-4bc1-94f9-145a6d7a07dd None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:15:52.543138 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 747/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 4 09:15:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:15:52.549330 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf896c6-fd7e-4d62-af1d-dd6659e0d018 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:15:52.550280 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf896c6-fd7e-4d62-af1d-dd6659e0d018 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:15:52.550449 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf896c6-fd7e-4d62-af1d-dd6659e0d018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:15:52.580293 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-6cf896c6-fd7e-4d62-af1d-dd6659e0d018 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:15:52.581529 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-6cf896c6-fd7e-4d62-af1d-dd6659e0d018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:15:52.591822 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 779/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 4 09:15:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:15:52.743027 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbea791-d5f3-4bc1-94f9-145a6d7a07dd None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:15:52.759382 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbea791-d5f3-4bc1-94f9-145a6d7a07dd None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:15:52.765824 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1461c7e-2852-41a7-a7e8-0bb9d7cb447c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3b6e252a8c434a99432bcece6493b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:15:52.766442 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1461c7e-2852-41a7-a7e8-0bb9d7cb447c service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:15:52.766720 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1461c7e-2852-41a7-a7e8-0bb9d7cb447c service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:15:52.766986 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1461c7e-2852-41a7-a7e8-0bb9d7cb447c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:15:52.775212 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1461c7e-2852-41a7-a7e8-0bb9d7cb447c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:15:52.776901 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1461c7e-2852-41a7-a7e8-0bb9d7cb447c service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:15:52.786335 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 748/1527] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:15:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:15:56.770914 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0838c91-fe91-4456-836c-ec96c0eb7a40 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:15:56.771480 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0838c91-fe91-4456-836c-ec96c0eb7a40 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:15:56.771480 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0838c91-fe91-4456-836c-ec96c0eb7a40 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:15:56.772907 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 780/1528] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 4 09:15:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:15:56.779260 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c05ce7-6d3a-4f16-a0ee-cc306aed4dd4 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:15:56.780027 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c05ce7-6d3a-4f16-a0ee-cc306aed4dd4 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:15:56.780224 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c05ce7-6d3a-4f16-a0ee-cc306aed4dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:15:56.800807 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-05c05ce7-6d3a-4f16-a0ee-cc306aed4dd4 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:15:56.802045 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-05c05ce7-6d3a-4f16-a0ee-cc306aed4dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:15:56.813329 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 749/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 4 09:15:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:15:56.887788 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0838c91-fe91-4456-836c-ec96c0eb7a40 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:15:56.889665 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-e0838c91-fe91-4456-836c-ec96c0eb7a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:15:56.955588 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0838c91-fe91-4456-836c-ec96c0eb7a40 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:15:56.960569 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74655f6b-876f-47c3-ac14-7e1573ca86b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:15:56.961548 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74655f6b-876f-47c3-ac14-7e1573ca86b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:15:56.961975 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74655f6b-876f-47c3-ac14-7e1573ca86b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:15:56.962414 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74655f6b-876f-47c3-ac14-7e1573ca86b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:15:56.975274 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74655f6b-876f-47c3-ac14-7e1573ca86b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:15:56.977121 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74655f6b-876f-47c3-ac14-7e1573ca86b8 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:15:56.982092 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:15:56.987650 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 781/1530] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:15:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 09:15:59.000373 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9546e0-5660-4702-b627-ce4e74697887 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:15:59.001313 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9546e0-5660-4702-b627-ce4e74697887 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:15:59.001313 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9546e0-5660-4702-b627-ce4e74697887 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:15:59.003505 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 750/1531] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 4 09:15:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:15:59.012542 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e09cdc-2aa8-4b1a-b7c6-46aa7c176f80 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:15:59.013009 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e09cdc-2aa8-4b1a-b7c6-46aa7c176f80 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:15:59.013143 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e09cdc-2aa8-4b1a-b7c6-46aa7c176f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:15:59.039394 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-99e09cdc-2aa8-4b1a-b7c6-46aa7c176f80 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:15:59.040665 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-99e09cdc-2aa8-4b1a-b7c6-46aa7c176f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:15:59.049146 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 782/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 4 09:15:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:15:59.089307 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9546e0-5660-4702-b627-ce4e74697887 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:15:59.091453 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-7c9546e0-5660-4702-b627-ce4e74697887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:15:59.107195 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9546e0-5660-4702-b627-ce4e74697887 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:15:59.111374 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8c45c3-3e4a-4f89-b5ed-0dc8caada462 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:15:59.112048 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c45c3-3e4a-4f89-b5ed-0dc8caada462 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:15:59.112335 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c45c3-3e4a-4f89-b5ed-0dc8caada462 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:15:59.112610 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c45c3-3e4a-4f89-b5ed-0dc8caada462 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:15:59.122036 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8c45c3-3e4a-4f89-b5ed-0dc8caada462 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:15:59.123499 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8c45c3-3e4a-4f89-b5ed-0dc8caada462 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:15:59.133314 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 751/1533] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:15:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:16:02.702026 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe8c7fe-f729-4fa5-99ba-6860052d6cb9 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:16:02.702866 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe8c7fe-f729-4fa5-99ba-6860052d6cb9 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:16:02.703044 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe8c7fe-f729-4fa5-99ba-6860052d6cb9 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:16:02.705439 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 783/1534] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 4 09:16:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:16:02.714705 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871f99d-b0d3-40e4-a930-aa6545c58162 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:16:02.715456 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871f99d-b0d3-40e4-a930-aa6545c58162 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:16:02.715690 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871f99d-b0d3-40e4-a930-aa6545c58162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:16:02.735845 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-5871f99d-b0d3-40e4-a930-aa6545c58162 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:16:02.737093 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-5871f99d-b0d3-40e4-a930-aa6545c58162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:16:02.745148 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 752/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 4 09:16:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:16:03.061687 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe8c7fe-f729-4fa5-99ba-6860052d6cb9 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:16:03.064866 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-afe8c7fe-f729-4fa5-99ba-6860052d6cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:16:03.137008 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe8c7fe-f729-4fa5-99ba-6860052d6cb9 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:16:03.143195 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaa0207-92de-43ca-b59f-7cc4b80dec68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f86373d65440da97c853fff3c1d0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:16:03.143766 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa0207-92de-43ca-b59f-7cc4b80dec68 service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:16:03.144087 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa0207-92de-43ca-b59f-7cc4b80dec68 service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:16:03.144368 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa0207-92de-43ca-b59f-7cc4b80dec68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:16:03.153867 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaa0207-92de-43ca-b59f-7cc4b80dec68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:16:03.155318 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaa0207-92de-43ca-b59f-7cc4b80dec68 service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:16:03.165286 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 784/1536] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:16:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:16:05.234179 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f278c7-34c8-4259-a78e-8e3923d76bf5 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:16:05.234989 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f278c7-34c8-4259-a78e-8e3923d76bf5 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:16:05.234989 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f278c7-34c8-4259-a78e-8e3923d76bf5 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:16:05.236388 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 753/1537] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 4 09:16:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:16:05.242818 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912487f-718b-445f-851a-e3c0ba9951d8 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:16:05.243279 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912487f-718b-445f-851a-e3c0ba9951d8 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:16:05.243413 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912487f-718b-445f-851a-e3c0ba9951d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:16:05.270993 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-6912487f-718b-445f-851a-e3c0ba9951d8 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:16:05.272229 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-6912487f-718b-445f-851a-e3c0ba9951d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:16:05.281506 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 785/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 4 09:16:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:16:05.580988 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f278c7-34c8-4259-a78e-8e3923d76bf5 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:16:05.583045 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-79f278c7-34c8-4259-a78e-8e3923d76bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:16:05.591849 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=65 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:16:05.598674 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f278c7-34c8-4259-a78e-8e3923d76bf5 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:16:05.603060 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaee7fa-9286-4864-9046-41a770e31713 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f86373d65440da97c853fff3c1d0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:16:05.603699 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaee7fa-9286-4864-9046-41a770e31713 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:16:05.604013 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaee7fa-9286-4864-9046-41a770e31713 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:16:05.604287 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaee7fa-9286-4864-9046-41a770e31713 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:16:05.614322 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaee7fa-9286-4864-9046-41a770e31713 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:16:05.615819 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaee7fa-9286-4864-9046-41a770e31713 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:16:05.625876 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 754/1539] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:16:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:16:15.264877 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=32 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:16:15.621544 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=5 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:17:37.706311 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a69f82a-1331-43b2-9053-95910117097d None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:37.707608 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a69f82a-1331-43b2-9053-95910117097d None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:37.708234 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a69f82a-1331-43b2-9053-95910117097d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:37.734520 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-4a69f82a-1331-43b2-9053-95910117097d None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:17:37.735815 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-4a69f82a-1331-43b2-9053-95910117097d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:17:37.753480 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 786/1540] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:17:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:17:37.763017 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8094b48b-d706-4649-810a-b9742d195cee None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:37.764447 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8094b48b-d706-4649-810a-b9742d195cee None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:37.765436 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8094b48b-d706-4649-810a-b9742d195cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:37.798245 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-8094b48b-d706-4649-810a-b9742d195cee None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:17:37.799921 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-8094b48b-d706-4649-810a-b9742d195cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:17:37.817788 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 755/1541] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:17:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:17:37.823290 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a69f82a-1331-43b2-9053-95910117097d None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:37.838082 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a69f82a-1331-43b2-9053-95910117097d None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:37.850428 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f0e102-2151-49e7-aef1-d8bb7b0b02b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:37.851138 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f0e102-2151-49e7-aef1-d8bb7b0b02b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:37.851425 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f0e102-2151-49e7-aef1-d8bb7b0b02b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:37.851707 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f0e102-2151-49e7-aef1-d8bb7b0b02b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:37.852512 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f0e102-2151-49e7-aef1-d8bb7b0b02b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:17:37.852977 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f0e102-2151-49e7-aef1-d8bb7b0b02b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:37.854729 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f0e102-2151-49e7-aef1-d8bb7b0b02b9 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:37.873277 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 787/1542] 10.222.0.42 () {58 vars in 1152 bytes} [Mon Jul 4 09:17:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:17:37.881909 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8094b48b-d706-4649-810a-b9742d195cee None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:37.900946 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8094b48b-d706-4649-810a-b9742d195cee None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:37.911134 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d26b19b-bde2-4005-af84-c0388bb1dc1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:37.912022 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d26b19b-bde2-4005-af84-c0388bb1dc1c admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:37.912336 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d26b19b-bde2-4005-af84-c0388bb1dc1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:37.912637 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d26b19b-bde2-4005-af84-c0388bb1dc1c admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:37.913497 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d26b19b-bde2-4005-af84-c0388bb1dc1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:37.915721 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d26b19b-bde2-4005-af84-c0388bb1dc1c admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:37.965008 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 756/1543] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:17:37 2022] POST /identity/v3/projects => generated 361 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:17:37.969738 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f0e102-2151-49e7-aef1-d8bb7b0b02b9 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:37.991043 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f0e102-2151-49e7-aef1-d8bb7b0b02b9 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:38.072988 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb36f74-50be-4f62-8a1b-01415febd5eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:38.074249 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb36f74-50be-4f62-8a1b-01415febd5eb admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:38.074821 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb36f74-50be-4f62-8a1b-01415febd5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:38.075389 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb36f74-50be-4f62-8a1b-01415febd5eb admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:38.076553 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb36f74-50be-4f62-8a1b-01415febd5eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:38.078890 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb36f74-50be-4f62-8a1b-01415febd5eb admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:38.106398 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 788/1544] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:17:37 2022] POST /identity/v3/users => generated 281 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:17:38.110841 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d26b19b-bde2-4005-af84-c0388bb1dc1c admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:38.127783 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d26b19b-bde2-4005-af84-c0388bb1dc1c admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:38.140672 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a505d9-e66f-4dce-861f-ecdf31a8c823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:38.141482 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a505d9-e66f-4dce-861f-ecdf31a8c823 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:38.141772 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a505d9-e66f-4dce-861f-ecdf31a8c823 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:38.142055 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a505d9-e66f-4dce-861f-ecdf31a8c823 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:38.142963 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a505d9-e66f-4dce-861f-ecdf31a8c823 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:38.144815 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a505d9-e66f-4dce-861f-ecdf31a8c823 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:38.162882 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 757/1545] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:17:38 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:17:38.166836 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb36f74-50be-4f62-8a1b-01415febd5eb admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:38.183267 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb36f74-50be-4f62-8a1b-01415febd5eb admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:38.192332 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4797a830-78bb-41b1-9b53-a94e81d6f94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:38.193318 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4797a830-78bb-41b1-9b53-a94e81d6f94f admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:38.193829 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4797a830-78bb-41b1-9b53-a94e81d6f94f admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:38.194324 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4797a830-78bb-41b1-9b53-a94e81d6f94f admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:38.195280 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4797a830-78bb-41b1-9b53-a94e81d6f94f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:38.197160 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4797a830-78bb-41b1-9b53-a94e81d6f94f admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:38.214762 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 789/1546] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:17:38 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:17:38.218963 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a505d9-e66f-4dce-861f-ecdf31a8c823 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:38.233340 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a505d9-e66f-4dce-861f-ecdf31a8c823 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:38.244512 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baa0d34-2f17-430b-869f-44e46afc5f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:38.245541 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa0d34-2f17-430b-869f-44e46afc5f0c admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:38.245932 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa0d34-2f17-430b-869f-44e46afc5f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:38.246352 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa0d34-2f17-430b-869f-44e46afc5f0c admin admin] PATH_INFO: `/v3/projects/7c966ebce50b4a1f82b401c4c3dd406d/users/d07378d5e355446ea7f420786014d024/roles/81634e7812344f84afcb29b0dba2687c` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:38.271443 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baa0d34-2f17-430b-869f-44e46afc5f0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c966ebce50b4a1f82b401c4c3dd406d, user_id=d07378d5e355446ea7f420786014d024, role_id=81634e7812344f84afcb29b0dba2687c)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:38.274836 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baa0d34-2f17-430b-869f-44e46afc5f0c admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:38.293190 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 758/1547] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:17:38 2022] PUT /identity/v3/projects/7c966ebce50b4a1f82b401c4c3dd406d/users/d07378d5e355446ea7f420786014d024/roles/81634e7812344f84afcb29b0dba2687c => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:17:38.301403 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b7d2d-2d95-401c-936a-349c1377d1e4 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:38.302005 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b7d2d-2d95-401c-936a-349c1377d1e4 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:38.302650 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b7d2d-2d95-401c-936a-349c1377d1e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:38.311932 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c31f5-0ae1-4eef-b145-497dc3a63a6e None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:38.312349 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c31f5-0ae1-4eef-b145-497dc3a63a6e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:38.312633 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c31f5-0ae1-4eef-b145-497dc3a63a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:38.340235 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-847b7d2d-2d95-401c-936a-349c1377d1e4 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:17:38.341572 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-847b7d2d-2d95-401c-936a-349c1377d1e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:17:38.367229 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-756c31f5-0ae1-4eef-b145-497dc3a63a6e None None] MFA Rules not processed for user `d07378d5e355446ea7f420786014d024`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:17:38.369331 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-756c31f5-0ae1-4eef-b145-497dc3a63a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:17:38.445881 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 759/1548] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:17:38 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:17:38.447298 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f397e31-f6bd-4696-9f69-745239ed6ed8 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:38.447655 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f397e31-f6bd-4696-9f69-745239ed6ed8 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:38.448087 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f397e31-f6bd-4696-9f69-745239ed6ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:38.454600 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 790/1549] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:17:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:17:38.456474 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d614e6-0e69-42fe-92f4-92a8843c2c8c None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:38.458028 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d614e6-0e69-42fe-92f4-92a8843c2c8c None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:38.458664 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d614e6-0e69-42fe-92f4-92a8843c2c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:38.468606 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-8f397e31-f6bd-4696-9f69-745239ed6ed8 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:17:38.469848 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-8f397e31-f6bd-4696-9f69-745239ed6ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:17:38.479900 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 760/1550] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:17:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:17:38.480993 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c443c11c-7896-4686-90bc-28ba4b091b41 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:38.480993 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c443c11c-7896-4686-90bc-28ba4b091b41 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:38.481190 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c443c11c-7896-4686-90bc-28ba4b091b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:38.486874 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-47d614e6-0e69-42fe-92f4-92a8843c2c8c None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:17:38.488471 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-47d614e6-0e69-42fe-92f4-92a8843c2c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:17:38.496677 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 791/1551] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:17:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:17:38.498006 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa435300-fbfc-4e77-8de3-5c3624bf7dfa None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:38.498311 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa435300-fbfc-4e77-8de3-5c3624bf7dfa None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:38.498703 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa435300-fbfc-4e77-8de3-5c3624bf7dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:38.509953 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-c443c11c-7896-4686-90bc-28ba4b091b41 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:17:38.511248 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c443c11c-7896-4686-90bc-28ba4b091b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:17:38.516490 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-fa435300-fbfc-4e77-8de3-5c3624bf7dfa None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:17:38.517657 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-fa435300-fbfc-4e77-8de3-5c3624bf7dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:17:38.519928 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 761/1552] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:17:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:17:38.521199 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e59140d-e256-457b-b04e-65c68903b18c None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:38.521579 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e59140d-e256-457b-b04e-65c68903b18c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:38.521860 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e59140d-e256-457b-b04e-65c68903b18c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:38.530334 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 792/1553] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:17:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:17:38.531204 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa435300-fbfc-4e77-8de3-5c3624bf7dfa None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:38.541235 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa435300-fbfc-4e77-8de3-5c3624bf7dfa None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:38.541763 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-9e59140d-e256-457b-b04e-65c68903b18c None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:17:38.543082 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9e59140d-e256-457b-b04e-65c68903b18c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:17:38.546019 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb60ce6-f0e7-400b-a209-8e25b645d481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:38.546754 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb60ce6-f0e7-400b-a209-8e25b645d481 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:38.547032 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb60ce6-f0e7-400b-a209-8e25b645d481 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:38.547306 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb60ce6-f0e7-400b-a209-8e25b645d481 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:38.548084 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb60ce6-f0e7-400b-a209-8e25b645d481 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:38.549136 dv-cinder-844563-4-smb devstack@keystone.service[80182]: WARNING py.warnings [None req-fbb60ce6-f0e7-400b-a209-8e25b645d481 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 04 09:17:38.549136 dv-cinder-844563-4-smb devstack@keystone.service[80182]: warnings.warn(msg) Jul 04 09:17:38.549136 dv-cinder-844563-4-smb devstack@keystone.service[80182]: Jul 04 09:17:38.550349 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb60ce6-f0e7-400b-a209-8e25b645d481 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:38.551557 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 762/1554] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:17:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:17:38.552931 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81646950-0985-4146-8a6c-1d4657f7528d None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:38.553245 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81646950-0985-4146-8a6c-1d4657f7528d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:38.553607 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81646950-0985-4146-8a6c-1d4657f7528d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:38.575318 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-81646950-0985-4146-8a6c-1d4657f7528d None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:17:38.576651 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-81646950-0985-4146-8a6c-1d4657f7528d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:17:38.581105 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 793/1555] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:17:38 2022] POST /identity/v3/projects => generated 365 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:17:38.581105 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4245a6c2-4ac0-4892-b27f-394f512cb59d None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:38.581105 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4245a6c2-4ac0-4892-b27f-394f512cb59d None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:38.581105 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4245a6c2-4ac0-4892-b27f-394f512cb59d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:38.598117 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-4245a6c2-4ac0-4892-b27f-394f512cb59d None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:17:38.599302 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-4245a6c2-4ac0-4892-b27f-394f512cb59d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:17:38.619121 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:17:38.637711 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 763/1556] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:17:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:17:38.639191 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c659b-0608-4666-9a19-dfee7ad054ce None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:38.639515 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c659b-0608-4666-9a19-dfee7ad054ce None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:38.639811 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c659b-0608-4666-9a19-dfee7ad054ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:38.653366 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:17:38.661143 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-ed6c659b-0608-4666-9a19-dfee7ad054ce None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:17:38.662773 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ed6c659b-0608-4666-9a19-dfee7ad054ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:17:38.666388 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 794/1557] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:17:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:17:38.667724 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ac559-14ca-44b5-98bf-11042d5c8a3c None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:38.668065 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ac559-14ca-44b5-98bf-11042d5c8a3c None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:38.668348 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ac559-14ca-44b5-98bf-11042d5c8a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:38.680355 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 764/1558] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:17:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:17:38.682039 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44605c2-7127-458f-8b41-4225359a1cdb None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:38.682331 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44605c2-7127-458f-8b41-4225359a1cdb None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:38.682755 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44605c2-7127-458f-8b41-4225359a1cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:38.688554 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-0e4ac559-14ca-44b5-98bf-11042d5c8a3c None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:17:38.689773 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-0e4ac559-14ca-44b5-98bf-11042d5c8a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:17:38.699090 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 795/1559] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:17:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:17:38.701350 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-d44605c2-7127-458f-8b41-4225359a1cdb None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:17:38.701482 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304522b0-fcfe-41d7-bf77-4ca217c84120 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:38.702024 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304522b0-fcfe-41d7-bf77-4ca217c84120 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:38.702483 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304522b0-fcfe-41d7-bf77-4ca217c84120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:38.702594 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d44605c2-7127-458f-8b41-4225359a1cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:17:38.711323 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 765/1560] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:17:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:17:38.712526 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739dc06-b54c-4853-9024-24061aaf7b5c None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:38.712808 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739dc06-b54c-4853-9024-24061aaf7b5c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:38.713133 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739dc06-b54c-4853-9024-24061aaf7b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:38.725960 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-304522b0-fcfe-41d7-bf77-4ca217c84120 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:17:38.726793 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-304522b0-fcfe-41d7-bf77-4ca217c84120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:17:38.731388 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-3739dc06-b54c-4853-9024-24061aaf7b5c None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:17:38.732630 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3739dc06-b54c-4853-9024-24061aaf7b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:17:38.735554 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 796/1561] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:17:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:17:38.736384 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304522b0-fcfe-41d7-bf77-4ca217c84120 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:38.744116 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 766/1562] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:17:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:17:38.744116 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3739dc06-b54c-4853-9024-24061aaf7b5c None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:38.750066 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304522b0-fcfe-41d7-bf77-4ca217c84120 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:38.751037 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3739dc06-b54c-4853-9024-24061aaf7b5c None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:38.754796 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd06d6f-6fc8-44de-9c58-aec4d782d490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:38.755595 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3239b030-a121-4e3a-9aeb-dcbf764d927b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:38.755750 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd06d6f-6fc8-44de-9c58-aec4d782d490 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:38.755968 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd06d6f-6fc8-44de-9c58-aec4d782d490 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:38.756252 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239b030-a121-4e3a-9aeb-dcbf764d927b admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:38.756368 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd06d6f-6fc8-44de-9c58-aec4d782d490 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:38.756517 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239b030-a121-4e3a-9aeb-dcbf764d927b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:38.756789 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239b030-a121-4e3a-9aeb-dcbf764d927b admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:38.756920 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd06d6f-6fc8-44de-9c58-aec4d782d490 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:38.757509 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3239b030-a121-4e3a-9aeb-dcbf764d927b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:17:38.757811 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3239b030-a121-4e3a-9aeb-dcbf764d927b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:38.758861 dv-cinder-844563-4-smb devstack@keystone.service[80181]: WARNING py.warnings [None req-3239b030-a121-4e3a-9aeb-dcbf764d927b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 04 09:17:38.758861 dv-cinder-844563-4-smb devstack@keystone.service[80181]: warnings.warn(msg) Jul 04 09:17:38.758861 dv-cinder-844563-4-smb devstack@keystone.service[80181]: Jul 04 09:17:38.759122 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd06d6f-6fc8-44de-9c58-aec4d782d490 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:38.759746 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3239b030-a121-4e3a-9aeb-dcbf764d927b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:38.772463 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 767/1563] 10.222.0.42 () {58 vars in 1152 bytes} [Mon Jul 4 09:17:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:17:38.774645 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba46b20-d7ee-4fdf-a9f8-a55362a11329 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:38.774970 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba46b20-d7ee-4fdf-a9f8-a55362a11329 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:38.775258 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba46b20-d7ee-4fdf-a9f8-a55362a11329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:38.787001 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 797/1564] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:17:38 2022] POST /identity/v3/users => generated 289 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:17:38.787988 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd06d6f-6fc8-44de-9c58-aec4d782d490 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:38.795743 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-aba46b20-d7ee-4fdf-a9f8-a55362a11329 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:17:38.797023 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-aba46b20-d7ee-4fdf-a9f8-a55362a11329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:17:38.797944 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd06d6f-6fc8-44de-9c58-aec4d782d490 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:38.802652 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588929ca-d417-4f17-b049-7e4b560589c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:38.803319 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588929ca-d417-4f17-b049-7e4b560589c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:38.803600 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588929ca-d417-4f17-b049-7e4b560589c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:38.803905 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588929ca-d417-4f17-b049-7e4b560589c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:38.804652 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588929ca-d417-4f17-b049-7e4b560589c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:17:38.804972 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588929ca-d417-4f17-b049-7e4b560589c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:38.809903 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 768/1565] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:17:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:17:38.810081 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588929ca-d417-4f17-b049-7e4b560589c6 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:38.810181 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba46b20-d7ee-4fdf-a9f8-a55362a11329 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:38.817358 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba46b20-d7ee-4fdf-a9f8-a55362a11329 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:38.819787 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 798/1566] 10.222.0.42 () {58 vars in 1152 bytes} [Mon Jul 4 09:17:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:17:38.820674 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588929ca-d417-4f17-b049-7e4b560589c6 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:38.823779 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a7e975-5f1c-4286-ba7f-6283714307be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:38.824460 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a7e975-5f1c-4286-ba7f-6283714307be admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:38.824761 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a7e975-5f1c-4286-ba7f-6283714307be admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:38.825025 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a7e975-5f1c-4286-ba7f-6283714307be admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:38.825770 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a7e975-5f1c-4286-ba7f-6283714307be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:17:38.826078 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a7e975-5f1c-4286-ba7f-6283714307be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:38.828282 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a7e975-5f1c-4286-ba7f-6283714307be admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:38.834985 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588929ca-d417-4f17-b049-7e4b560589c6 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:38.840174 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca48e4c-230d-4e14-b734-819d9aa77d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:38.840827 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca48e4c-230d-4e14-b734-819d9aa77d0d admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:38.840966 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 769/1567] 10.222.0.42 () {58 vars in 1152 bytes} [Mon Jul 4 09:17:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:17:38.841090 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca48e4c-230d-4e14-b734-819d9aa77d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:38.841366 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca48e4c-230d-4e14-b734-819d9aa77d0d admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:38.841718 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a7e975-5f1c-4286-ba7f-6283714307be admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:38.842092 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca48e4c-230d-4e14-b734-819d9aa77d0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:17:38.842507 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca48e4c-230d-4e14-b734-819d9aa77d0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:38.844319 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca48e4c-230d-4e14-b734-819d9aa77d0d admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:38.865090 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 799/1568] 10.222.0.42 () {58 vars in 1152 bytes} [Mon Jul 4 09:17:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:17:38.865090 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca48e4c-230d-4e14-b734-819d9aa77d0d admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:38.865375 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a7e975-5f1c-4286-ba7f-6283714307be admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:38.865375 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becfa4da-7996-4fbd-97d0-d8058dd7581d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:38.866067 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becfa4da-7996-4fbd-97d0-d8058dd7581d admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:38.866354 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becfa4da-7996-4fbd-97d0-d8058dd7581d admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:38.866632 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becfa4da-7996-4fbd-97d0-d8058dd7581d admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:38.867364 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becfa4da-7996-4fbd-97d0-d8058dd7581d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:17:38.867677 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becfa4da-7996-4fbd-97d0-d8058dd7581d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:38.868309 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca48e4c-230d-4e14-b734-819d9aa77d0d admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:38.869379 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becfa4da-7996-4fbd-97d0-d8058dd7581d admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:38.872854 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c13476a-7e63-4078-94d6-97b00eecb936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:38.873555 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13476a-7e63-4078-94d6-97b00eecb936 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:38.873907 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13476a-7e63-4078-94d6-97b00eecb936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:38.874174 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13476a-7e63-4078-94d6-97b00eecb936 admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:38.874936 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c13476a-7e63-4078-94d6-97b00eecb936 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:17:38.875300 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c13476a-7e63-4078-94d6-97b00eecb936 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:38.876979 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c13476a-7e63-4078-94d6-97b00eecb936 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:38.882980 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 770/1569] 10.222.0.42 () {58 vars in 1152 bytes} [Mon Jul 4 09:17:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:17:38.883632 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becfa4da-7996-4fbd-97d0-d8058dd7581d admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:38.892025 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 800/1570] 10.222.0.42 () {58 vars in 1152 bytes} [Mon Jul 4 09:17:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:17:38.892934 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c13476a-7e63-4078-94d6-97b00eecb936 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:38.901362 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becfa4da-7996-4fbd-97d0-d8058dd7581d admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:38.903974 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c13476a-7e63-4078-94d6-97b00eecb936 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:38.906357 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55911e86-d474-42cd-9c4f-bdf04ae6ad7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:38.907032 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55911e86-d474-42cd-9c4f-bdf04ae6ad7b admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:38.907312 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55911e86-d474-42cd-9c4f-bdf04ae6ad7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:38.907583 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55911e86-d474-42cd-9c4f-bdf04ae6ad7b admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:38.908373 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55911e86-d474-42cd-9c4f-bdf04ae6ad7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:38.909139 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fb7264-0b3f-4f43-b5f6-15750e25a870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:38.909784 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb7264-0b3f-4f43-b5f6-15750e25a870 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:38.910071 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb7264-0b3f-4f43-b5f6-15750e25a870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:38.910345 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55911e86-d474-42cd-9c4f-bdf04ae6ad7b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:38.910456 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb7264-0b3f-4f43-b5f6-15750e25a870 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:38.911146 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fb7264-0b3f-4f43-b5f6-15750e25a870 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:38.912872 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fb7264-0b3f-4f43-b5f6-15750e25a870 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:38.924771 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 801/1571] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:17:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:17:38.925733 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fb7264-0b3f-4f43-b5f6-15750e25a870 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:38.936891 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fb7264-0b3f-4f43-b5f6-15750e25a870 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:38.941379 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 771/1572] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:17:38 2022] POST /identity/v3/projects => generated 391 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:17:38.941379 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55911e86-d474-42cd-9c4f-bdf04ae6ad7b admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:38.996477 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5185745e-e793-46bb-9c6d-7657ee29c057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:38.997203 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5185745e-e793-46bb-9c6d-7657ee29c057 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:38.997487 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5185745e-e793-46bb-9c6d-7657ee29c057 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:38.997761 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5185745e-e793-46bb-9c6d-7657ee29c057 admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:38.998528 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5185745e-e793-46bb-9c6d-7657ee29c057 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:17:38.998884 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5185745e-e793-46bb-9c6d-7657ee29c057 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:39.000623 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5185745e-e793-46bb-9c6d-7657ee29c057 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:39.004595 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55911e86-d474-42cd-9c4f-bdf04ae6ad7b admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:39.009922 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe5209e-e4b7-4758-ae19-bbf6b1b7ebab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:39.010620 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe5209e-e4b7-4758-ae19-bbf6b1b7ebab admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:39.011033 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe5209e-e4b7-4758-ae19-bbf6b1b7ebab admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:39.011299 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe5209e-e4b7-4758-ae19-bbf6b1b7ebab admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:39.012083 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe5209e-e4b7-4758-ae19-bbf6b1b7ebab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:39.012502 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 802/1573] 10.222.0.42 () {58 vars in 1152 bytes} [Mon Jul 4 09:17:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:17:39.013448 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5185745e-e793-46bb-9c6d-7657ee29c057 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:39.014350 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe5209e-e4b7-4758-ae19-bbf6b1b7ebab admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:39.023493 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5185745e-e793-46bb-9c6d-7657ee29c057 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:39.028309 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f92cb4-a17e-441a-973a-fb16e1b1d04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:39.029016 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f92cb4-a17e-441a-973a-fb16e1b1d04f admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:39.029422 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f92cb4-a17e-441a-973a-fb16e1b1d04f admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:39.029912 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f92cb4-a17e-441a-973a-fb16e1b1d04f admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:39.031438 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f92cb4-a17e-441a-973a-fb16e1b1d04f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:39.034471 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f92cb4-a17e-441a-973a-fb16e1b1d04f admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:39.045156 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 772/1574] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:17:38 2022] POST /identity/v3/projects => generated 377 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:17:39.046162 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe5209e-e4b7-4758-ae19-bbf6b1b7ebab admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:39.069397 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 803/1575] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:17:39 2022] POST /identity/v3/projects => generated 357 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:17:39.073308 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f92cb4-a17e-441a-973a-fb16e1b1d04f admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:39.091404 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:17:39.110666 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe5209e-e4b7-4758-ae19-bbf6b1b7ebab admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:39.119399 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:17:39.139532 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f92cb4-a17e-441a-973a-fb16e1b1d04f admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:39.144636 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a160d122-4cd3-4a07-b233-ff6e8d85c259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:39.145451 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a160d122-4cd3-4a07-b233-ff6e8d85c259 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:39.145741 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a160d122-4cd3-4a07-b233-ff6e8d85c259 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:39.146025 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a160d122-4cd3-4a07-b233-ff6e8d85c259 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:39.146732 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a160d122-4cd3-4a07-b233-ff6e8d85c259 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:39.148769 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a160d122-4cd3-4a07-b233-ff6e8d85c259 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:39.170338 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120e8613-297c-498c-b842-b1c18a2df1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:39.171116 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e8613-297c-498c-b842-b1c18a2df1de admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:39.171400 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e8613-297c-498c-b842-b1c18a2df1de admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:39.171678 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e8613-297c-498c-b842-b1c18a2df1de admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:39.172401 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120e8613-297c-498c-b842-b1c18a2df1de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:39.174356 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120e8613-297c-498c-b842-b1c18a2df1de admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:39.175732 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 804/1576] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:17:39 2022] POST /identity/v3/projects => generated 367 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:17:39.176708 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a160d122-4cd3-4a07-b233-ff6e8d85c259 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:39.205439 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 773/1577] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:17:39 2022] POST /identity/v3/projects => generated 389 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:17:39.206264 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120e8613-297c-498c-b842-b1c18a2df1de admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:39.247283 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a160d122-4cd3-4a07-b233-ff6e8d85c259 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:39.272149 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120e8613-297c-498c-b842-b1c18a2df1de admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:39.276808 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a768059f-aef0-4143-88be-2166064f4886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:39.277707 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768059f-aef0-4143-88be-2166064f4886 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:39.277993 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768059f-aef0-4143-88be-2166064f4886 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:39.278264 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768059f-aef0-4143-88be-2166064f4886 admin admin] PATH_INFO: `/v3/projects/0d3c7bd9ba1b4d038af6266ee4d25ac2/users/36808302afce48e4873de88c23eaf46c/roles/965049e7ce6144aaad23c15f3a5e37c3` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:39.292836 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a768059f-aef0-4143-88be-2166064f4886 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d3c7bd9ba1b4d038af6266ee4d25ac2, user_id=36808302afce48e4873de88c23eaf46c, role_id=965049e7ce6144aaad23c15f3a5e37c3)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:39.295587 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a768059f-aef0-4143-88be-2166064f4886 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:39.310139 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 774/1578] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:17:39 2022] PUT /identity/v3/projects/0d3c7bd9ba1b4d038af6266ee4d25ac2/users/36808302afce48e4873de88c23eaf46c/roles/965049e7ce6144aaad23c15f3a5e37c3 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:17:39.310968 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a768059f-aef0-4143-88be-2166064f4886 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:39.315236 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc78dcd8-5e48-4be3-bef8-2adfae7a089b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:39.315978 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc78dcd8-5e48-4be3-bef8-2adfae7a089b admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:39.316272 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc78dcd8-5e48-4be3-bef8-2adfae7a089b admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:39.316564 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc78dcd8-5e48-4be3-bef8-2adfae7a089b admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:39.317311 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc78dcd8-5e48-4be3-bef8-2adfae7a089b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:39.319297 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc78dcd8-5e48-4be3-bef8-2adfae7a089b admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:39.346341 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 805/1579] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:17:39 2022] POST /identity/v3/projects => generated 385 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:17:39.347613 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc78dcd8-5e48-4be3-bef8-2adfae7a089b admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:39.373970 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a768059f-aef0-4143-88be-2166064f4886 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:39.383197 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:17:39.402599 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:17:39.412366 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc78dcd8-5e48-4be3-bef8-2adfae7a089b admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:39.416943 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c232d7-a54d-41c7-8997-58e97a831507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:39.417607 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c232d7-a54d-41c7-8997-58e97a831507 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:39.417894 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c232d7-a54d-41c7-8997-58e97a831507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:39.418169 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c232d7-a54d-41c7-8997-58e97a831507 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:39.418887 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c232d7-a54d-41c7-8997-58e97a831507 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:39.420885 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c232d7-a54d-41c7-8997-58e97a831507 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:39.439384 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897077a1-0e90-4e79-9585-6ad856250747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:39.440150 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897077a1-0e90-4e79-9585-6ad856250747 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:39.440430 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897077a1-0e90-4e79-9585-6ad856250747 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:39.440708 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897077a1-0e90-4e79-9585-6ad856250747 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:39.441399 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897077a1-0e90-4e79-9585-6ad856250747 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:39.442443 dv-cinder-844563-4-smb devstack@keystone.service[80181]: WARNING py.warnings [None req-897077a1-0e90-4e79-9585-6ad856250747 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 04 09:17:39.442443 dv-cinder-844563-4-smb devstack@keystone.service[80181]: warnings.warn(msg) Jul 04 09:17:39.442443 dv-cinder-844563-4-smb devstack@keystone.service[80181]: Jul 04 09:17:39.443663 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897077a1-0e90-4e79-9585-6ad856250747 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:39.448652 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 806/1580] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:17:39 2022] POST /identity/v3/projects => generated 377 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:17:39.449508 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c232d7-a54d-41c7-8997-58e97a831507 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:39.468357 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 775/1581] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:17:39 2022] POST /identity/v3/users => generated 296 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:17:39.468357 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897077a1-0e90-4e79-9585-6ad856250747 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:39.476250 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897077a1-0e90-4e79-9585-6ad856250747 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:39.523399 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c232d7-a54d-41c7-8997-58e97a831507 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:39.528613 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e8647c-c748-4a12-90de-608c6768faff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:39.529323 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e8647c-c748-4a12-90de-608c6768faff admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:39.529630 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e8647c-c748-4a12-90de-608c6768faff admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:39.530063 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e8647c-c748-4a12-90de-608c6768faff admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:39.530803 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e8647c-c748-4a12-90de-608c6768faff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:39.532956 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e8647c-c748-4a12-90de-608c6768faff admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:39.534130 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33273683-74a3-4a5d-882f-cf0dfc1d1cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:39.534801 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33273683-74a3-4a5d-882f-cf0dfc1d1cdf admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:39.535088 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33273683-74a3-4a5d-882f-cf0dfc1d1cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:39.535365 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33273683-74a3-4a5d-882f-cf0dfc1d1cdf admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:39.536100 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33273683-74a3-4a5d-882f-cf0dfc1d1cdf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:39.538149 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33273683-74a3-4a5d-882f-cf0dfc1d1cdf admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:39.554067 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 807/1582] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:17:39 2022] POST /identity/v3/users => generated 289 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:17:39.555018 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e8647c-c748-4a12-90de-608c6768faff admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:39.558869 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 776/1583] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:17:39 2022] POST /identity/v3/users => generated 279 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:17:39.559810 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33273683-74a3-4a5d-882f-cf0dfc1d1cdf admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:39.569733 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e8647c-c748-4a12-90de-608c6768faff admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:39.573473 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33273683-74a3-4a5d-882f-cf0dfc1d1cdf admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:39.575030 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de16621-1983-4986-8bfa-ddd6ae387510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:39.575807 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de16621-1983-4986-8bfa-ddd6ae387510 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:39.576171 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de16621-1983-4986-8bfa-ddd6ae387510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:39.576450 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de16621-1983-4986-8bfa-ddd6ae387510 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:39.577212 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de16621-1983-4986-8bfa-ddd6ae387510 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:39.578688 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba834a3-8424-4db0-9981-5d57136bbe60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:39.579588 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de16621-1983-4986-8bfa-ddd6ae387510 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:39.579709 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba834a3-8424-4db0-9981-5d57136bbe60 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:39.579810 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba834a3-8424-4db0-9981-5d57136bbe60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:39.580174 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba834a3-8424-4db0-9981-5d57136bbe60 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:39.580930 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba834a3-8424-4db0-9981-5d57136bbe60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:39.583347 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba834a3-8424-4db0-9981-5d57136bbe60 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:39.605118 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 808/1584] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:17:39 2022] POST /identity/v3/users => generated 284 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:17:39.605118 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de16621-1983-4986-8bfa-ddd6ae387510 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:39.610269 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 777/1585] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:17:39 2022] POST /identity/v3/users => generated 295 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:17:39.610269 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba834a3-8424-4db0-9981-5d57136bbe60 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:39.613453 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de16621-1983-4986-8bfa-ddd6ae387510 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:39.618629 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459627e9-1575-4b78-ba42-39c239530ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:39.619282 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459627e9-1575-4b78-ba42-39c239530ed7 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:39.619564 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459627e9-1575-4b78-ba42-39c239530ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:39.619836 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459627e9-1575-4b78-ba42-39c239530ed7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:39.620615 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459627e9-1575-4b78-ba42-39c239530ed7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:39.620889 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba834a3-8424-4db0-9981-5d57136bbe60 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:39.622346 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459627e9-1575-4b78-ba42-39c239530ed7 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:39.626768 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a037483-4b5a-4ce1-b38e-c9eb535b94b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:39.627368 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a037483-4b5a-4ce1-b38e-c9eb535b94b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:39.627652 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a037483-4b5a-4ce1-b38e-c9eb535b94b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:39.627988 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a037483-4b5a-4ce1-b38e-c9eb535b94b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:39.628726 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a037483-4b5a-4ce1-b38e-c9eb535b94b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:39.630826 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a037483-4b5a-4ce1-b38e-c9eb535b94b4 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:39.634653 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 809/1586] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:17:39.638869 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459627e9-1575-4b78-ba42-39c239530ed7 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:39.648837 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459627e9-1575-4b78-ba42-39c239530ed7 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:39.655049 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 778/1587] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:17:39 2022] POST /identity/v3/users => generated 293 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:17:39.655049 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a037483-4b5a-4ce1-b38e-c9eb535b94b4 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:39.655288 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f520563c-d053-43ee-b8be-edeae0601b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:39.655288 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f520563c-d053-43ee-b8be-edeae0601b85 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:39.655288 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f520563c-d053-43ee-b8be-edeae0601b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:39.655288 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f520563c-d053-43ee-b8be-edeae0601b85 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:39.655927 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f520563c-d053-43ee-b8be-edeae0601b85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:39.657992 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f520563c-d053-43ee-b8be-edeae0601b85 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:39.662458 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a037483-4b5a-4ce1-b38e-c9eb535b94b4 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:39.667052 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d181233b-4e49-499d-9bbd-e8fbfffad53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:39.667771 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d181233b-4e49-499d-9bbd-e8fbfffad53d admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:39.668088 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d181233b-4e49-499d-9bbd-e8fbfffad53d admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:39.668361 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d181233b-4e49-499d-9bbd-e8fbfffad53d admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:39.669132 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d181233b-4e49-499d-9bbd-e8fbfffad53d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:39.670980 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d181233b-4e49-499d-9bbd-e8fbfffad53d admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:39.680226 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 810/1588] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:17:39 2022] POST /identity/v3/users => generated 289 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:17:39.682539 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 779/1589] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:17:39.684242 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f520563c-d053-43ee-b8be-edeae0601b85 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:39.686486 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d181233b-4e49-499d-9bbd-e8fbfffad53d admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:39.693978 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f520563c-d053-43ee-b8be-edeae0601b85 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:39.696462 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d181233b-4e49-499d-9bbd-e8fbfffad53d admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:39.698467 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ddc573-ef7b-45a7-b320-32245623befb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:39.699114 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ddc573-ef7b-45a7-b320-32245623befb admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:39.699438 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ddc573-ef7b-45a7-b320-32245623befb admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:39.699716 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ddc573-ef7b-45a7-b320-32245623befb admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:39.700463 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ddc573-ef7b-45a7-b320-32245623befb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:39.701262 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fbf126-611c-49ff-bd4b-579362e33c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:39.701963 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fbf126-611c-49ff-bd4b-579362e33c80 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:39.702169 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ddc573-ef7b-45a7-b320-32245623befb admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:39.702292 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fbf126-611c-49ff-bd4b-579362e33c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:39.702549 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fbf126-611c-49ff-bd4b-579362e33c80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:39.703381 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fbf126-611c-49ff-bd4b-579362e33c80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:39.704943 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fbf126-611c-49ff-bd4b-579362e33c80 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:39.712320 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 811/1590] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:17:39.713175 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ddc573-ef7b-45a7-b320-32245623befb admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:39.716523 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 780/1591] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:17:39.717718 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fbf126-611c-49ff-bd4b-579362e33c80 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:39.725695 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ddc573-ef7b-45a7-b320-32245623befb admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:39.729195 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fbf126-611c-49ff-bd4b-579362e33c80 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:39.730634 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a7c2a-b87a-4968-809a-9648e276d7d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:39.731263 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a7c2a-b87a-4968-809a-9648e276d7d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:39.731566 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a7c2a-b87a-4968-809a-9648e276d7d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:39.731808 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a7c2a-b87a-4968-809a-9648e276d7d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:39.732560 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14a7c2a-b87a-4968-809a-9648e276d7d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:39.734242 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14a7c2a-b87a-4968-809a-9648e276d7d1 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:39.734572 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082b38f2-8bd6-4221-8cfd-e09843b37540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:39.735260 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b38f2-8bd6-4221-8cfd-e09843b37540 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:39.735562 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b38f2-8bd6-4221-8cfd-e09843b37540 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:39.735854 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b38f2-8bd6-4221-8cfd-e09843b37540 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:39.736669 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082b38f2-8bd6-4221-8cfd-e09843b37540 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:39.738367 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082b38f2-8bd6-4221-8cfd-e09843b37540 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:39.744801 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 812/1592] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:17:39.745738 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a7c2a-b87a-4968-809a-9648e276d7d1 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:39.751785 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 781/1593] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:17:39.752870 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082b38f2-8bd6-4221-8cfd-e09843b37540 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:39.758289 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a7c2a-b87a-4968-809a-9648e276d7d1 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:39.762965 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082b38f2-8bd6-4221-8cfd-e09843b37540 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:39.763191 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1a7897-87d4-4d43-963f-219404d0c26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:39.763991 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1a7897-87d4-4d43-963f-219404d0c26b admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:39.764353 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1a7897-87d4-4d43-963f-219404d0c26b admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:39.764563 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1a7897-87d4-4d43-963f-219404d0c26b admin admin] PATH_INFO: `/v3/projects/0d3c7bd9ba1b4d038af6266ee4d25ac2/users/36808302afce48e4873de88c23eaf46c/roles/965049e7ce6144aaad23c15f3a5e37c3` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:39.766722 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1a7897-87d4-4d43-963f-219404d0c26b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d3c7bd9ba1b4d038af6266ee4d25ac2, user_id=36808302afce48e4873de88c23eaf46c, role_id=965049e7ce6144aaad23c15f3a5e37c3)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:39.767800 dv-cinder-844563-4-smb devstack@keystone.service[80182]: WARNING py.warnings [None req-bd1a7897-87d4-4d43-963f-219404d0c26b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 04 09:17:39.767800 dv-cinder-844563-4-smb devstack@keystone.service[80182]: warnings.warn(msg) Jul 04 09:17:39.767800 dv-cinder-844563-4-smb devstack@keystone.service[80182]: Jul 04 09:17:39.768140 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32dc6d1-13dc-45e7-87ad-f25227d8d1fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:39.768711 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32dc6d1-13dc-45e7-87ad-f25227d8d1fe admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:39.769036 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32dc6d1-13dc-45e7-87ad-f25227d8d1fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:39.769367 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32dc6d1-13dc-45e7-87ad-f25227d8d1fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:39.769815 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1a7897-87d4-4d43-963f-219404d0c26b admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:39.770129 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32dc6d1-13dc-45e7-87ad-f25227d8d1fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:39.771801 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32dc6d1-13dc-45e7-87ad-f25227d8d1fe admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:39.780924 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 813/1594] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:17:39 2022] PUT /identity/v3/projects/0d3c7bd9ba1b4d038af6266ee4d25ac2/users/36808302afce48e4873de88c23eaf46c/roles/965049e7ce6144aaad23c15f3a5e37c3 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:17:39.781730 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1a7897-87d4-4d43-963f-219404d0c26b admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:39.787907 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 782/1595] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:17:39.787907 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32dc6d1-13dc-45e7-87ad-f25227d8d1fe admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:39.796775 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32dc6d1-13dc-45e7-87ad-f25227d8d1fe admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:39.814848 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:INSERT=11 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:17:39.821188 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=88,keystone:INSERT=12 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:17:39.850208 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1a7897-87d4-4d43-963f-219404d0c26b admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:39.855000 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4303a622-eb3b-4753-ac89-f4420c56ae20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:39.855710 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303a622-eb3b-4753-ac89-f4420c56ae20 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:39.855984 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abd5cdc-c7fc-4324-bbab-44a59d5fcba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:39.856199 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303a622-eb3b-4753-ac89-f4420c56ae20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:39.856329 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303a622-eb3b-4753-ac89-f4420c56ae20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:39.856547 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd5cdc-c7fc-4324-bbab-44a59d5fcba6 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:39.856859 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd5cdc-c7fc-4324-bbab-44a59d5fcba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:39.857124 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4303a622-eb3b-4753-ac89-f4420c56ae20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:39.857239 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd5cdc-c7fc-4324-bbab-44a59d5fcba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:39.857860 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abd5cdc-c7fc-4324-bbab-44a59d5fcba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:39.858897 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4303a622-eb3b-4753-ac89-f4420c56ae20 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:39.859582 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abd5cdc-c7fc-4324-bbab-44a59d5fcba6 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:39.869168 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 814/1596] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:17:39.870178 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4303a622-eb3b-4753-ac89-f4420c56ae20 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:39.872684 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 783/1597] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:17:39.873440 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abd5cdc-c7fc-4324-bbab-44a59d5fcba6 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:39.880492 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4303a622-eb3b-4753-ac89-f4420c56ae20 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:39.885186 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d00f0ab-0f90-4acb-b2ab-6667e44df8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:39.885848 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d00f0ab-0f90-4acb-b2ab-6667e44df8ad admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:39.886183 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d00f0ab-0f90-4acb-b2ab-6667e44df8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:39.886438 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abd5cdc-c7fc-4324-bbab-44a59d5fcba6 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:39.886542 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d00f0ab-0f90-4acb-b2ab-6667e44df8ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:39.887194 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d00f0ab-0f90-4acb-b2ab-6667e44df8ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:39.888890 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d00f0ab-0f90-4acb-b2ab-6667e44df8ad admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:39.891828 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4631eb-cb64-416d-ba5a-fbb8012e9f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:39.892521 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4631eb-cb64-416d-ba5a-fbb8012e9f2d admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:39.893000 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4631eb-cb64-416d-ba5a-fbb8012e9f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:39.893213 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4631eb-cb64-416d-ba5a-fbb8012e9f2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:39.893970 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4631eb-cb64-416d-ba5a-fbb8012e9f2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:39.895635 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4631eb-cb64-416d-ba5a-fbb8012e9f2d admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:39.900028 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 815/1598] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:17:39.900879 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d00f0ab-0f90-4acb-b2ab-6667e44df8ad admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:39.906703 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 784/1599] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:17:39.907398 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4631eb-cb64-416d-ba5a-fbb8012e9f2d admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:39.910730 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d00f0ab-0f90-4acb-b2ab-6667e44df8ad admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:39.916657 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ae9fda-3303-4900-a45f-326dd942a3cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:39.916886 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4631eb-cb64-416d-ba5a-fbb8012e9f2d admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:39.917302 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae9fda-3303-4900-a45f-326dd942a3cc admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:39.917589 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae9fda-3303-4900-a45f-326dd942a3cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:39.917867 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae9fda-3303-4900-a45f-326dd942a3cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:39.918608 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ae9fda-3303-4900-a45f-326dd942a3cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:39.920267 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ae9fda-3303-4900-a45f-326dd942a3cc admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:39.921746 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5604ce8e-a72b-44bc-a9c1-b2cc33c9209e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:39.922383 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5604ce8e-a72b-44bc-a9c1-b2cc33c9209e admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:39.922662 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5604ce8e-a72b-44bc-a9c1-b2cc33c9209e admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:39.922936 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5604ce8e-a72b-44bc-a9c1-b2cc33c9209e admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:39.923676 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5604ce8e-a72b-44bc-a9c1-b2cc33c9209e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:39.925309 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5604ce8e-a72b-44bc-a9c1-b2cc33c9209e admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:39.931057 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 816/1600] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:17:39.931915 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ae9fda-3303-4900-a45f-326dd942a3cc admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:39.937746 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 785/1601] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:17:39.939207 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c25f0-a109-4491-a891-423602cc16fc None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:39.939568 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c25f0-a109-4491-a891-423602cc16fc None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:39.939862 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c25f0-a109-4491-a891-423602cc16fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:39.946523 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ae9fda-3303-4900-a45f-326dd942a3cc admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:39.951249 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2cbc47-238a-4e30-ae9e-88b4f947046a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:39.952006 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2cbc47-238a-4e30-ae9e-88b4f947046a admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:39.952298 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2cbc47-238a-4e30-ae9e-88b4f947046a admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:39.952587 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2cbc47-238a-4e30-ae9e-88b4f947046a admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:39.953335 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2cbc47-238a-4e30-ae9e-88b4f947046a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:39.954947 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2cbc47-238a-4e30-ae9e-88b4f947046a admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:39.965025 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 817/1602] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:17:39.965838 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2cbc47-238a-4e30-ae9e-88b4f947046a admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:39.966319 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-9c1c25f0-a109-4491-a891-423602cc16fc None None] MFA Rules not processed for user `36808302afce48e4873de88c23eaf46c`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:17:39.967566 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9c1c25f0-a109-4491-a891-423602cc16fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:17:39.976023 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2cbc47-238a-4e30-ae9e-88b4f947046a admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:39.980888 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1da054-cdb8-4436-8d0d-27286b6c43c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:39.981579 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1da054-cdb8-4436-8d0d-27286b6c43c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:39.981902 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1da054-cdb8-4436-8d0d-27286b6c43c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:39.982217 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1da054-cdb8-4436-8d0d-27286b6c43c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:39.982954 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1da054-cdb8-4436-8d0d-27286b6c43c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:39.984655 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1da054-cdb8-4436-8d0d-27286b6c43c6 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:39.995161 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 818/1603] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:17:39.996051 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1da054-cdb8-4436-8d0d-27286b6c43c6 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:40.006841 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1da054-cdb8-4436-8d0d-27286b6c43c6 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:40.011617 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aa6b81-d33e-481a-9fac-dd2c023298ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:40.012539 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa6b81-d33e-481a-9fac-dd2c023298ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:40.012821 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa6b81-d33e-481a-9fac-dd2c023298ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:40.013097 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa6b81-d33e-481a-9fac-dd2c023298ea admin admin] PATH_INFO: `/v3/projects/e5be1dfd2c694925a02e87630ea22eca/users/1c1ef56d5b9f4545865414d14f861907/roles/81634e7812344f84afcb29b0dba2687c` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:40.028803 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aa6b81-d33e-481a-9fac-dd2c023298ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5be1dfd2c694925a02e87630ea22eca, user_id=1c1ef56d5b9f4545865414d14f861907, role_id=81634e7812344f84afcb29b0dba2687c)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:40.031669 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aa6b81-d33e-481a-9fac-dd2c023298ea admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:40.047405 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 786/1604] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:17:39 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:17:40.047405 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1c25f0-a109-4491-a891-423602cc16fc None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:40.049835 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 819/1605] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:17:39 2022] PUT /identity/v3/projects/e5be1dfd2c694925a02e87630ea22eca/users/1c1ef56d5b9f4545865414d14f861907/roles/81634e7812344f84afcb29b0dba2687c => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:17:40.050858 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aa6b81-d33e-481a-9fac-dd2c023298ea admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:40.064590 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1c25f0-a109-4491-a891-423602cc16fc None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:40.115076 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aa6b81-d33e-481a-9fac-dd2c023298ea admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:40.120100 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9787c809-7620-4cdd-a098-b306270ab4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:40.121192 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9787c809-7620-4cdd-a098-b306270ab4c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:40.121488 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9787c809-7620-4cdd-a098-b306270ab4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:40.121762 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9787c809-7620-4cdd-a098-b306270ab4c4 admin admin] PATH_INFO: `/v3/projects/b4fe1def05a5402e9d15cd5167e0d26a/users/f8a3049071c04a9b939d7fc00ce86554/roles/81634e7812344f84afcb29b0dba2687c` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:40.125425 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dc3901-ec0b-4f66-99fd-c289c97a6111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:40.126320 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc3901-ec0b-4f66-99fd-c289c97a6111 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:40.126600 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc3901-ec0b-4f66-99fd-c289c97a6111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:40.126879 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc3901-ec0b-4f66-99fd-c289c97a6111 admin admin] PATH_INFO: `/v3/projects/9670c67ac9f54bed9d37f247a911e2c2/users/e87c029b91ce4bcf977b52cf18ffd37c/roles/81634e7812344f84afcb29b0dba2687c` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:40.138447 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9787c809-7620-4cdd-a098-b306270ab4c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4fe1def05a5402e9d15cd5167e0d26a, user_id=f8a3049071c04a9b939d7fc00ce86554, role_id=81634e7812344f84afcb29b0dba2687c)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:40.141143 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dc3901-ec0b-4f66-99fd-c289c97a6111 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9670c67ac9f54bed9d37f247a911e2c2, user_id=e87c029b91ce4bcf977b52cf18ffd37c, role_id=81634e7812344f84afcb29b0dba2687c)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:40.141282 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9787c809-7620-4cdd-a098-b306270ab4c4 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:40.143820 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dc3901-ec0b-4f66-99fd-c289c97a6111 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:40.155854 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 820/1606] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:17:40 2022] PUT /identity/v3/projects/b4fe1def05a5402e9d15cd5167e0d26a/users/f8a3049071c04a9b939d7fc00ce86554/roles/81634e7812344f84afcb29b0dba2687c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:17:40.160380 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 787/1607] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:17:40 2022] PUT /identity/v3/projects/9670c67ac9f54bed9d37f247a911e2c2/users/e87c029b91ce4bcf977b52cf18ffd37c/roles/81634e7812344f84afcb29b0dba2687c => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:17:40.160520 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9787c809-7620-4cdd-a098-b306270ab4c4 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:40.160641 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dc3901-ec0b-4f66-99fd-c289c97a6111 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:40.174246 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:17:40.209511 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:17:40.232834 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9787c809-7620-4cdd-a098-b306270ab4c4 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:40.235489 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dc3901-ec0b-4f66-99fd-c289c97a6111 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:40.238862 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d390d8-e847-40a3-9552-24941d8f3ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:40.239885 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d390d8-e847-40a3-9552-24941d8f3ee4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:40.240171 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d390d8-e847-40a3-9552-24941d8f3ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:40.240501 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d390d8-e847-40a3-9552-24941d8f3ee4 admin admin] PATH_INFO: `/v3/projects/995839d7ff2b483597fdc46bc72301c3/users/8941915283174f9588cbe4b3d67858ce/roles/81634e7812344f84afcb29b0dba2687c` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:40.240664 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c3ebc5-43e4-4ffd-858d-14f32ed34e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:40.241435 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c3ebc5-43e4-4ffd-858d-14f32ed34e31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:40.241721 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c3ebc5-43e4-4ffd-858d-14f32ed34e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:40.241998 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c3ebc5-43e4-4ffd-858d-14f32ed34e31 admin admin] PATH_INFO: `/v3/projects/17c43e06ebe740af9b4fe4678526ef7a/users/34b5671b702a4d369463b45fb5dbe07a/roles/81634e7812344f84afcb29b0dba2687c` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:40.257311 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c3ebc5-43e4-4ffd-858d-14f32ed34e31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17c43e06ebe740af9b4fe4678526ef7a, user_id=34b5671b702a4d369463b45fb5dbe07a, role_id=81634e7812344f84afcb29b0dba2687c)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:40.257665 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d390d8-e847-40a3-9552-24941d8f3ee4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=995839d7ff2b483597fdc46bc72301c3, user_id=8941915283174f9588cbe4b3d67858ce, role_id=81634e7812344f84afcb29b0dba2687c)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:40.260054 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c3ebc5-43e4-4ffd-858d-14f32ed34e31 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:40.260557 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d390d8-e847-40a3-9552-24941d8f3ee4 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:40.274806 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 788/1608] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:17:40 2022] PUT /identity/v3/projects/17c43e06ebe740af9b4fe4678526ef7a/users/34b5671b702a4d369463b45fb5dbe07a/roles/81634e7812344f84afcb29b0dba2687c => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:17:40.275621 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c3ebc5-43e4-4ffd-858d-14f32ed34e31 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:40.276388 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 821/1609] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:17:40 2022] PUT /identity/v3/projects/995839d7ff2b483597fdc46bc72301c3/users/8941915283174f9588cbe4b3d67858ce/roles/81634e7812344f84afcb29b0dba2687c => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:17:40.277244 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d390d8-e847-40a3-9552-24941d8f3ee4 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:40.344427 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c3ebc5-43e4-4ffd-858d-14f32ed34e31 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:40.346892 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d390d8-e847-40a3-9552-24941d8f3ee4 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:40.349558 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906dffde-3562-4c96-8a29-b898d37a4fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:40.350967 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906dffde-3562-4c96-8a29-b898d37a4fc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:40.351248 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906dffde-3562-4c96-8a29-b898d37a4fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:40.351541 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906dffde-3562-4c96-8a29-b898d37a4fc2 admin admin] PATH_INFO: `/v3/projects/fa3b91395ec24070a3ee1c31cbf9ac63/users/defd27b64b204349a191a7b50b2d4cc4/roles/81634e7812344f84afcb29b0dba2687c` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:40.352423 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4d0841-3557-461b-b5d8-33cba77de05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:40.353411 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d0841-3557-461b-b5d8-33cba77de05c admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:40.353796 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d0841-3557-461b-b5d8-33cba77de05c admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:40.354140 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d0841-3557-461b-b5d8-33cba77de05c admin admin] PATH_INFO: `/v3/projects/47c7ac57b6244fb19f74f62d292107c3/users/6d13b840941349d78da243f9b4c2c72e/roles/81634e7812344f84afcb29b0dba2687c` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:40.368416 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906dffde-3562-4c96-8a29-b898d37a4fc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa3b91395ec24070a3ee1c31cbf9ac63, user_id=defd27b64b204349a191a7b50b2d4cc4, role_id=81634e7812344f84afcb29b0dba2687c)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:40.369181 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4d0841-3557-461b-b5d8-33cba77de05c admin admin] RBAC: Authorizing `identity:create_grant(project_id=47c7ac57b6244fb19f74f62d292107c3, user_id=6d13b840941349d78da243f9b4c2c72e, role_id=81634e7812344f84afcb29b0dba2687c)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:40.371243 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906dffde-3562-4c96-8a29-b898d37a4fc2 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:40.372292 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4d0841-3557-461b-b5d8-33cba77de05c admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:40.386640 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 789/1610] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:17:40 2022] PUT /identity/v3/projects/fa3b91395ec24070a3ee1c31cbf9ac63/users/defd27b64b204349a191a7b50b2d4cc4/roles/81634e7812344f84afcb29b0dba2687c => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:17:40.390929 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 822/1611] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:17:40 2022] PUT /identity/v3/projects/47c7ac57b6244fb19f74f62d292107c3/users/6d13b840941349d78da243f9b4c2c72e/roles/81634e7812344f84afcb29b0dba2687c => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:17:40.390929 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4d0841-3557-461b-b5d8-33cba77de05c admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:40.391174 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e035e52-09ca-4eb1-964b-9a50736a2160 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:40.391174 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e035e52-09ca-4eb1-964b-9a50736a2160 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:40.391174 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e035e52-09ca-4eb1-964b-9a50736a2160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:40.408678 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-7e035e52-09ca-4eb1-964b-9a50736a2160 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:17:40.410310 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-7e035e52-09ca-4eb1-964b-9a50736a2160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:17:40.444988 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4d0841-3557-461b-b5d8-33cba77de05c admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:40.448767 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeebb3c-e03c-4282-adb7-025a519e8b37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f86373d65440da97c853fff3c1d0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:40.449494 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeebb3c-e03c-4282-adb7-025a519e8b37 service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:40.449783 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeebb3c-e03c-4282-adb7-025a519e8b37 service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:40.450096 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeebb3c-e03c-4282-adb7-025a519e8b37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:40.471555 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 790/1612] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:17:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:17:40.472936 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c34ee0-3c0f-4eb3-9e32-0648af7b2be8 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:40.473226 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c34ee0-3c0f-4eb3-9e32-0648af7b2be8 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:40.473501 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c34ee0-3c0f-4eb3-9e32-0648af7b2be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:40.492554 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-d7c34ee0-3c0f-4eb3-9e32-0648af7b2be8 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:17:40.493776 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d7c34ee0-3c0f-4eb3-9e32-0648af7b2be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:17:40.502031 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 791/1613] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:17:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:17:40.503300 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac1e5e-655e-4a9d-99c1-e4289a1ec1c2 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:40.503844 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac1e5e-655e-4a9d-99c1-e4289a1ec1c2 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:40.504009 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac1e5e-655e-4a9d-99c1-e4289a1ec1c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:40.510378 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:17:40.516681 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeebb3c-e03c-4282-adb7-025a519e8b37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:40.518980 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeebb3c-e03c-4282-adb7-025a519e8b37 service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:40.523669 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:17:40.530042 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 823/1614] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:17:40 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:17:40.535029 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-58ac1e5e-655e-4a9d-99c1-e4289a1ec1c2 None None] MFA Rules not processed for user `f8a3049071c04a9b939d7fc00ce86554`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:17:40.536185 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-58ac1e5e-655e-4a9d-99c1-e4289a1ec1c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:17:40.537435 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717cc4eb-229d-4187-94fa-a39f916e595f None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:40.537816 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717cc4eb-229d-4187-94fa-a39f916e595f None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:40.538246 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717cc4eb-229d-4187-94fa-a39f916e595f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:40.557394 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-717cc4eb-229d-4187-94fa-a39f916e595f None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:17:40.558826 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-717cc4eb-229d-4187-94fa-a39f916e595f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:17:40.567299 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 824/1615] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:17:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:17:40.568766 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c61d782-f9d9-4e6d-a3cf-2d82bbb8b6ea None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:40.569155 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c61d782-f9d9-4e6d-a3cf-2d82bbb8b6ea None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:40.570017 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c61d782-f9d9-4e6d-a3cf-2d82bbb8b6ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:40.606759 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-6c61d782-f9d9-4e6d-a3cf-2d82bbb8b6ea None None] MFA Rules not processed for user `8941915283174f9588cbe4b3d67858ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:17:40.608126 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-6c61d782-f9d9-4e6d-a3cf-2d82bbb8b6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:17:40.620999 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 792/1616] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:17:40 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:17:40.622854 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63feceb-ef85-416f-93d7-7d3ca77d1f19 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:40.623156 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63feceb-ef85-416f-93d7-7d3ca77d1f19 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:40.623438 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63feceb-ef85-416f-93d7-7d3ca77d1f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:40.643008 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-d63feceb-ef85-416f-93d7-7d3ca77d1f19 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:17:40.644342 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d63feceb-ef85-416f-93d7-7d3ca77d1f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:17:40.652749 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 793/1617] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:17:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:17:40.654150 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509ccae6-4597-478c-9ac1-22bdfe95cfed None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:40.654441 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509ccae6-4597-478c-9ac1-22bdfe95cfed None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:40.654794 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509ccae6-4597-478c-9ac1-22bdfe95cfed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:40.675246 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-509ccae6-4597-478c-9ac1-22bdfe95cfed None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:17:40.676612 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-509ccae6-4597-478c-9ac1-22bdfe95cfed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:17:40.685443 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 794/1618] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:17:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:17:40.686284 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509ccae6-4597-478c-9ac1-22bdfe95cfed None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:40.718142 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 825/1619] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:17:40 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:17:40.718142 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c61d782-f9d9-4e6d-a3cf-2d82bbb8b6ea None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:40.755204 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509ccae6-4597-478c-9ac1-22bdfe95cfed None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:40.759389 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3722a005-c887-491f-8050-e3e8573e6488 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:40.760118 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3722a005-c887-491f-8050-e3e8573e6488 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:40.760403 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3722a005-c887-491f-8050-e3e8573e6488 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:40.761042 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3722a005-c887-491f-8050-e3e8573e6488 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:40.771407 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3722a005-c887-491f-8050-e3e8573e6488 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:40.773084 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3722a005-c887-491f-8050-e3e8573e6488 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:40.775104 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c61d782-f9d9-4e6d-a3cf-2d82bbb8b6ea None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:40.778828 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1c37d9-cff8-4d68-a884-f2e0b1fbe0c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:40.779487 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c37d9-cff8-4d68-a884-f2e0b1fbe0c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:40.779800 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c37d9-cff8-4d68-a884-f2e0b1fbe0c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:40.780299 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c37d9-cff8-4d68-a884-f2e0b1fbe0c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:40.783714 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 795/1620] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:17:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:17:40.784610 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3722a005-c887-491f-8050-e3e8573e6488 service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:40.796289 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3722a005-c887-491f-8050-e3e8573e6488 service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:40.800955 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1c37d9-cff8-4d68-a884-f2e0b1fbe0c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:40.802438 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1c37d9-cff8-4d68-a884-f2e0b1fbe0c0 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:40.802849 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee4ee8a-ea6a-4abc-a102-d65ee759e28e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:40.804010 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee4ee8a-ea6a-4abc-a102-d65ee759e28e service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:40.804660 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee4ee8a-ea6a-4abc-a102-d65ee759e28e service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:40.805329 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee4ee8a-ea6a-4abc-a102-d65ee759e28e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:40.813961 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 826/1621] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:17:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:17:40.814856 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1c37d9-cff8-4d68-a884-f2e0b1fbe0c0 service neutron] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:40.821097 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee4ee8a-ea6a-4abc-a102-d65ee759e28e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:40.823907 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee4ee8a-ea6a-4abc-a102-d65ee759e28e service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:40.825434 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1c37d9-cff8-4d68-a884-f2e0b1fbe0c0 service neutron] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:40.835207 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9ed493-e7d5-4ecd-9a75-86d4629aabaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:40.836081 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ed493-e7d5-4ecd-9a75-86d4629aabaa admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:40.836659 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ed493-e7d5-4ecd-9a75-86d4629aabaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:40.836877 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ed493-e7d5-4ecd-9a75-86d4629aabaa admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:40.837603 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9ed493-e7d5-4ecd-9a75-86d4629aabaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:40.839811 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9ed493-e7d5-4ecd-9a75-86d4629aabaa admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:40.848754 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 796/1622] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:17:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:17:40.849905 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee4ee8a-ea6a-4abc-a102-d65ee759e28e service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:40.865474 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee4ee8a-ea6a-4abc-a102-d65ee759e28e service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:40.870972 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d34b70f-e8d6-4090-8078-c6e2e116462b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:40.871818 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d34b70f-e8d6-4090-8078-c6e2e116462b service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:40.872251 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d34b70f-e8d6-4090-8078-c6e2e116462b service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:40.872602 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d34b70f-e8d6-4090-8078-c6e2e116462b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:40.887373 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 827/1623] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:17:40 2022] POST /identity/v3/projects => generated 357 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:17:40.889895 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9ed493-e7d5-4ecd-9a75-86d4629aabaa admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:40.901111 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d34b70f-e8d6-4090-8078-c6e2e116462b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:40.902619 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d34b70f-e8d6-4090-8078-c6e2e116462b service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:40.916182 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 797/1624] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:17:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:17:40.917609 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d34b70f-e8d6-4090-8078-c6e2e116462b service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:40.928683 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d34b70f-e8d6-4090-8078-c6e2e116462b service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:40.984739 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9ed493-e7d5-4ecd-9a75-86d4629aabaa admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:40.991260 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5cf35b-7348-4e58-85f8-6211c04be137 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:40.993251 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5cf35b-7348-4e58-85f8-6211c04be137 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:40.993652 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5cf35b-7348-4e58-85f8-6211c04be137 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:40.994152 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5cf35b-7348-4e58-85f8-6211c04be137 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:41.028231 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:17:41.060052 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfbfd56-c986-4c9e-8067-40b18cc45d5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f86373d65440da97c853fff3c1d0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:41.060804 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfbfd56-c986-4c9e-8067-40b18cc45d5e service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:41.062854 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfbfd56-c986-4c9e-8067-40b18cc45d5e service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:41.063149 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfbfd56-c986-4c9e-8067-40b18cc45d5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:41.100439 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:17:41.162035 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5cf35b-7348-4e58-85f8-6211c04be137 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:41.167500 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5cf35b-7348-4e58-85f8-6211c04be137 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:41.210364 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfbfd56-c986-4c9e-8067-40b18cc45d5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:41.215153 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfbfd56-c986-4c9e-8067-40b18cc45d5e service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:41.219613 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 828/1625] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:17:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:17:41.222838 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5cf35b-7348-4e58-85f8-6211c04be137 service neutron] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:41.245070 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 798/1626] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:17:40 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:17:41.254105 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5cf35b-7348-4e58-85f8-6211c04be137 service neutron] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:41.259460 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfbfd56-c986-4c9e-8067-40b18cc45d5e service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:41.264632 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89281f97-9f7b-4c8c-bfcf-8f046c5d7c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:41.265351 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89281f97-9f7b-4c8c-bfcf-8f046c5d7c43 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:41.265635 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89281f97-9f7b-4c8c-bfcf-8f046c5d7c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:41.265926 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89281f97-9f7b-4c8c-bfcf-8f046c5d7c43 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:41.266638 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89281f97-9f7b-4c8c-bfcf-8f046c5d7c43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:41.272851 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89281f97-9f7b-4c8c-bfcf-8f046c5d7c43 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:41.294801 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfbfd56-c986-4c9e-8067-40b18cc45d5e service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:41.307429 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c943db-6430-4af7-b662-6e9426e51780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:41.308485 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c943db-6430-4af7-b662-6e9426e51780 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:41.308853 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c943db-6430-4af7-b662-6e9426e51780 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:41.312989 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c943db-6430-4af7-b662-6e9426e51780 admin admin] PATH_INFO: `/v3/users/d07378d5e355446ea7f420786014d024` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:41.318206 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c943db-6430-4af7-b662-6e9426e51780 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d07378d5e355446ea7f420786014d024)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:41.321158 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c943db-6430-4af7-b662-6e9426e51780 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:41.331733 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 829/1627] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:17:41 2022] POST /identity/v3/users => generated 285 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:17:41.332988 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89281f97-9f7b-4c8c-bfcf-8f046c5d7c43 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:41.353879 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89281f97-9f7b-4c8c-bfcf-8f046c5d7c43 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:41.368601 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc4a2b4-8732-4a70-a925-acb9d7958b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:41.369819 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc4a2b4-8732-4a70-a925-acb9d7958b93 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:41.370128 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc4a2b4-8732-4a70-a925-acb9d7958b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:41.370405 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc4a2b4-8732-4a70-a925-acb9d7958b93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:41.371259 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc4a2b4-8732-4a70-a925-acb9d7958b93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:41.373283 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc4a2b4-8732-4a70-a925-acb9d7958b93 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:41.405497 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 830/1628] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:17:41 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:17:41.410625 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc4a2b4-8732-4a70-a925-acb9d7958b93 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:41.434450 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc4a2b4-8732-4a70-a925-acb9d7958b93 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:41.440118 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8298ae96-cde9-42a1-8f84-6e98d341e381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:41.440305 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-65c943db-6430-4af7-b662-6e9426e51780 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd07378d5e355446ea7f420786014d024'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:17:41.441067 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-65c943db-6430-4af7-b662-6e9426e51780 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd07378d5e355446ea7f420786014d024'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:17:41.441947 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8298ae96-cde9-42a1-8f84-6e98d341e381 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:41.442141 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8298ae96-cde9-42a1-8f84-6e98d341e381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:41.442464 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8298ae96-cde9-42a1-8f84-6e98d341e381 admin admin] PATH_INFO: `/v3/projects/37496e4374c54249ae89bb18478071ad/users/18498384857b46779778772fbe823725/roles/965049e7ce6144aaad23c15f3a5e37c3` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:41.463606 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8298ae96-cde9-42a1-8f84-6e98d341e381 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37496e4374c54249ae89bb18478071ad, user_id=18498384857b46779778772fbe823725, role_id=965049e7ce6144aaad23c15f3a5e37c3)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:41.464398 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-65c943db-6430-4af7-b662-6e9426e51780 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd07378d5e355446ea7f420786014d024'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:17:41.466130 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-65c943db-6430-4af7-b662-6e9426e51780 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd07378d5e355446ea7f420786014d024'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:17:41.467162 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8298ae96-cde9-42a1-8f84-6e98d341e381 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:41.490238 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 831/1629] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:17:41 2022] PUT /identity/v3/projects/37496e4374c54249ae89bb18478071ad/users/18498384857b46779778772fbe823725/roles/965049e7ce6144aaad23c15f3a5e37c3 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:17:41.491520 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8298ae96-cde9-42a1-8f84-6e98d341e381 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:41.500601 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-65c943db-6430-4af7-b662-6e9426e51780 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd07378d5e355446ea7f420786014d024'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:17:41.506952 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-8298ae96-cde9-42a1-8f84-6e98d341e381 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:17:41.537655 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 799/1630] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:17:41 2022] DELETE /identity/v3/users/d07378d5e355446ea7f420786014d024 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:17:41.540241 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdad948-856c-4199-bb0e-021eef04f726 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:41.540451 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdad948-856c-4199-bb0e-021eef04f726 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:41.540622 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdad948-856c-4199-bb0e-021eef04f726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:41.583277 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-3cdad948-856c-4199-bb0e-021eef04f726 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:17:41.589146 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3cdad948-856c-4199-bb0e-021eef04f726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:17:41.681285 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8298ae96-cde9-42a1-8f84-6e98d341e381 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:41.746015 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 800/1631] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:17:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:17:41.754378 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9818180-dbad-482a-9e63-c95ac480c9b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:41.755519 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9818180-dbad-482a-9e63-c95ac480c9b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:41.756227 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9818180-dbad-482a-9e63-c95ac480c9b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:41.756544 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9818180-dbad-482a-9e63-c95ac480c9b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:41.757897 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9818180-dbad-482a-9e63-c95ac480c9b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:41.760962 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9818180-dbad-482a-9e63-c95ac480c9b1 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:41.764017 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:17:41.772994 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdad948-856c-4199-bb0e-021eef04f726 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:41.775031 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3cdad948-856c-4199-bb0e-021eef04f726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:17:41.800229 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 832/1632] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:17:41 2022] GET /identity/v3/roles => generated 1420 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:17:41.801717 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9818180-dbad-482a-9e63-c95ac480c9b1 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:41.825868 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9818180-dbad-482a-9e63-c95ac480c9b1 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:41.841623 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ba37aa-34d9-46b9-ac10-a06b9a99f8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:41.842846 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba37aa-34d9-46b9-ac10-a06b9a99f8af admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:41.843220 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba37aa-34d9-46b9-ac10-a06b9a99f8af admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:41.844355 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba37aa-34d9-46b9-ac10-a06b9a99f8af admin admin] PATH_INFO: `/v3/projects/37496e4374c54249ae89bb18478071ad/users/18498384857b46779778772fbe823725/roles/965049e7ce6144aaad23c15f3a5e37c3` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:41.850846 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ba37aa-34d9-46b9-ac10-a06b9a99f8af admin admin] RBAC: Authorizing `identity:create_grant(project_id=37496e4374c54249ae89bb18478071ad, user_id=18498384857b46779778772fbe823725, role_id=965049e7ce6144aaad23c15f3a5e37c3)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:41.858276 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ba37aa-34d9-46b9-ac10-a06b9a99f8af admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:41.861905 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:17:41.889315 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 833/1633] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:17:41 2022] PUT /identity/v3/projects/37496e4374c54249ae89bb18478071ad/users/18498384857b46779778772fbe823725/roles/965049e7ce6144aaad23c15f3a5e37c3 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:17:41.900398 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f9371-1de5-4692-945c-d7e276ea5a35 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:41.900793 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f9371-1de5-4692-945c-d7e276ea5a35 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:41.901223 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f9371-1de5-4692-945c-d7e276ea5a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:41.932300 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdad948-856c-4199-bb0e-021eef04f726 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:41.970624 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-7b1f9371-1de5-4692-945c-d7e276ea5a35 None None] MFA Rules not processed for user `18498384857b46779778772fbe823725`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:17:41.974310 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-7b1f9371-1de5-4692-945c-d7e276ea5a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:17:42.061923 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42b03b2-8189-4133-a93a-818a860166c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:42.064249 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b03b2-8189-4133-a93a-818a860166c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:42.065365 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b03b2-8189-4133-a93a-818a860166c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:42.066021 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b03b2-8189-4133-a93a-818a860166c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:42.178195 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 834/1634] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:17:41 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:17:42.190645 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1f9371-1de5-4692-945c-d7e276ea5a35 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:42.193142 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-7b1f9371-1de5-4692-945c-d7e276ea5a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:17:42.255427 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42b03b2-8189-4133-a93a-818a860166c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:42.263598 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42b03b2-8189-4133-a93a-818a860166c0 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:42.293233 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 801/1635] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:17:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 09:17:42.353525 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1f9371-1de5-4692-945c-d7e276ea5a35 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:42.360553 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0b3ec4-7de6-4689-b535-98c02e217f87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f86373d65440da97c853fff3c1d0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:42.361420 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b3ec4-7de6-4689-b535-98c02e217f87 service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:42.362148 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b3ec4-7de6-4689-b535-98c02e217f87 service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:42.363188 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b3ec4-7de6-4689-b535-98c02e217f87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:42.393151 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0b3ec4-7de6-4689-b535-98c02e217f87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:42.396956 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0b3ec4-7de6-4689-b535-98c02e217f87 service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:42.435398 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 835/1636] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:17:42 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 09:17:42.564344 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42b03b2-8189-4133-a93a-818a860166c0 service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:42.580070 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42b03b2-8189-4133-a93a-818a860166c0 service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:42.585644 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548895c6-afbb-4ebc-a592-48cd365f4598 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f86373d65440da97c853fff3c1d0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:42.586484 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548895c6-afbb-4ebc-a592-48cd365f4598 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:42.586873 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548895c6-afbb-4ebc-a592-48cd365f4598 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:42.587245 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548895c6-afbb-4ebc-a592-48cd365f4598 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:42.590026 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-548895c6-afbb-4ebc-a592-48cd365f4598 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:17:42.730348 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548895c6-afbb-4ebc-a592-48cd365f4598 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:42.733651 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548895c6-afbb-4ebc-a592-48cd365f4598 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:42.748563 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 802/1637] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:17:42 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:17:43.767329 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0b3ec4-7de6-4689-b535-98c02e217f87 service cinder] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:43.768997 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-df0b3ec4-7de6-4689-b535-98c02e217f87 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:17:43.796218 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0b3ec4-7de6-4689-b535-98c02e217f87 service cinder] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:43.811675 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939c6b97-fdc5-4488-8095-5075dae505f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:43.812805 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939c6b97-fdc5-4488-8095-5075dae505f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:43.813095 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939c6b97-fdc5-4488-8095-5075dae505f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:43.813371 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939c6b97-fdc5-4488-8095-5075dae505f5 admin admin] PATH_INFO: `/v3/projects/7c966ebce50b4a1f82b401c4c3dd406d` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:43.814628 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939c6b97-fdc5-4488-8095-5075dae505f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c966ebce50b4a1f82b401c4c3dd406d)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:43.816631 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939c6b97-fdc5-4488-8095-5075dae505f5 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:43.985917 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-939c6b97-fdc5-4488-8095-5075dae505f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c966ebce50b4a1f82b401c4c3dd406d', 'request_id': 'req-939c6b97-fdc5-4488-8095-5075dae505f5'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:17:43.985917 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-939c6b97-fdc5-4488-8095-5075dae505f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c966ebce50b4a1f82b401c4c3dd406d', 'request_id': 'req-939c6b97-fdc5-4488-8095-5075dae505f5'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:17:43.985917 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-939c6b97-fdc5-4488-8095-5075dae505f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c966ebce50b4a1f82b401c4c3dd406d', 'request_id': 'req-939c6b97-fdc5-4488-8095-5075dae505f5'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:17:43.985917 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:17:43.985917 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-939c6b97-fdc5-4488-8095-5075dae505f5 admin admin] The token cache is being invalidate because project 7c966ebce50b4a1f82b401c4c3dd406d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:17:43.986409 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-939c6b97-fdc5-4488-8095-5075dae505f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:17:43.986409 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-939c6b97-fdc5-4488-8095-5075dae505f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:17:43.986409 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 836/1638] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:17:43 2022] DELETE /identity/v3/projects/7c966ebce50b4a1f82b401c4c3dd406d => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:17:43.986729 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548895c6-afbb-4ebc-a592-48cd365f4598 service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:43.994691 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548895c6-afbb-4ebc-a592-48cd365f4598 service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:44.065890 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:17:44.140184 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e65c9d-1e99-49b2-a386-d2155e7e00f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:44.154971 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e65c9d-1e99-49b2-a386-d2155e7e00f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:44.155299 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e65c9d-1e99-49b2-a386-d2155e7e00f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:44.155585 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e65c9d-1e99-49b2-a386-d2155e7e00f0 admin admin] PATH_INFO: `/v3/users/36808302afce48e4873de88c23eaf46c` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:44.160191 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e65c9d-1e99-49b2-a386-d2155e7e00f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36808302afce48e4873de88c23eaf46c)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:44.162213 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e65c9d-1e99-49b2-a386-d2155e7e00f0 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:44.199022 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee4fe44-f53f-47de-9ffc-62d3cf0c8b11 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:44.199321 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee4fe44-f53f-47de-9ffc-62d3cf0c8b11 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:44.199700 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee4fe44-f53f-47de-9ffc-62d3cf0c8b11 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:44.202035 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 837/1639] 10.222.0.42 () {54 vars in 961 bytes} [Mon Jul 4 09:17:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:17:44.228791 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892dc244-0bd6-4de8-9eea-7211f84ba09e None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:44.229086 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892dc244-0bd6-4de8-9eea-7211f84ba09e None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:44.229367 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892dc244-0bd6-4de8-9eea-7211f84ba09e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:44.314120 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-892dc244-0bd6-4de8-9eea-7211f84ba09e None None] MFA Rules not processed for user `af3b6e252a8c434a99432bcece6493b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:17:44.318104 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-892dc244-0bd6-4de8-9eea-7211f84ba09e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:17:44.342741 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-29e65c9d-1e99-49b2-a386-d2155e7e00f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36808302afce48e4873de88c23eaf46c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:17:44.345035 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-29e65c9d-1e99-49b2-a386-d2155e7e00f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36808302afce48e4873de88c23eaf46c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:17:44.366472 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-29e65c9d-1e99-49b2-a386-d2155e7e00f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36808302afce48e4873de88c23eaf46c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:17:44.368094 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-29e65c9d-1e99-49b2-a386-d2155e7e00f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36808302afce48e4873de88c23eaf46c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:17:44.413142 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-29e65c9d-1e99-49b2-a386-d2155e7e00f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36808302afce48e4873de88c23eaf46c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:17:44.456073 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 803/1640] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:17:43 2022] DELETE /identity/v3/users/36808302afce48e4873de88c23eaf46c => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:17:44.553528 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 838/1641] 10.222.0.42 () {58 vars in 1058 bytes} [Mon Jul 4 09:17:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:17:44.571370 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44b0fe3-91fc-4560-bad5-9c4bdda585a0 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:44.572150 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44b0fe3-91fc-4560-bad5-9c4bdda585a0 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:44.574637 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44b0fe3-91fc-4560-bad5-9c4bdda585a0 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:44.581122 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 804/1642] 10.222.0.42 () {54 vars in 912 bytes} [Mon Jul 4 09:17:44 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:17:44.591678 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34678874-0618-4951-903d-aaa9e18c98a6 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:44.592640 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34678874-0618-4951-903d-aaa9e18c98a6 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:44.593114 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34678874-0618-4951-903d-aaa9e18c98a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:44.653038 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-34678874-0618-4951-903d-aaa9e18c98a6 None None] MFA Rules not processed for user `af3b6e252a8c434a99432bcece6493b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:17:44.655175 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-34678874-0618-4951-903d-aaa9e18c98a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:17:44.832589 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 839/1643] 10.222.0.42 () {58 vars in 1009 bytes} [Mon Jul 4 09:17:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:17:44.847971 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44b0fe3-91fc-4560-bad5-9c4bdda585a0 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:44.850323 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f44b0fe3-91fc-4560-bad5-9c4bdda585a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:17:44.991519 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44b0fe3-91fc-4560-bad5-9c4bdda585a0 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:44.996652 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92148487-a25f-4995-bb57-6d2b3195361d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f86373d65440da97c853fff3c1d0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:44.997933 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92148487-a25f-4995-bb57-6d2b3195361d service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:44.998489 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92148487-a25f-4995-bb57-6d2b3195361d service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:44.998996 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92148487-a25f-4995-bb57-6d2b3195361d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:45.012157 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92148487-a25f-4995-bb57-6d2b3195361d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:45.014084 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92148487-a25f-4995-bb57-6d2b3195361d service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:45.040716 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 805/1644] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:17:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:17:47.167896 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e0f3e-0cca-481b-af0a-aefb0497047c None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:47.168427 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e0f3e-0cca-481b-af0a-aefb0497047c None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:47.168854 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e0f3e-0cca-481b-af0a-aefb0497047c None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:47.170090 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 840/1645] 10.222.0.42 () {54 vars in 961 bytes} [Mon Jul 4 09:17:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:17:47.178771 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f33fbd-06f9-44aa-901e-2c55c04cf031 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:47.179775 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f33fbd-06f9-44aa-901e-2c55c04cf031 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:47.180287 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f33fbd-06f9-44aa-901e-2c55c04cf031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:47.216356 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-66f33fbd-06f9-44aa-901e-2c55c04cf031 None None] MFA Rules not processed for user `af3b6e252a8c434a99432bcece6493b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:17:47.218140 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-66f33fbd-06f9-44aa-901e-2c55c04cf031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:17:47.245760 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 806/1646] 10.222.0.42 () {58 vars in 1058 bytes} [Mon Jul 4 09:17:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:17:47.252650 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f532c06e-696d-4fcb-b5a2-851bb5b286be None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:47.253086 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f532c06e-696d-4fcb-b5a2-851bb5b286be None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:47.253475 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f532c06e-696d-4fcb-b5a2-851bb5b286be None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:47.255944 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 841/1647] 10.222.0.42 () {54 vars in 912 bytes} [Mon Jul 4 09:17:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:17:47.261686 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04db2ce-e5aa-49f6-b65b-97e20a5cfe32 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:47.262116 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04db2ce-e5aa-49f6-b65b-97e20a5cfe32 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:47.262505 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04db2ce-e5aa-49f6-b65b-97e20a5cfe32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:47.306912 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-b04db2ce-e5aa-49f6-b65b-97e20a5cfe32 None None] MFA Rules not processed for user `af3b6e252a8c434a99432bcece6493b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:17:47.309192 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b04db2ce-e5aa-49f6-b65b-97e20a5cfe32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:17:47.338915 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 807/1648] 10.222.0.42 () {58 vars in 1009 bytes} [Mon Jul 4 09:17:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:17:47.354688 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f532c06e-696d-4fcb-b5a2-851bb5b286be None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:47.356256 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-f532c06e-696d-4fcb-b5a2-851bb5b286be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:17:47.382591 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f532c06e-696d-4fcb-b5a2-851bb5b286be None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:47.387708 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f01ffd7-fceb-46ab-a91e-f149abaa7874 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f86373d65440da97c853fff3c1d0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:47.388623 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01ffd7-fceb-46ab-a91e-f149abaa7874 service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:47.389095 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01ffd7-fceb-46ab-a91e-f149abaa7874 service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:47.389491 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01ffd7-fceb-46ab-a91e-f149abaa7874 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:47.411676 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04db2ce-e5aa-49f6-b65b-97e20a5cfe32 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:47.413707 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b04db2ce-e5aa-49f6-b65b-97e20a5cfe32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:17:47.422736 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f01ffd7-fceb-46ab-a91e-f149abaa7874 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:47.436346 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f01ffd7-fceb-46ab-a91e-f149abaa7874 service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:47.475287 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 842/1649] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:17:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 09:17:47.600418 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:17:47.668537 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04db2ce-e5aa-49f6-b65b-97e20a5cfe32 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:47.679373 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f668bdc1-34ed-4109-9485-b86965fe3496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:47.680405 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f668bdc1-34ed-4109-9485-b86965fe3496 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:47.692441 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f668bdc1-34ed-4109-9485-b86965fe3496 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:47.693052 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f668bdc1-34ed-4109-9485-b86965fe3496 admin admin] PATH_INFO: `/v3/projects/0d3c7bd9ba1b4d038af6266ee4d25ac2` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:47.694822 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f668bdc1-34ed-4109-9485-b86965fe3496 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d3c7bd9ba1b4d038af6266ee4d25ac2)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:47.698763 dv-cinder-844563-4-smb devstack@keystone.service[80181]: WARNING py.warnings [None req-f668bdc1-34ed-4109-9485-b86965fe3496 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 04 09:17:47.698763 dv-cinder-844563-4-smb devstack@keystone.service[80181]: warnings.warn(msg) Jul 04 09:17:47.698763 dv-cinder-844563-4-smb devstack@keystone.service[80181]: Jul 04 09:17:47.703220 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f668bdc1-34ed-4109-9485-b86965fe3496 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:47.897941 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-f668bdc1-34ed-4109-9485-b86965fe3496 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d3c7bd9ba1b4d038af6266ee4d25ac2', 'request_id': 'req-f668bdc1-34ed-4109-9485-b86965fe3496'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:17:47.913625 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-f668bdc1-34ed-4109-9485-b86965fe3496 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d3c7bd9ba1b4d038af6266ee4d25ac2', 'request_id': 'req-f668bdc1-34ed-4109-9485-b86965fe3496'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:17:47.929880 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-f668bdc1-34ed-4109-9485-b86965fe3496 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d3c7bd9ba1b4d038af6266ee4d25ac2', 'request_id': 'req-f668bdc1-34ed-4109-9485-b86965fe3496'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:17:47.969543 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-f668bdc1-34ed-4109-9485-b86965fe3496 admin admin] The token cache is being invalidate because project 0d3c7bd9ba1b4d038af6266ee4d25ac2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:17:47.969966 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-f668bdc1-34ed-4109-9485-b86965fe3496 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:17:47.971110 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-f668bdc1-34ed-4109-9485-b86965fe3496 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:17:47.976050 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 808/1650] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:17:47 2022] DELETE /identity/v3/projects/0d3c7bd9ba1b4d038af6266ee4d25ac2 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:17:47.981573 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3206fa68-9990-4978-8e04-e00162667915 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:47.982011 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3206fa68-9990-4978-8e04-e00162667915 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:47.983615 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3206fa68-9990-4978-8e04-e00162667915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:48.035831 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-3206fa68-9990-4978-8e04-e00162667915 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:17:48.043644 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-3206fa68-9990-4978-8e04-e00162667915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:17:48.231594 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 843/1651] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:17:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:17:48.240535 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19fb5f8-6ca4-4039-90f7-b4d11b5c1966 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:48.240535 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19fb5f8-6ca4-4039-90f7-b4d11b5c1966 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:48.240535 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19fb5f8-6ca4-4039-90f7-b4d11b5c1966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:48.299255 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-d19fb5f8-6ca4-4039-90f7-b4d11b5c1966 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:17:48.300772 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d19fb5f8-6ca4-4039-90f7-b4d11b5c1966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:17:48.330030 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 809/1652] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:17:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:17:48.336448 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3206fa68-9990-4978-8e04-e00162667915 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:48.355493 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3206fa68-9990-4978-8e04-e00162667915 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:48.372411 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afe959b-0be0-4e36-8346-a8b92981cc81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:48.373569 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe959b-0be0-4e36-8346-a8b92981cc81 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:48.374072 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe959b-0be0-4e36-8346-a8b92981cc81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:48.374641 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe959b-0be0-4e36-8346-a8b92981cc81 admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:48.375627 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afe959b-0be0-4e36-8346-a8b92981cc81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:17:48.376185 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afe959b-0be0-4e36-8346-a8b92981cc81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:48.381881 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afe959b-0be0-4e36-8346-a8b92981cc81 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:48.388771 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:17:48.415856 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 844/1653] 10.222.0.42 () {58 vars in 1152 bytes} [Mon Jul 4 09:17:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:17:48.419940 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19fb5f8-6ca4-4039-90f7-b4d11b5c1966 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:48.434883 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19fb5f8-6ca4-4039-90f7-b4d11b5c1966 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:48.448700 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a08bb4-eb21-4eec-bfbf-3a4dc7792cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:48.450446 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a08bb4-eb21-4eec-bfbf-3a4dc7792cc6 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:48.451448 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a08bb4-eb21-4eec-bfbf-3a4dc7792cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:48.451990 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a08bb4-eb21-4eec-bfbf-3a4dc7792cc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:48.454538 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a08bb4-eb21-4eec-bfbf-3a4dc7792cc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:48.460362 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a08bb4-eb21-4eec-bfbf-3a4dc7792cc6 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:48.537719 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afe959b-0be0-4e36-8346-a8b92981cc81 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:48.539121 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 810/1654] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:17:48 2022] POST /identity/v3/projects => generated 377 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:17:48.558712 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afe959b-0be0-4e36-8346-a8b92981cc81 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:48.690736 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5408a18b-de21-4619-9ccf-c798672c30ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:48.691576 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5408a18b-de21-4619-9ccf-c798672c30ce admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:48.691767 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5408a18b-de21-4619-9ccf-c798672c30ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:48.692547 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5408a18b-de21-4619-9ccf-c798672c30ce admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:48.693271 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5408a18b-de21-4619-9ccf-c798672c30ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:48.695246 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5408a18b-de21-4619-9ccf-c798672c30ce admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:48.747352 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 845/1655] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:17:48 2022] POST /identity/v3/users => generated 289 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:17:48.747595 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a08bb4-eb21-4eec-bfbf-3a4dc7792cc6 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:48.761889 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a08bb4-eb21-4eec-bfbf-3a4dc7792cc6 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:48.777915 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480601b3-c76a-401e-94fe-1d67bf214903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:48.778628 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480601b3-c76a-401e-94fe-1d67bf214903 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:48.778963 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480601b3-c76a-401e-94fe-1d67bf214903 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:48.779181 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480601b3-c76a-401e-94fe-1d67bf214903 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:48.780032 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480601b3-c76a-401e-94fe-1d67bf214903 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:48.781760 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480601b3-c76a-401e-94fe-1d67bf214903 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:48.810540 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 811/1656] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:17:48 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:17:48.811656 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5408a18b-de21-4619-9ccf-c798672c30ce admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:48.830943 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5408a18b-de21-4619-9ccf-c798672c30ce admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:48.838054 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3d65a8-8129-438a-a0b5-b874c8d775fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:48.838829 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d65a8-8129-438a-a0b5-b874c8d775fc admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:48.839225 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d65a8-8129-438a-a0b5-b874c8d775fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:48.839599 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d65a8-8129-438a-a0b5-b874c8d775fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:48.840484 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3d65a8-8129-438a-a0b5-b874c8d775fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:48.842266 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3d65a8-8129-438a-a0b5-b874c8d775fc admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:48.868020 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480601b3-c76a-401e-94fe-1d67bf214903 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:48.879572 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 846/1657] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:17:48 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:17:48.880589 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480601b3-c76a-401e-94fe-1d67bf214903 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:48.888458 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbcc3d6-0586-47d9-8bf9-763e08db30c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:48.889678 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbcc3d6-0586-47d9-8bf9-763e08db30c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:48.889968 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbcc3d6-0586-47d9-8bf9-763e08db30c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:48.890458 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbcc3d6-0586-47d9-8bf9-763e08db30c3 admin admin] PATH_INFO: `/v3/projects/5c23df1cac534a149bcc008464e66cea/users/130fe9afc5dd4ec58781dea48600633e/roles/81634e7812344f84afcb29b0dba2687c` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:48.913713 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbcc3d6-0586-47d9-8bf9-763e08db30c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c23df1cac534a149bcc008464e66cea, user_id=130fe9afc5dd4ec58781dea48600633e, role_id=81634e7812344f84afcb29b0dba2687c)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:48.917968 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbcc3d6-0586-47d9-8bf9-763e08db30c3 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:48.962292 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705363d5-a71d-4f49-bf86-cb1bb92a0ba6 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:48.964054 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705363d5-a71d-4f49-bf86-cb1bb92a0ba6 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:48.964578 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705363d5-a71d-4f49-bf86-cb1bb92a0ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:48.975565 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 812/1658] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:17:48 2022] PUT /identity/v3/projects/5c23df1cac534a149bcc008464e66cea/users/130fe9afc5dd4ec58781dea48600633e/roles/81634e7812344f84afcb29b0dba2687c => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:17:49.040661 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-705363d5-a71d-4f49-bf86-cb1bb92a0ba6 None None] MFA Rules not processed for user `130fe9afc5dd4ec58781dea48600633e`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:17:49.041996 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-705363d5-a71d-4f49-bf86-cb1bb92a0ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:17:49.221195 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbcc3d6-0586-47d9-8bf9-763e08db30c3 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:49.242304 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 847/1659] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:17:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:17:49.447813 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbcc3d6-0586-47d9-8bf9-763e08db30c3 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:49.503158 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c7654-8540-4158-a652-736a50b43086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:49.503158 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c7654-8540-4158-a652-736a50b43086 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:49.503158 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c7654-8540-4158-a652-736a50b43086 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:49.503158 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c7654-8540-4158-a652-736a50b43086 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:49.503615 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158c7654-8540-4158-a652-736a50b43086 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:49.523028 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158c7654-8540-4158-a652-736a50b43086 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:49.565598 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:17:49.624934 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 813/1660] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:17:49 2022] POST /identity/v3/projects => generated 377 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:17:49.625646 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705363d5-a71d-4f49-bf86-cb1bb92a0ba6 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:49.643813 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705363d5-a71d-4f49-bf86-cb1bb92a0ba6 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:49.756600 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58604494-4feb-4c67-92be-74218b9f1dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:49.757598 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58604494-4feb-4c67-92be-74218b9f1dc9 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:49.758091 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58604494-4feb-4c67-92be-74218b9f1dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:49.758664 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58604494-4feb-4c67-92be-74218b9f1dc9 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:49.764359 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58604494-4feb-4c67-92be-74218b9f1dc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:49.767030 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58604494-4feb-4c67-92be-74218b9f1dc9 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:49.789201 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:17:49.821442 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 848/1661] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:17:49 2022] POST /identity/v3/users => generated 295 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:17:49.822576 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c7654-8540-4158-a652-736a50b43086 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:49.839679 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c7654-8540-4158-a652-736a50b43086 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:49.879115 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f648114-a671-4aac-8ff8-877e8910e834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:49.884026 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f648114-a671-4aac-8ff8-877e8910e834 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:49.885343 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f648114-a671-4aac-8ff8-877e8910e834 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:49.885653 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f648114-a671-4aac-8ff8-877e8910e834 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:49.892794 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f648114-a671-4aac-8ff8-877e8910e834 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:49.898094 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f648114-a671-4aac-8ff8-877e8910e834 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:49.922336 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58604494-4feb-4c67-92be-74218b9f1dc9 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:49.922859 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 814/1662] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:17:49 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:17:49.934766 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58604494-4feb-4c67-92be-74218b9f1dc9 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:49.942783 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32cfe1f-2a01-4fd5-9483-5443dd5f8751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:49.944580 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32cfe1f-2a01-4fd5-9483-5443dd5f8751 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:49.945128 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32cfe1f-2a01-4fd5-9483-5443dd5f8751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:49.945577 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32cfe1f-2a01-4fd5-9483-5443dd5f8751 admin admin] PATH_INFO: `/v3/projects/9b9354af17d74b919319d9e3f3c84c71/users/04ecd6c70d834e1bb1a6cf9d9c700c96/roles/965049e7ce6144aaad23c15f3a5e37c3` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:49.969805 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32cfe1f-2a01-4fd5-9483-5443dd5f8751 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b9354af17d74b919319d9e3f3c84c71, user_id=04ecd6c70d834e1bb1a6cf9d9c700c96, role_id=965049e7ce6144aaad23c15f3a5e37c3)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:49.974327 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32cfe1f-2a01-4fd5-9483-5443dd5f8751 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:50.012810 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 849/1663] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:17:49 2022] PUT /identity/v3/projects/9b9354af17d74b919319d9e3f3c84c71/users/04ecd6c70d834e1bb1a6cf9d9c700c96/roles/965049e7ce6144aaad23c15f3a5e37c3 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:17:50.018296 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f648114-a671-4aac-8ff8-877e8910e834 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:50.029799 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f648114-a671-4aac-8ff8-877e8910e834 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:50.213659 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacdf5e1-411c-475c-88e1-f019ec0ee693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:50.215516 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacdf5e1-411c-475c-88e1-f019ec0ee693 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:50.216597 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacdf5e1-411c-475c-88e1-f019ec0ee693 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:50.218103 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacdf5e1-411c-475c-88e1-f019ec0ee693 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:50.227421 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacdf5e1-411c-475c-88e1-f019ec0ee693 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:50.232029 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacdf5e1-411c-475c-88e1-f019ec0ee693 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:50.264687 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 815/1664] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:17:50 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:17:50.271857 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32cfe1f-2a01-4fd5-9483-5443dd5f8751 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:50.294491 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32cfe1f-2a01-4fd5-9483-5443dd5f8751 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:50.313366 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a185a665-b6e6-48fb-9070-e7d3c33f4447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:50.314412 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a185a665-b6e6-48fb-9070-e7d3c33f4447 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:50.314703 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a185a665-b6e6-48fb-9070-e7d3c33f4447 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:50.315017 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a185a665-b6e6-48fb-9070-e7d3c33f4447 admin admin] PATH_INFO: `/v3/projects/9b9354af17d74b919319d9e3f3c84c71/users/04ecd6c70d834e1bb1a6cf9d9c700c96/roles/965049e7ce6144aaad23c15f3a5e37c3` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:50.323179 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a185a665-b6e6-48fb-9070-e7d3c33f4447 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b9354af17d74b919319d9e3f3c84c71, user_id=04ecd6c70d834e1bb1a6cf9d9c700c96, role_id=965049e7ce6144aaad23c15f3a5e37c3)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:50.339810 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a185a665-b6e6-48fb-9070-e7d3c33f4447 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:50.367007 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 850/1665] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:17:50 2022] PUT /identity/v3/projects/9b9354af17d74b919319d9e3f3c84c71/users/04ecd6c70d834e1bb1a6cf9d9c700c96/roles/965049e7ce6144aaad23c15f3a5e37c3 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:17:50.381877 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b7774-51c5-4b01-9439-1cf0ce752ec2 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:50.382224 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b7774-51c5-4b01-9439-1cf0ce752ec2 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:50.382558 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b7774-51c5-4b01-9439-1cf0ce752ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:50.442332 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-a85b7774-51c5-4b01-9439-1cf0ce752ec2 None None] MFA Rules not processed for user `04ecd6c70d834e1bb1a6cf9d9c700c96`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:17:50.444397 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a85b7774-51c5-4b01-9439-1cf0ce752ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:17:50.672619 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 816/1666] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:17:50 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:17:50.685343 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a185a665-b6e6-48fb-9070-e7d3c33f4447 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:50.687941 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-a185a665-b6e6-48fb-9070-e7d3c33f4447 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:17:50.847270 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a185a665-b6e6-48fb-9070-e7d3c33f4447 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:50.851758 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd62a5dc-ee26-4fa4-b108-9ef563454f48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f86373d65440da97c853fff3c1d0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:50.852560 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62a5dc-ee26-4fa4-b108-9ef563454f48 service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:50.853190 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62a5dc-ee26-4fa4-b108-9ef563454f48 service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:50.858447 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62a5dc-ee26-4fa4-b108-9ef563454f48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:50.974344 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd62a5dc-ee26-4fa4-b108-9ef563454f48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:50.979759 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd62a5dc-ee26-4fa4-b108-9ef563454f48 service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:51.001569 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 851/1667] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:17:50 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:17:54.647014 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85b7774-51c5-4b01-9439-1cf0ce752ec2 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:54.648556 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a85b7774-51c5-4b01-9439-1cf0ce752ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:17:54.664695 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85b7774-51c5-4b01-9439-1cf0ce752ec2 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:54.683130 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe63823b-fa34-4ecf-840c-57f16738e4fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f86373d65440da97c853fff3c1d0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:54.683825 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe63823b-fa34-4ecf-840c-57f16738e4fc service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:54.684287 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe63823b-fa34-4ecf-840c-57f16738e4fc service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:54.684561 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe63823b-fa34-4ecf-840c-57f16738e4fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:54.716140 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe63823b-fa34-4ecf-840c-57f16738e4fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:54.717756 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe63823b-fa34-4ecf-840c-57f16738e4fc service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:54.761411 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 817/1668] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:17:54 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:17:54.781004 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e5580-eead-4764-9802-915de75176c3 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:54.781564 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e5580-eead-4764-9802-915de75176c3 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:54.781966 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e5580-eead-4764-9802-915de75176c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:54.844772 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-ed3e5580-eead-4764-9802-915de75176c3 None None] MFA Rules not processed for user `e87c029b91ce4bcf977b52cf18ffd37c`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:17:54.848210 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-ed3e5580-eead-4764-9802-915de75176c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:17:55.058333 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:17:55.090584 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630134de-2f98-4e17-8bf7-ae4a8b0abefe None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:55.090865 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630134de-2f98-4e17-8bf7-ae4a8b0abefe None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:55.091209 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630134de-2f98-4e17-8bf7-ae4a8b0abefe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:55.106582 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 852/1669] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:17:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:17:55.138479 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-630134de-2f98-4e17-8bf7-ae4a8b0abefe None None] MFA Rules not processed for user `e87c029b91ce4bcf977b52cf18ffd37c`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:17:55.139780 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-630134de-2f98-4e17-8bf7-ae4a8b0abefe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:17:55.176272 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 818/1670] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:17:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:17:55.208872 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e5580-eead-4764-9802-915de75176c3 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:55.214532 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-ed3e5580-eead-4764-9802-915de75176c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:17:55.330410 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630134de-2f98-4e17-8bf7-ae4a8b0abefe None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:55.331901 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-630134de-2f98-4e17-8bf7-ae4a8b0abefe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:17:55.477801 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e5580-eead-4764-9802-915de75176c3 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:55.489421 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:17:55.515606 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79a5490-56b7-47d2-8b35-7b29869e8bca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3b6e252a8c434a99432bcece6493b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:55.518135 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a5490-56b7-47d2-8b35-7b29869e8bca service nova] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:55.522139 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a5490-56b7-47d2-8b35-7b29869e8bca service nova] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:55.522875 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a5490-56b7-47d2-8b35-7b29869e8bca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:55.533234 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630134de-2f98-4e17-8bf7-ae4a8b0abefe None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:55.538982 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eab185-d3ff-4c04-b278-c2d443972af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:55.539925 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eab185-d3ff-4c04-b278-c2d443972af6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:55.540212 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eab185-d3ff-4c04-b278-c2d443972af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:55.540480 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eab185-d3ff-4c04-b278-c2d443972af6 admin admin] PATH_INFO: `/v3/users/8941915283174f9588cbe4b3d67858ce` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:55.542946 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eab185-d3ff-4c04-b278-c2d443972af6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8941915283174f9588cbe4b3d67858ce)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:55.545075 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eab185-d3ff-4c04-b278-c2d443972af6 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:55.582963 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79a5490-56b7-47d2-8b35-7b29869e8bca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:55.589528 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79a5490-56b7-47d2-8b35-7b29869e8bca service nova] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:55.624475 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 853/1671] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:17:55 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:17:55.740292 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-40eab185-d3ff-4c04-b278-c2d443972af6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8941915283174f9588cbe4b3d67858ce'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:17:55.742155 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-40eab185-d3ff-4c04-b278-c2d443972af6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8941915283174f9588cbe4b3d67858ce'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:17:55.777032 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-40eab185-d3ff-4c04-b278-c2d443972af6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8941915283174f9588cbe4b3d67858ce'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:17:55.778978 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-40eab185-d3ff-4c04-b278-c2d443972af6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8941915283174f9588cbe4b3d67858ce'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:17:55.798845 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-40eab185-d3ff-4c04-b278-c2d443972af6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8941915283174f9588cbe4b3d67858ce'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:17:55.823170 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 819/1672] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:17:55 2022] DELETE /identity/v3/users/8941915283174f9588cbe4b3d67858ce => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:17:55.830853 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a83a8e-f28d-4aa4-b70a-e5ddff947e00 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:55.831592 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a83a8e-f28d-4aa4-b70a-e5ddff947e00 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:55.831785 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a83a8e-f28d-4aa4-b70a-e5ddff947e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:55.927214 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-b8a83a8e-f28d-4aa4-b70a-e5ddff947e00 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:17:55.937924 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-b8a83a8e-f28d-4aa4-b70a-e5ddff947e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:17:56.148434 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 854/1673] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:17:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:17:56.346597 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eab185-d3ff-4c04-b278-c2d443972af6 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:56.348253 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-40eab185-d3ff-4c04-b278-c2d443972af6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:17:56.562720 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eab185-d3ff-4c04-b278-c2d443972af6 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:56.574138 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829a1121-b4f6-4a27-b912-c0ee2f7eec55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:56.574830 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829a1121-b4f6-4a27-b912-c0ee2f7eec55 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:56.575115 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829a1121-b4f6-4a27-b912-c0ee2f7eec55 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:56.575394 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829a1121-b4f6-4a27-b912-c0ee2f7eec55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:56.614819 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829a1121-b4f6-4a27-b912-c0ee2f7eec55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:56.616401 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829a1121-b4f6-4a27-b912-c0ee2f7eec55 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:56.679144 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 820/1674] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:17:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:17:56.948067 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a650c-0dfb-4a09-80ef-23e1eacf60f6 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:56.949113 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a650c-0dfb-4a09-80ef-23e1eacf60f6 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:56.949609 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a650c-0dfb-4a09-80ef-23e1eacf60f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:57.007574 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-9b2a650c-0dfb-4a09-80ef-23e1eacf60f6 None None] MFA Rules not processed for user `defd27b64b204349a191a7b50b2d4cc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:17:57.009330 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-9b2a650c-0dfb-4a09-80ef-23e1eacf60f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:17:57.165714 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 855/1675] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:17:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:17:57.178125 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c1461-8ee7-4db5-abc6-1f8005e44335 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:57.179008 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c1461-8ee7-4db5-abc6-1f8005e44335 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:57.179423 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c1461-8ee7-4db5-abc6-1f8005e44335 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:57.181128 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 821/1676] 10.222.0.42 () {54 vars in 912 bytes} [Mon Jul 4 09:17:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:17:57.189169 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a650c-0dfb-4a09-80ef-23e1eacf60f6 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:57.190994 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-9b2a650c-0dfb-4a09-80ef-23e1eacf60f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:17:57.197525 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c9ecc-0991-4f39-bb79-9f07d3b455f5 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:57.198026 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c9ecc-0991-4f39-bb79-9f07d3b455f5 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:57.198306 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c9ecc-0991-4f39-bb79-9f07d3b455f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:57.215805 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:17:57.291225 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-d40c9ecc-0991-4f39-bb79-9f07d3b455f5 None None] MFA Rules not processed for user `4db0575f076240559f64e9548b56ffeb`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:17:57.292537 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d40c9ecc-0991-4f39-bb79-9f07d3b455f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:17:57.306880 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 822/1677] 10.222.0.42 () {58 vars in 1009 bytes} [Mon Jul 4 09:17:57 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:17:57.308364 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40c9ecc-0991-4f39-bb79-9f07d3b455f5 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:57.309907 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d40c9ecc-0991-4f39-bb79-9f07d3b455f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:17:57.338430 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40c9ecc-0991-4f39-bb79-9f07d3b455f5 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:57.347502 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a650c-0dfb-4a09-80ef-23e1eacf60f6 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:57.350259 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb64fd9b-4a13-46da-817f-4e7745d5f7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:57.354721 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb64fd9b-4a13-46da-817f-4e7745d5f7cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:57.356540 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb64fd9b-4a13-46da-817f-4e7745d5f7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:57.357148 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb64fd9b-4a13-46da-817f-4e7745d5f7cf admin admin] PATH_INFO: `/v3/projects/995839d7ff2b483597fdc46bc72301c3` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:57.360509 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb64fd9b-4a13-46da-817f-4e7745d5f7cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=995839d7ff2b483597fdc46bc72301c3)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:57.364310 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645bf567-1943-4b16-9561-b1cb5cedd848 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3b6e252a8c434a99432bcece6493b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:57.365439 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb64fd9b-4a13-46da-817f-4e7745d5f7cf admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:57.366423 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645bf567-1943-4b16-9561-b1cb5cedd848 service nova] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:57.366817 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645bf567-1943-4b16-9561-b1cb5cedd848 service nova] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:57.368125 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645bf567-1943-4b16-9561-b1cb5cedd848 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:57.401489 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645bf567-1943-4b16-9561-b1cb5cedd848 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:57.406542 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645bf567-1943-4b16-9561-b1cb5cedd848 service nova] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:57.447987 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 856/1678] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:17:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:17:57.449504 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d76fdcb-1ee3-495e-8651-0b6f6c2504fb None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:57.449800 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d76fdcb-1ee3-495e-8651-0b6f6c2504fb None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:57.452719 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d76fdcb-1ee3-495e-8651-0b6f6c2504fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:57.495508 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:17:57.518404 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-bb64fd9b-4a13-46da-817f-4e7745d5f7cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '995839d7ff2b483597fdc46bc72301c3', 'request_id': 'req-bb64fd9b-4a13-46da-817f-4e7745d5f7cf'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:17:57.520201 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-2d76fdcb-1ee3-495e-8651-0b6f6c2504fb None None] MFA Rules not processed for user `1c1ef56d5b9f4545865414d14f861907`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:17:57.521785 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-2d76fdcb-1ee3-495e-8651-0b6f6c2504fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:17:57.536598 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-bb64fd9b-4a13-46da-817f-4e7745d5f7cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '995839d7ff2b483597fdc46bc72301c3', 'request_id': 'req-bb64fd9b-4a13-46da-817f-4e7745d5f7cf'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:17:57.559946 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-bb64fd9b-4a13-46da-817f-4e7745d5f7cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '995839d7ff2b483597fdc46bc72301c3', 'request_id': 'req-bb64fd9b-4a13-46da-817f-4e7745d5f7cf'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:17:57.620732 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-bb64fd9b-4a13-46da-817f-4e7745d5f7cf admin admin] The token cache is being invalidate because project 995839d7ff2b483597fdc46bc72301c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:17:57.621309 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-bb64fd9b-4a13-46da-817f-4e7745d5f7cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:17:57.624378 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-bb64fd9b-4a13-46da-817f-4e7745d5f7cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:17:57.626391 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 823/1679] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:17:57 2022] DELETE /identity/v3/projects/995839d7ff2b483597fdc46bc72301c3 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:17:57.630538 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb64fd9b-4a13-46da-817f-4e7745d5f7cf admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:57.635520 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 857/1680] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:17:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:17:57.636767 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01169f-6d2a-40b9-98a1-2a6c8d4c5751 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:57.637066 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01169f-6d2a-40b9-98a1-2a6c8d4c5751 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:57.637352 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01169f-6d2a-40b9-98a1-2a6c8d4c5751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:57.637469 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-bb64fd9b-4a13-46da-817f-4e7745d5f7cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:17:57.665121 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-3e01169f-6d2a-40b9-98a1-2a6c8d4c5751 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:17:57.666578 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-3e01169f-6d2a-40b9-98a1-2a6c8d4c5751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:17:57.872482 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 858/1681] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:17:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:17:57.874069 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e207ef86-b9c4-4062-9362-4bc77eb66544 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:57.874609 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e207ef86-b9c4-4062-9362-4bc77eb66544 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:57.875236 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e207ef86-b9c4-4062-9362-4bc77eb66544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:57.876026 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb64fd9b-4a13-46da-817f-4e7745d5f7cf admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:57.913657 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a390271-d498-4505-8adb-2faf775c55b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:57.921127 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a390271-d498-4505-8adb-2faf775c55b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:57.921838 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a390271-d498-4505-8adb-2faf775c55b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:57.922142 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a390271-d498-4505-8adb-2faf775c55b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:57.930577 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-1a390271-d498-4505-8adb-2faf775c55b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:17:57.982213 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-e207ef86-b9c4-4062-9362-4bc77eb66544 None None] MFA Rules not processed for user `1c1ef56d5b9f4545865414d14f861907`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:17:57.992517 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-e207ef86-b9c4-4062-9362-4bc77eb66544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:17:58.002108 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a390271-d498-4505-8adb-2faf775c55b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:58.004001 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a390271-d498-4505-8adb-2faf775c55b2 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:58.039280 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 859/1682] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:17:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:17:58.046980 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e669140-2456-446c-9c7d-094638a160c1 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:58.047275 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e669140-2456-446c-9c7d-094638a160c1 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:58.047554 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e669140-2456-446c-9c7d-094638a160c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:58.051317 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 824/1683] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:17:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:17:58.057763 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a390271-d498-4505-8adb-2faf775c55b2 service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:58.062634 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-1a390271-d498-4505-8adb-2faf775c55b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:17:58.107757 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-8e669140-2456-446c-9c7d-094638a160c1 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:17:58.109040 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-8e669140-2456-446c-9c7d-094638a160c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:17:58.150100 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 860/1684] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:17:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:17:58.152564 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e669140-2456-446c-9c7d-094638a160c1 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:58.179536 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e669140-2456-446c-9c7d-094638a160c1 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:58.209686 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592e114a-eaf2-46e2-9389-28b8743219fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:58.210747 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e114a-eaf2-46e2-9389-28b8743219fb admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:58.211373 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e114a-eaf2-46e2-9389-28b8743219fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:58.211754 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e114a-eaf2-46e2-9389-28b8743219fb admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:58.223129 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592e114a-eaf2-46e2-9389-28b8743219fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:17:58.223360 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592e114a-eaf2-46e2-9389-28b8743219fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:58.225360 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592e114a-eaf2-46e2-9389-28b8743219fb admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:58.282634 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 861/1685] 10.222.0.42 () {58 vars in 1152 bytes} [Mon Jul 4 09:17:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:17:58.288008 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592e114a-eaf2-46e2-9389-28b8743219fb admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:58.298468 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:17:58.316314 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a390271-d498-4505-8adb-2faf775c55b2 service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:58.321664 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592e114a-eaf2-46e2-9389-28b8743219fb admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:58.341812 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe57e18-6497-411e-ad1c-ecf7d2f85eb1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3b6e252a8c434a99432bcece6493b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:58.342478 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe57e18-6497-411e-ad1c-ecf7d2f85eb1 service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:58.342764 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe57e18-6497-411e-ad1c-ecf7d2f85eb1 service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:58.343123 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe57e18-6497-411e-ad1c-ecf7d2f85eb1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:58.346202 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e088b4-42a0-44f3-91d4-a2f70c1b6866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:58.346896 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e088b4-42a0-44f3-91d4-a2f70c1b6866 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:58.347188 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e088b4-42a0-44f3-91d4-a2f70c1b6866 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:58.347468 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e088b4-42a0-44f3-91d4-a2f70c1b6866 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:58.348260 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e088b4-42a0-44f3-91d4-a2f70c1b6866 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:58.350692 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e088b4-42a0-44f3-91d4-a2f70c1b6866 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:58.353399 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-bfe57e18-6497-411e-ad1c-ecf7d2f85eb1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:17:58.398599 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe57e18-6497-411e-ad1c-ecf7d2f85eb1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:58.400808 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe57e18-6497-411e-ad1c-ecf7d2f85eb1 service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:58.440316 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 825/1686] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:17:58 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:17:58.445618 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 862/1687] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:17:58 2022] POST /identity/v3/projects => generated 373 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:17:58.451221 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe57e18-6497-411e-ad1c-ecf7d2f85eb1 service nova] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:58.471488 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe57e18-6497-411e-ad1c-ecf7d2f85eb1 service nova] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:58.556258 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:17:58.589986 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3630ae-eb68-44a3-bc79-06efa0d1eb90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:58.591457 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3630ae-eb68-44a3-bc79-06efa0d1eb90 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:58.591998 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3630ae-eb68-44a3-bc79-06efa0d1eb90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:58.592665 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3630ae-eb68-44a3-bc79-06efa0d1eb90 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:58.594757 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3630ae-eb68-44a3-bc79-06efa0d1eb90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:58.598110 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3630ae-eb68-44a3-bc79-06efa0d1eb90 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:58.649188 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 826/1688] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:17:58 2022] POST /identity/v3/users => generated 287 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:17:58.653389 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e088b4-42a0-44f3-91d4-a2f70c1b6866 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:58.672677 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e088b4-42a0-44f3-91d4-a2f70c1b6866 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:58.682907 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517df90f-9887-4957-82dd-633a8e6be5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:58.683781 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517df90f-9887-4957-82dd-633a8e6be5cf admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:58.684285 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517df90f-9887-4957-82dd-633a8e6be5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:58.684668 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517df90f-9887-4957-82dd-633a8e6be5cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:58.685786 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517df90f-9887-4957-82dd-633a8e6be5cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:58.687699 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517df90f-9887-4957-82dd-633a8e6be5cf admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:58.707702 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 863/1689] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:17:58 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:17:58.709159 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3630ae-eb68-44a3-bc79-06efa0d1eb90 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:58.721733 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3630ae-eb68-44a3-bc79-06efa0d1eb90 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:58.729167 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11da19aa-396d-4485-aa0a-8424b3c8d7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:58.730245 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da19aa-396d-4485-aa0a-8424b3c8d7a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:58.730747 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da19aa-396d-4485-aa0a-8424b3c8d7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:58.731209 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da19aa-396d-4485-aa0a-8424b3c8d7a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:58.733272 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11da19aa-396d-4485-aa0a-8424b3c8d7a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:58.735265 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11da19aa-396d-4485-aa0a-8424b3c8d7a4 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:58.766903 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 827/1690] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:17:58 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:17:58.767077 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517df90f-9887-4957-82dd-633a8e6be5cf admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:58.782776 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517df90f-9887-4957-82dd-633a8e6be5cf admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:58.797585 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a52098-b4f2-411b-845f-94e4476d9c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:58.798668 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a52098-b4f2-411b-845f-94e4476d9c84 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:58.801414 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a52098-b4f2-411b-845f-94e4476d9c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:58.801795 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a52098-b4f2-411b-845f-94e4476d9c84 admin admin] PATH_INFO: `/v3/projects/1a1c59efb64243ecb5594134104c12ae/users/38e2fdd8d5a245e6a760fb10f8b55989/roles/81634e7812344f84afcb29b0dba2687c` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:58.849049 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a52098-b4f2-411b-845f-94e4476d9c84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a1c59efb64243ecb5594134104c12ae, user_id=38e2fdd8d5a245e6a760fb10f8b55989, role_id=81634e7812344f84afcb29b0dba2687c)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:58.862329 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a52098-b4f2-411b-845f-94e4476d9c84 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:58.908488 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 864/1691] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:17:58 2022] PUT /identity/v3/projects/1a1c59efb64243ecb5594134104c12ae/users/38e2fdd8d5a245e6a760fb10f8b55989/roles/81634e7812344f84afcb29b0dba2687c => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:17:58.920239 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b343e4df-d037-4b8e-87b2-48fba43ef6fc None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:58.920533 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b343e4df-d037-4b8e-87b2-48fba43ef6fc None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:58.920812 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b343e4df-d037-4b8e-87b2-48fba43ef6fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:58.976840 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-b343e4df-d037-4b8e-87b2-48fba43ef6fc None None] MFA Rules not processed for user `38e2fdd8d5a245e6a760fb10f8b55989`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:17:58.978132 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b343e4df-d037-4b8e-87b2-48fba43ef6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:17:59.127326 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 828/1692] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:17:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:17:59.129908 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a52098-b4f2-411b-845f-94e4476d9c84 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:59.296286 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a52098-b4f2-411b-845f-94e4476d9c84 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:59.328623 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7cee63-0eff-44c9-a45a-9fd259691b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:59.329318 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7cee63-0eff-44c9-a45a-9fd259691b9e admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:59.329608 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7cee63-0eff-44c9-a45a-9fd259691b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:59.329964 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7cee63-0eff-44c9-a45a-9fd259691b9e admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:59.330590 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7cee63-0eff-44c9-a45a-9fd259691b9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:59.346113 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7cee63-0eff-44c9-a45a-9fd259691b9e admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:59.446672 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 865/1693] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:17:59 2022] POST /identity/v3/projects => generated 373 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:17:59.447340 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b343e4df-d037-4b8e-87b2-48fba43ef6fc None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:59.466513 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b343e4df-d037-4b8e-87b2-48fba43ef6fc None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:59.481035 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae80a3-949a-40e6-a8ba-6bd497831d3d None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:59.481330 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae80a3-949a-40e6-a8ba-6bd497831d3d None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:59.481609 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae80a3-949a-40e6-a8ba-6bd497831d3d None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:59.491795 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 866/1694] 10.222.0.42 () {54 vars in 912 bytes} [Mon Jul 4 09:17:59 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:17:59.502389 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df375e-8fa1-445d-a88f-2960e6f95c3a None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:59.503216 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df375e-8fa1-445d-a88f-2960e6f95c3a None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:59.503531 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df375e-8fa1-445d-a88f-2960e6f95c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:59.562429 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-a5df375e-8fa1-445d-a88f-2960e6f95c3a None None] MFA Rules not processed for user `4db0575f076240559f64e9548b56ffeb`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:17:59.588177 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-a5df375e-8fa1-445d-a88f-2960e6f95c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:17:59.720705 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aefb045-9c93-4a32-ac03-8f1641788994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:59.721416 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aefb045-9c93-4a32-ac03-8f1641788994 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:59.721704 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aefb045-9c93-4a32-ac03-8f1641788994 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:59.721981 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aefb045-9c93-4a32-ac03-8f1641788994 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:59.722761 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aefb045-9c93-4a32-ac03-8f1641788994 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:59.725215 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aefb045-9c93-4a32-ac03-8f1641788994 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:59.744042 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 867/1695] 10.222.0.42 () {58 vars in 1009 bytes} [Mon Jul 4 09:17:59 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:17:59.810071 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 829/1696] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:17:59 2022] POST /identity/v3/users => generated 293 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:17:59.810824 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5df375e-8fa1-445d-a88f-2960e6f95c3a None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:59.826083 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5df375e-8fa1-445d-a88f-2960e6f95c3a None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:59.831481 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401e850d-8167-4287-970b-a6ebc0a6319e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:59.833656 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e850d-8167-4287-970b-a6ebc0a6319e admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:59.833796 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aefb045-9c93-4a32-ac03-8f1641788994 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:59.833999 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e850d-8167-4287-970b-a6ebc0a6319e admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:59.834342 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e850d-8167-4287-970b-a6ebc0a6319e admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:59.835349 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401e850d-8167-4287-970b-a6ebc0a6319e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:59.835662 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0aefb045-9c93-4a32-ac03-8f1641788994 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:17:59.837313 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401e850d-8167-4287-970b-a6ebc0a6319e admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:59.870017 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aefb045-9c93-4a32-ac03-8f1641788994 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:59.889122 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f967ede6-c600-46f2-ad08-754b079f6981 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:59.890336 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f967ede6-c600-46f2-ad08-754b079f6981 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:59.890844 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f967ede6-c600-46f2-ad08-754b079f6981 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:59.891437 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f967ede6-c600-46f2-ad08-754b079f6981 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:59.900301 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 868/1697] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:17:59 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:17:59.903096 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401e850d-8167-4287-970b-a6ebc0a6319e admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:17:59.908399 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f967ede6-c600-46f2-ad08-754b079f6981 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:59.911507 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f967ede6-c600-46f2-ad08-754b079f6981 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:17:59.924671 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 830/1698] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:17:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:17:59.931914 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401e850d-8167-4287-970b-a6ebc0a6319e admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:17:59.943362 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd553c00-1ffa-4ec7-ae5d-63130c4eab93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:17:59.944316 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd553c00-1ffa-4ec7-ae5d-63130c4eab93 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:17:59.944607 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd553c00-1ffa-4ec7-ae5d-63130c4eab93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:17:59.945006 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd553c00-1ffa-4ec7-ae5d-63130c4eab93 admin admin] PATH_INFO: `/v3/projects/1bba3cef7c6249c387da1192b92c8623/users/d6b3255e75de4a64886cc5ed2da0bd3e/roles/965049e7ce6144aaad23c15f3a5e37c3` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:17:59.979012 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd553c00-1ffa-4ec7-ae5d-63130c4eab93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bba3cef7c6249c387da1192b92c8623, user_id=d6b3255e75de4a64886cc5ed2da0bd3e, role_id=965049e7ce6144aaad23c15f3a5e37c3)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:17:59.982580 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd553c00-1ffa-4ec7-ae5d-63130c4eab93 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:00.016149 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 869/1699] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:17:59 2022] PUT /identity/v3/projects/1bba3cef7c6249c387da1192b92c8623/users/d6b3255e75de4a64886cc5ed2da0bd3e/roles/965049e7ce6144aaad23c15f3a5e37c3 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:18:00.017382 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f967ede6-c600-46f2-ad08-754b079f6981 service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:00.039254 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f967ede6-c600-46f2-ad08-754b079f6981 service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:00.113740 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a647ded-85a1-467c-b7ca-a7c65e060372 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:00.114211 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a647ded-85a1-467c-b7ca-a7c65e060372 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:00.114503 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a647ded-85a1-467c-b7ca-a7c65e060372 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:00.116002 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 870/1700] 10.222.0.42 () {54 vars in 960 bytes} [Mon Jul 4 09:18:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:18:00.124680 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e7c7b-b40c-42e1-992d-4d6a7f7147b3 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:00.124975 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e7c7b-b40c-42e1-992d-4d6a7f7147b3 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:00.125258 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e7c7b-b40c-42e1-992d-4d6a7f7147b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:00.158942 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:00.207703 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-f77e7c7b-b40c-42e1-992d-4d6a7f7147b3 None None] MFA Rules not processed for user `46ec1a2091f1434cabc69066eb3b6725`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:18:00.211717 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-f77e7c7b-b40c-42e1-992d-4d6a7f7147b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:00.230496 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:00.294425 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2613a0-b5f0-4013-a034-2adbed8d0fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:00.295361 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2613a0-b5f0-4013-a034-2adbed8d0fdf admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:00.295711 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2613a0-b5f0-4013-a034-2adbed8d0fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:00.295945 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2613a0-b5f0-4013-a034-2adbed8d0fdf admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:00.296706 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2613a0-b5f0-4013-a034-2adbed8d0fdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:00.299500 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2613a0-b5f0-4013-a034-2adbed8d0fdf admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:00.335212 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 831/1701] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:18:00 2022] GET /identity/v3/roles => generated 1420 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:18:00.336389 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2613a0-b5f0-4013-a034-2adbed8d0fdf admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:00.366959 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2613a0-b5f0-4013-a034-2adbed8d0fdf admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:00.390215 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f14da4-800d-4be6-b026-6c8aa7567f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:00.391254 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f14da4-800d-4be6-b026-6c8aa7567f83 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:00.391542 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f14da4-800d-4be6-b026-6c8aa7567f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:00.391827 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f14da4-800d-4be6-b026-6c8aa7567f83 admin admin] PATH_INFO: `/v3/projects/1bba3cef7c6249c387da1192b92c8623/users/d6b3255e75de4a64886cc5ed2da0bd3e/roles/965049e7ce6144aaad23c15f3a5e37c3` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:00.410289 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f14da4-800d-4be6-b026-6c8aa7567f83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bba3cef7c6249c387da1192b92c8623, user_id=d6b3255e75de4a64886cc5ed2da0bd3e, role_id=965049e7ce6144aaad23c15f3a5e37c3)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:00.413227 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f14da4-800d-4be6-b026-6c8aa7567f83 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:00.453861 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 832/1702] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:18:00 2022] PUT /identity/v3/projects/1bba3cef7c6249c387da1192b92c8623/users/d6b3255e75de4a64886cc5ed2da0bd3e/roles/965049e7ce6144aaad23c15f3a5e37c3 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:18:00.464304 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca767710-98cf-4fa6-a972-17cdc3c10fdb None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:00.464608 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca767710-98cf-4fa6-a972-17cdc3c10fdb None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:00.464920 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca767710-98cf-4fa6-a972-17cdc3c10fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:00.508982 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 871/1703] 10.222.0.42 () {58 vars in 1057 bytes} [Mon Jul 4 09:18:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:18:00.522116 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77e7c7b-b40c-42e1-992d-4d6a7f7147b3 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:00.539987 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77e7c7b-b40c-42e1-992d-4d6a7f7147b3 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:00.572246 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-ca767710-98cf-4fa6-a972-17cdc3c10fdb None None] MFA Rules not processed for user `d6b3255e75de4a64886cc5ed2da0bd3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:18:00.573519 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ca767710-98cf-4fa6-a972-17cdc3c10fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:00.813618 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5094eb1b-9ecd-472a-b49c-8fcb09e58899 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46ec1a2091f1434cabc69066eb3b6725', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:00.818866 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5094eb1b-9ecd-472a-b49c-8fcb09e58899 service placement] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:00.821440 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5094eb1b-9ecd-472a-b49c-8fcb09e58899 service placement] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:00.822373 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5094eb1b-9ecd-472a-b49c-8fcb09e58899 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:00.829478 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-5094eb1b-9ecd-472a-b49c-8fcb09e58899 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:00.876919 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5094eb1b-9ecd-472a-b49c-8fcb09e58899 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:00.878568 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5094eb1b-9ecd-472a-b49c-8fcb09e58899 service placement] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:00.929245 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 833/1704] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:18:00 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 466 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:18:00.930954 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca767710-98cf-4fa6-a972-17cdc3c10fdb None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:00.933715 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 872/1705] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:18:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 09:18:00.936694 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ca767710-98cf-4fa6-a972-17cdc3c10fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:01.141626 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca767710-98cf-4fa6-a972-17cdc3c10fdb None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:01.154812 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c64e60-9a58-45ed-bbb4-a3c8eb8925e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f86373d65440da97c853fff3c1d0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:01.155499 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c64e60-9a58-45ed-bbb4-a3c8eb8925e2 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:01.155782 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c64e60-9a58-45ed-bbb4-a3c8eb8925e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:01.156076 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c64e60-9a58-45ed-bbb4-a3c8eb8925e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:01.180144 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c64e60-9a58-45ed-bbb4-a3c8eb8925e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:01.181672 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c64e60-9a58-45ed-bbb4-a3c8eb8925e2 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:01.229605 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 834/1706] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:18:00 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:18:01.705372 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f394f2d1-5655-479d-af86-c7106b8a5ccb None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:01.706282 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f394f2d1-5655-479d-af86-c7106b8a5ccb None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:01.706725 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f394f2d1-5655-479d-af86-c7106b8a5ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:01.830406 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-f394f2d1-5655-479d-af86-c7106b8a5ccb None None] MFA Rules not processed for user `6d13b840941349d78da243f9b4c2c72e`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:18:01.831647 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-f394f2d1-5655-479d-af86-c7106b8a5ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:02.079338 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d046d48-f7a2-43b5-9337-c3338d5664ee None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:02.080347 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d046d48-f7a2-43b5-9337-c3338d5664ee None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:02.080959 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d046d48-f7a2-43b5-9337-c3338d5664ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:02.156935 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-3d046d48-f7a2-43b5-9337-c3338d5664ee None None] MFA Rules not processed for user `1c1ef56d5b9f4545865414d14f861907`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:18:02.162421 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3d046d48-f7a2-43b5-9337-c3338d5664ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:02.183449 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 873/1707] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:18:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 472 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:18:02.200300 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f394f2d1-5655-479d-af86-c7106b8a5ccb None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:02.202132 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-f394f2d1-5655-479d-af86-c7106b8a5ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:02.279987 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:02.348843 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:02.386680 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 835/1708] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:18:02 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:18:02.570704 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f394f2d1-5655-479d-af86-c7106b8a5ccb None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:02.605452 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e80983-c8a4-4a24-a9c1-bf7470d7b6be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3b6e252a8c434a99432bcece6493b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:02.606169 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e80983-c8a4-4a24-a9c1-bf7470d7b6be service nova] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:02.606462 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e80983-c8a4-4a24-a9c1-bf7470d7b6be service nova] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:02.606801 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e80983-c8a4-4a24-a9c1-bf7470d7b6be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:02.664283 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e80983-c8a4-4a24-a9c1-bf7470d7b6be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:02.669429 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e80983-c8a4-4a24-a9c1-bf7470d7b6be service nova] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:02.710941 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 874/1709] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:18:02 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 09:18:03.163134 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d046d48-f7a2-43b5-9337-c3338d5664ee None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:03.294991 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d046d48-f7a2-43b5-9337-c3338d5664ee None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:03.317522 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cb5791-4a7e-47ff-af88-29dc0fb62ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:03.320329 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb5791-4a7e-47ff-af88-29dc0fb62ec5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:03.320772 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb5791-4a7e-47ff-af88-29dc0fb62ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:03.321184 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb5791-4a7e-47ff-af88-29dc0fb62ec5 admin admin] PATH_INFO: `/v3/users/38e2fdd8d5a245e6a760fb10f8b55989` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:03.328612 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cb5791-4a7e-47ff-af88-29dc0fb62ec5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38e2fdd8d5a245e6a760fb10f8b55989)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:03.334201 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cb5791-4a7e-47ff-af88-29dc0fb62ec5 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:03.449531 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-97cb5791-4a7e-47ff-af88-29dc0fb62ec5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38e2fdd8d5a245e6a760fb10f8b55989'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:03.450418 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-97cb5791-4a7e-47ff-af88-29dc0fb62ec5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38e2fdd8d5a245e6a760fb10f8b55989'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:03.479901 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb0a9a2-17a7-4e07-9d2e-ae5b4e2ef6d1 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:03.480411 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb0a9a2-17a7-4e07-9d2e-ae5b4e2ef6d1 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:03.480852 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb0a9a2-17a7-4e07-9d2e-ae5b4e2ef6d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:03.482911 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-97cb5791-4a7e-47ff-af88-29dc0fb62ec5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38e2fdd8d5a245e6a760fb10f8b55989'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:03.484712 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-97cb5791-4a7e-47ff-af88-29dc0fb62ec5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38e2fdd8d5a245e6a760fb10f8b55989'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:03.541175 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-97cb5791-4a7e-47ff-af88-29dc0fb62ec5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38e2fdd8d5a245e6a760fb10f8b55989'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:03.584692 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-3eb0a9a2-17a7-4e07-9d2e-ae5b4e2ef6d1 None None] MFA Rules not processed for user `34b5671b702a4d369463b45fb5dbe07a`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:18:03.589144 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-3eb0a9a2-17a7-4e07-9d2e-ae5b4e2ef6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:03.599232 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 836/1710] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:18:03 2022] DELETE /identity/v3/users/38e2fdd8d5a245e6a760fb10f8b55989 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:18:03.601579 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702cc36-caf3-4875-84a9-1e6208ce1c3f None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:03.605811 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702cc36-caf3-4875-84a9-1e6208ce1c3f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:03.606653 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702cc36-caf3-4875-84a9-1e6208ce1c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:03.676293 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-6702cc36-caf3-4875-84a9-1e6208ce1c3f None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:18:03.680386 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6702cc36-caf3-4875-84a9-1e6208ce1c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:03.862578 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 875/1711] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:18:03 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:18:03.878038 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb0a9a2-17a7-4e07-9d2e-ae5b4e2ef6d1 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:03.880109 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-3eb0a9a2-17a7-4e07-9d2e-ae5b4e2ef6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:03.981489 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 837/1712] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:18:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:18:03.995171 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6702cc36-caf3-4875-84a9-1e6208ce1c3f None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:03.997832 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6702cc36-caf3-4875-84a9-1e6208ce1c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:04.059478 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:04.151563 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb0a9a2-17a7-4e07-9d2e-ae5b4e2ef6d1 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:04.164583 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b6b91d-e02c-409a-b1c9-b26639e86985 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3b6e252a8c434a99432bcece6493b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:04.165267 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6b91d-e02c-409a-b1c9-b26639e86985 service nova] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:04.165552 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6b91d-e02c-409a-b1c9-b26639e86985 service nova] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:04.165835 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6b91d-e02c-409a-b1c9-b26639e86985 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:04.205232 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6702cc36-caf3-4875-84a9-1e6208ce1c3f None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:04.207307 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b6b91d-e02c-409a-b1c9-b26639e86985 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:04.209037 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b6b91d-e02c-409a-b1c9-b26639e86985 service nova] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:04.223073 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452b8e95-f6f7-4330-a3d2-72c1c0492b36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:04.224112 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452b8e95-f6f7-4330-a3d2-72c1c0492b36 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:04.224883 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452b8e95-f6f7-4330-a3d2-72c1c0492b36 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:04.225370 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452b8e95-f6f7-4330-a3d2-72c1c0492b36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:04.258852 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 876/1713] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:18:03 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:18:04.264745 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452b8e95-f6f7-4330-a3d2-72c1c0492b36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:04.272340 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452b8e95-f6f7-4330-a3d2-72c1c0492b36 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:04.313768 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 838/1714] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:18:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:18:04.432127 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b6b91d-e02c-409a-b1c9-b26639e86985 service nova] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:04.433520 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-19b6b91d-e02c-409a-b1c9-b26639e86985 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:04.458219 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b6b91d-e02c-409a-b1c9-b26639e86985 service nova] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:04.472085 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383fdb94-b44e-4497-a95f-a9f91e649dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:04.474794 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383fdb94-b44e-4497-a95f-a9f91e649dfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:04.475097 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383fdb94-b44e-4497-a95f-a9f91e649dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:04.475376 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383fdb94-b44e-4497-a95f-a9f91e649dfe admin admin] PATH_INFO: `/v3/users/f8a3049071c04a9b939d7fc00ce86554` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:04.477647 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383fdb94-b44e-4497-a95f-a9f91e649dfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8a3049071c04a9b939d7fc00ce86554)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:04.481049 dv-cinder-844563-4-smb devstack@keystone.service[80182]: WARNING py.warnings [None req-383fdb94-b44e-4497-a95f-a9f91e649dfe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 04 09:18:04.481049 dv-cinder-844563-4-smb devstack@keystone.service[80182]: warnings.warn(msg) Jul 04 09:18:04.481049 dv-cinder-844563-4-smb devstack@keystone.service[80182]: Jul 04 09:18:04.484926 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383fdb94-b44e-4497-a95f-a9f91e649dfe admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:04.533741 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:04.630155 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-383fdb94-b44e-4497-a95f-a9f91e649dfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8a3049071c04a9b939d7fc00ce86554'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:04.639578 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-383fdb94-b44e-4497-a95f-a9f91e649dfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8a3049071c04a9b939d7fc00ce86554'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:04.640503 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-383fdb94-b44e-4497-a95f-a9f91e649dfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8a3049071c04a9b939d7fc00ce86554'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:04.641474 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-383fdb94-b44e-4497-a95f-a9f91e649dfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8a3049071c04a9b939d7fc00ce86554'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:04.694601 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-383fdb94-b44e-4497-a95f-a9f91e649dfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8a3049071c04a9b939d7fc00ce86554'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:04.726272 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 877/1715] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:18:04 2022] DELETE /identity/v3/users/f8a3049071c04a9b939d7fc00ce86554 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:18:04.730574 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce46552-9a4e-4a6f-b7b2-6545ca6052db None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:04.731056 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce46552-9a4e-4a6f-b7b2-6545ca6052db None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:04.731484 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce46552-9a4e-4a6f-b7b2-6545ca6052db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:04.768011 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-2ce46552-9a4e-4a6f-b7b2-6545ca6052db None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:18:04.769555 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-2ce46552-9a4e-4a6f-b7b2-6545ca6052db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:04.865378 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 839/1716] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:18:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:18:04.879702 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383fdb94-b44e-4497-a95f-a9f91e649dfe admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:04.897782 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-383fdb94-b44e-4497-a95f-a9f91e649dfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:04.973413 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383fdb94-b44e-4497-a95f-a9f91e649dfe admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:04.977798 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd0bd39-d411-404b-99e1-9ee62f7862da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:04.978478 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd0bd39-d411-404b-99e1-9ee62f7862da service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:04.978955 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd0bd39-d411-404b-99e1-9ee62f7862da service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:04.979481 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd0bd39-d411-404b-99e1-9ee62f7862da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:04.990149 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd0bd39-d411-404b-99e1-9ee62f7862da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:04.992779 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd0bd39-d411-404b-99e1-9ee62f7862da service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:05.005566 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 878/1717] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:18:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:18:05.154447 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f4123-1d0c-488a-aaa7-d836e3c022af None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:05.155456 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f4123-1d0c-488a-aaa7-d836e3c022af None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:05.156022 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f4123-1d0c-488a-aaa7-d836e3c022af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:05.202771 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd0bd39-d411-404b-99e1-9ee62f7862da service neutron] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:05.204709 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-3fd0bd39-d411-404b-99e1-9ee62f7862da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:05.230490 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-c69f4123-1d0c-488a-aaa7-d836e3c022af None None] MFA Rules not processed for user `defd27b64b204349a191a7b50b2d4cc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:18:05.238759 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c69f4123-1d0c-488a-aaa7-d836e3c022af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:05.245120 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd0bd39-d411-404b-99e1-9ee62f7862da service neutron] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:05.269053 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192aa3a2-c76f-408f-abf0-bc4afde23d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:05.275448 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192aa3a2-c76f-408f-abf0-bc4afde23d10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:05.276133 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192aa3a2-c76f-408f-abf0-bc4afde23d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:05.277104 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192aa3a2-c76f-408f-abf0-bc4afde23d10 admin admin] PATH_INFO: `/v3/projects/1a1c59efb64243ecb5594134104c12ae` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:05.284807 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192aa3a2-c76f-408f-abf0-bc4afde23d10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a1c59efb64243ecb5594134104c12ae)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:05.293061 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192aa3a2-c76f-408f-abf0-bc4afde23d10 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:05.456921 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-192aa3a2-c76f-408f-abf0-bc4afde23d10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a1c59efb64243ecb5594134104c12ae', 'request_id': 'req-192aa3a2-c76f-408f-abf0-bc4afde23d10'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:05.507668 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-192aa3a2-c76f-408f-abf0-bc4afde23d10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a1c59efb64243ecb5594134104c12ae', 'request_id': 'req-192aa3a2-c76f-408f-abf0-bc4afde23d10'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:05.528209 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-192aa3a2-c76f-408f-abf0-bc4afde23d10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a1c59efb64243ecb5594134104c12ae', 'request_id': 'req-192aa3a2-c76f-408f-abf0-bc4afde23d10'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:05.537482 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 840/1718] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:18:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:18:05.569115 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-192aa3a2-c76f-408f-abf0-bc4afde23d10 admin admin] The token cache is being invalidate because project 1a1c59efb64243ecb5594134104c12ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:18:05.569427 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-192aa3a2-c76f-408f-abf0-bc4afde23d10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:05.572772 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-192aa3a2-c76f-408f-abf0-bc4afde23d10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:05.577365 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 879/1719] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:18:05 2022] DELETE /identity/v3/projects/1a1c59efb64243ecb5594134104c12ae => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:18:05.581646 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69f4123-1d0c-488a-aaa7-d836e3c022af None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:05.619138 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69f4123-1d0c-488a-aaa7-d836e3c022af None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:05.820167 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8656c0e5-2840-496e-9ddb-52fd24eac6d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:05.821084 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8656c0e5-2840-496e-9ddb-52fd24eac6d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:05.821369 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8656c0e5-2840-496e-9ddb-52fd24eac6d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:05.821640 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8656c0e5-2840-496e-9ddb-52fd24eac6d6 admin admin] PATH_INFO: `/v3/users/d6b3255e75de4a64886cc5ed2da0bd3e` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:05.826769 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8656c0e5-2840-496e-9ddb-52fd24eac6d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6b3255e75de4a64886cc5ed2da0bd3e)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:05.828878 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8656c0e5-2840-496e-9ddb-52fd24eac6d6 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:05.845965 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:05.991973 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8656c0e5-2840-496e-9ddb-52fd24eac6d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6b3255e75de4a64886cc5ed2da0bd3e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:05.996324 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8656c0e5-2840-496e-9ddb-52fd24eac6d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6b3255e75de4a64886cc5ed2da0bd3e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:06.024412 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8656c0e5-2840-496e-9ddb-52fd24eac6d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6b3255e75de4a64886cc5ed2da0bd3e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:06.026554 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8656c0e5-2840-496e-9ddb-52fd24eac6d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6b3255e75de4a64886cc5ed2da0bd3e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:06.065526 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8656c0e5-2840-496e-9ddb-52fd24eac6d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6b3255e75de4a64886cc5ed2da0bd3e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:06.113905 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 841/1720] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:18:05 2022] DELETE /identity/v3/users/d6b3255e75de4a64886cc5ed2da0bd3e => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:18:06.241280 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da8f856-a372-4104-bcbe-1cc2592ff8b4 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:06.241821 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da8f856-a372-4104-bcbe-1cc2592ff8b4 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:06.242000 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da8f856-a372-4104-bcbe-1cc2592ff8b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:06.275069 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-6da8f856-a372-4104-bcbe-1cc2592ff8b4 None None] MFA Rules not processed for user `bd758d5b21684027b0d199021df0ad2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:18:06.276696 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-6da8f856-a372-4104-bcbe-1cc2592ff8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:06.316677 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:06.434948 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 880/1721] 10.222.0.42 () {58 vars in 1009 bytes} [Mon Jul 4 09:18:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:18:06.745879 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8656c0e5-2840-496e-9ddb-52fd24eac6d6 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:06.747304 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-8656c0e5-2840-496e-9ddb-52fd24eac6d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:06.954100 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8656c0e5-2840-496e-9ddb-52fd24eac6d6 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:06.967424 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f664a3c0-c4da-494a-a82f-a404e0263abf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59d8698c45fb46259765eb3c8de2297f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:06.968304 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664a3c0-c4da-494a-a82f-a404e0263abf service swift] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:06.968598 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664a3c0-c4da-494a-a82f-a404e0263abf service swift] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:06.968862 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664a3c0-c4da-494a-a82f-a404e0263abf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:06.981358 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f664a3c0-c4da-494a-a82f-a404e0263abf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:06.983421 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f664a3c0-c4da-494a-a82f-a404e0263abf service swift] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:07.001852 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 842/1722] 10.222.0.42 () {60 vars in 1384 bytes} [Mon Jul 4 09:18:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 04 09:18:07.797824 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da8f856-a372-4104-bcbe-1cc2592ff8b4 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:07.799577 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-6da8f856-a372-4104-bcbe-1cc2592ff8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:08.117900 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da8f856-a372-4104-bcbe-1cc2592ff8b4 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:08.137632 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae7028c-a992-4019-97ed-f24fc823eabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:08.141495 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae7028c-a992-4019-97ed-f24fc823eabf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:08.144211 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae7028c-a992-4019-97ed-f24fc823eabf admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:08.145466 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae7028c-a992-4019-97ed-f24fc823eabf admin admin] PATH_INFO: `/v3/projects/b4fe1def05a5402e9d15cd5167e0d26a` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:08.149618 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae7028c-a992-4019-97ed-f24fc823eabf admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4fe1def05a5402e9d15cd5167e0d26a)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:08.159480 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae7028c-a992-4019-97ed-f24fc823eabf admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:08.343505 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-fae7028c-a992-4019-97ed-f24fc823eabf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4fe1def05a5402e9d15cd5167e0d26a', 'request_id': 'req-fae7028c-a992-4019-97ed-f24fc823eabf'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:08.370411 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-fae7028c-a992-4019-97ed-f24fc823eabf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4fe1def05a5402e9d15cd5167e0d26a', 'request_id': 'req-fae7028c-a992-4019-97ed-f24fc823eabf'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:08.391173 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-fae7028c-a992-4019-97ed-f24fc823eabf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4fe1def05a5402e9d15cd5167e0d26a', 'request_id': 'req-fae7028c-a992-4019-97ed-f24fc823eabf'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:08.443334 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-fae7028c-a992-4019-97ed-f24fc823eabf admin admin] The token cache is being invalidate because project b4fe1def05a5402e9d15cd5167e0d26a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:18:08.444574 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-fae7028c-a992-4019-97ed-f24fc823eabf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:08.447462 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-fae7028c-a992-4019-97ed-f24fc823eabf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:08.455306 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 881/1723] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:18:07 2022] DELETE /identity/v3/projects/b4fe1def05a5402e9d15cd5167e0d26a => generated 0 bytes in 658 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:18:08.459217 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f664a3c0-c4da-494a-a82f-a404e0263abf service swift] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:08.481553 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f664a3c0-c4da-494a-a82f-a404e0263abf service swift] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:08.731555 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e96be5-2eb7-482f-8554-9aee1be0ea84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:08.732900 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e96be5-2eb7-482f-8554-9aee1be0ea84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:08.733593 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e96be5-2eb7-482f-8554-9aee1be0ea84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:08.734058 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e96be5-2eb7-482f-8554-9aee1be0ea84 admin admin] PATH_INFO: `/v3/users/18498384857b46779778772fbe823725` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:08.735628 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e96be5-2eb7-482f-8554-9aee1be0ea84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18498384857b46779778772fbe823725)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:08.738572 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e96be5-2eb7-482f-8554-9aee1be0ea84 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:08.797547 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:08.915122 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-65e96be5-2eb7-482f-8554-9aee1be0ea84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18498384857b46779778772fbe823725'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:08.919723 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-65e96be5-2eb7-482f-8554-9aee1be0ea84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18498384857b46779778772fbe823725'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:08.946979 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-65e96be5-2eb7-482f-8554-9aee1be0ea84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18498384857b46779778772fbe823725'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:08.947701 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-65e96be5-2eb7-482f-8554-9aee1be0ea84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18498384857b46779778772fbe823725'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:08.976676 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-65e96be5-2eb7-482f-8554-9aee1be0ea84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18498384857b46779778772fbe823725'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:09.076722 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 843/1724] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:18:08 2022] DELETE /identity/v3/users/18498384857b46779778772fbe823725 => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:18:10.207402 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e0738-3b08-460b-a765-e570ec8a9b40 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:10.208053 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e0738-3b08-460b-a765-e570ec8a9b40 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:10.208329 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e0738-3b08-460b-a765-e570ec8a9b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:10.292649 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-433e0738-3b08-460b-a765-e570ec8a9b40 None None] MFA Rules not processed for user `4db0575f076240559f64e9548b56ffeb`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:18:10.299775 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-433e0738-3b08-460b-a765-e570ec8a9b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:10.505351 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 882/1725] 10.222.0.70 () {58 vars in 1015 bytes} [Mon Jul 4 09:18:10 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:18:10.557515 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e96be5-2eb7-482f-8554-9aee1be0ea84 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:10.560748 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-65e96be5-2eb7-482f-8554-9aee1be0ea84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:10.589101 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e96be5-2eb7-482f-8554-9aee1be0ea84 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:10.605045 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53df749-c410-4fc3-9567-5a0b6b257a4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:10.611610 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53df749-c410-4fc3-9567-5a0b6b257a4e service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:10.612092 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53df749-c410-4fc3-9567-5a0b6b257a4e service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:10.612598 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53df749-c410-4fc3-9567-5a0b6b257a4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:10.652643 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53df749-c410-4fc3-9567-5a0b6b257a4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:10.655169 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53df749-c410-4fc3-9567-5a0b6b257a4e service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:10.691278 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433e0738-3b08-460b-a765-e570ec8a9b40 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:10.693430 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-433e0738-3b08-460b-a765-e570ec8a9b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:10.696677 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 844/1726] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:18:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:18:10.711002 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:10.958433 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433e0738-3b08-460b-a765-e570ec8a9b40 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:10.975643 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1b039c-c92d-4cc0-af35-3ef555582cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:10.977543 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1b039c-c92d-4cc0-af35-3ef555582cd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:10.978598 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1b039c-c92d-4cc0-af35-3ef555582cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:10.980290 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1b039c-c92d-4cc0-af35-3ef555582cd2 admin admin] PATH_INFO: `/v3/projects/37496e4374c54249ae89bb18478071ad` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:10.984737 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1b039c-c92d-4cc0-af35-3ef555582cd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37496e4374c54249ae89bb18478071ad)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:10.991255 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1b039c-c92d-4cc0-af35-3ef555582cd2 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:11.157552 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-0c1b039c-c92d-4cc0-af35-3ef555582cd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37496e4374c54249ae89bb18478071ad', 'request_id': 'req-0c1b039c-c92d-4cc0-af35-3ef555582cd2'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:11.173095 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-0c1b039c-c92d-4cc0-af35-3ef555582cd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37496e4374c54249ae89bb18478071ad', 'request_id': 'req-0c1b039c-c92d-4cc0-af35-3ef555582cd2'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:11.190925 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-0c1b039c-c92d-4cc0-af35-3ef555582cd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37496e4374c54249ae89bb18478071ad', 'request_id': 'req-0c1b039c-c92d-4cc0-af35-3ef555582cd2'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:11.228529 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-0c1b039c-c92d-4cc0-af35-3ef555582cd2 admin admin] The token cache is being invalidate because project 37496e4374c54249ae89bb18478071ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:18:11.229360 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-0c1b039c-c92d-4cc0-af35-3ef555582cd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:11.230632 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-0c1b039c-c92d-4cc0-af35-3ef555582cd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:11.239989 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 883/1727] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:18:10 2022] DELETE /identity/v3/projects/37496e4374c54249ae89bb18478071ad => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:18:11.240531 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c99b4-c64b-4682-a646-86bad7093b15 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:11.240921 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c99b4-c64b-4682-a646-86bad7093b15 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:11.241492 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c99b4-c64b-4682-a646-86bad7093b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:11.273029 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-ca0c99b4-c64b-4682-a646-86bad7093b15 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:18:11.274175 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ca0c99b4-c64b-4682-a646-86bad7093b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:11.517459 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 845/1728] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:18:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:18:11.528851 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8258e-78e8-4561-a6c1-a3d8e17645a0 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:11.529424 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8258e-78e8-4561-a6c1-a3d8e17645a0 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:11.530620 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8258e-78e8-4561-a6c1-a3d8e17645a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:11.603919 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-ade8258e-78e8-4561-a6c1-a3d8e17645a0 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:18:11.605225 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-ade8258e-78e8-4561-a6c1-a3d8e17645a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:11.658639 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 884/1729] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:18:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:18:11.660538 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0c99b4-c64b-4682-a646-86bad7093b15 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:11.675390 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0c99b4-c64b-4682-a646-86bad7093b15 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:11.719941 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade8258e-78e8-4561-a6c1-a3d8e17645a0 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:11.721351 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-ade8258e-78e8-4561-a6c1-a3d8e17645a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:11.739666 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d4907-ace1-41fc-9991-1f0db7db910f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:11.744601 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d4907-ace1-41fc-9991-1f0db7db910f admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:11.744894 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d4907-ace1-41fc-9991-1f0db7db910f admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:11.745171 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d4907-ace1-41fc-9991-1f0db7db910f admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:11.745942 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073d4907-ace1-41fc-9991-1f0db7db910f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:18:11.746251 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073d4907-ace1-41fc-9991-1f0db7db910f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:11.759415 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073d4907-ace1-41fc-9991-1f0db7db910f admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:11.762565 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade8258e-78e8-4561-a6c1-a3d8e17645a0 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:11.782974 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c88514d-1f0a-4a72-a818-12ff23db5a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:11.786618 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88514d-1f0a-4a72-a818-12ff23db5a1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:11.793995 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88514d-1f0a-4a72-a818-12ff23db5a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:11.795889 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88514d-1f0a-4a72-a818-12ff23db5a1a admin admin] PATH_INFO: `/v3/projects/1bba3cef7c6249c387da1192b92c8623` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:11.803213 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c88514d-1f0a-4a72-a818-12ff23db5a1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bba3cef7c6249c387da1192b92c8623)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:11.812348 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c88514d-1f0a-4a72-a818-12ff23db5a1a admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:11.816174 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 846/1730] 10.222.0.42 () {58 vars in 1152 bytes} [Mon Jul 4 09:18:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:18:11.820787 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d4907-ace1-41fc-9991-1f0db7db910f admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:11.883614 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d4907-ace1-41fc-9991-1f0db7db910f admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:11.904549 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12488b1c-a2fa-47f3-b185-ffc6c29ad8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:11.905470 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12488b1c-a2fa-47f3-b185-ffc6c29ad8c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:11.909305 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12488b1c-a2fa-47f3-b185-ffc6c29ad8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:11.909650 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12488b1c-a2fa-47f3-b185-ffc6c29ad8c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:11.911700 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12488b1c-a2fa-47f3-b185-ffc6c29ad8c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:11.916508 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12488b1c-a2fa-47f3-b185-ffc6c29ad8c3 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:11.934957 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-1c88514d-1f0a-4a72-a818-12ff23db5a1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bba3cef7c6249c387da1192b92c8623', 'request_id': 'req-1c88514d-1f0a-4a72-a818-12ff23db5a1a'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:11.947236 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-1c88514d-1f0a-4a72-a818-12ff23db5a1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bba3cef7c6249c387da1192b92c8623', 'request_id': 'req-1c88514d-1f0a-4a72-a818-12ff23db5a1a'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:11.969800 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-1c88514d-1f0a-4a72-a818-12ff23db5a1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bba3cef7c6249c387da1192b92c8623', 'request_id': 'req-1c88514d-1f0a-4a72-a818-12ff23db5a1a'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:11.980568 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 847/1731] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:18:11 2022] POST /identity/v3/projects => generated 385 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:18:11.981956 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12488b1c-a2fa-47f3-b185-ffc6c29ad8c3 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:11.986288 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-12488b1c-a2fa-47f3-b185-ffc6c29ad8c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:11.997311 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-1c88514d-1f0a-4a72-a818-12ff23db5a1a admin admin] The token cache is being invalidate because project 1bba3cef7c6249c387da1192b92c8623 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:18:11.997630 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-1c88514d-1f0a-4a72-a818-12ff23db5a1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:12.000340 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-1c88514d-1f0a-4a72-a818-12ff23db5a1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:12.011011 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 885/1732] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:18:11 2022] DELETE /identity/v3/projects/1bba3cef7c6249c387da1192b92c8623 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:18:12.011995 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c88514d-1f0a-4a72-a818-12ff23db5a1a admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:12.013613 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-1c88514d-1f0a-4a72-a818-12ff23db5a1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:12.060706 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:12.111071 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:12.166584 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12488b1c-a2fa-47f3-b185-ffc6c29ad8c3 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:12.189616 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e010c48-a159-4d32-9097-7887ff7e5768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:12.190596 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e010c48-a159-4d32-9097-7887ff7e5768 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:12.192938 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e010c48-a159-4d32-9097-7887ff7e5768 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:12.194107 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e010c48-a159-4d32-9097-7887ff7e5768 admin admin] PATH_INFO: `/v3/users/130fe9afc5dd4ec58781dea48600633e` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:12.201090 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e010c48-a159-4d32-9097-7887ff7e5768 admin admin] RBAC: Authorizing `identity:delete_user(user_id=130fe9afc5dd4ec58781dea48600633e)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:12.209292 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e010c48-a159-4d32-9097-7887ff7e5768 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:12.262427 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c88514d-1f0a-4a72-a818-12ff23db5a1a admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:12.278004 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad398483-803a-4b7f-80e5-08f8c29e5cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:12.278999 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad398483-803a-4b7f-80e5-08f8c29e5cae admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:12.279327 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad398483-803a-4b7f-80e5-08f8c29e5cae admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:12.279563 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad398483-803a-4b7f-80e5-08f8c29e5cae admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:12.280311 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad398483-803a-4b7f-80e5-08f8c29e5cae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:12.282281 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad398483-803a-4b7f-80e5-08f8c29e5cae admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:12.329642 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 886/1733] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:18:12 2022] POST /identity/v3/users => generated 293 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:18:12.340803 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38783a1c-ae60-4e82-bee7-c4ce7d5932eb None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:12.341103 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38783a1c-ae60-4e82-bee7-c4ce7d5932eb None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:12.341499 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38783a1c-ae60-4e82-bee7-c4ce7d5932eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:12.409367 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3e010c48-a159-4d32-9097-7887ff7e5768 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '130fe9afc5dd4ec58781dea48600633e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:12.412171 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3e010c48-a159-4d32-9097-7887ff7e5768 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '130fe9afc5dd4ec58781dea48600633e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:12.433303 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3e010c48-a159-4d32-9097-7887ff7e5768 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '130fe9afc5dd4ec58781dea48600633e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:12.434358 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3e010c48-a159-4d32-9097-7887ff7e5768 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '130fe9afc5dd4ec58781dea48600633e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:12.508725 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3e010c48-a159-4d32-9097-7887ff7e5768 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '130fe9afc5dd4ec58781dea48600633e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:12.539975 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 848/1734] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:18:11 2022] DELETE /identity/v3/users/130fe9afc5dd4ec58781dea48600633e => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:18:12.542771 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e010c48-a159-4d32-9097-7887ff7e5768 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:12.545319 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3e010c48-a159-4d32-9097-7887ff7e5768 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:12.683347 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-38783a1c-ae60-4e82-bee7-c4ce7d5932eb None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:18:12.687185 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-38783a1c-ae60-4e82-bee7-c4ce7d5932eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:12.706462 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e010c48-a159-4d32-9097-7887ff7e5768 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:12.716470 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 887/1735] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:18:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 386 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:18:12.718472 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e77c1f-3f94-4a2a-92d4-71813aca5956 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:12.719033 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e77c1f-3f94-4a2a-92d4-71813aca5956 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:12.720689 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e77c1f-3f94-4a2a-92d4-71813aca5956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:12.720816 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55928e9-d207-4d8d-9d92-441434a14a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:12.721523 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55928e9-d207-4d8d-9d92-441434a14a52 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:12.721876 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55928e9-d207-4d8d-9d92-441434a14a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:12.722629 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55928e9-d207-4d8d-9d92-441434a14a52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:12.723461 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55928e9-d207-4d8d-9d92-441434a14a52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:12.725657 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55928e9-d207-4d8d-9d92-441434a14a52 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:12.753343 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 849/1736] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:18:12 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:18:12.755078 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec404bb-940e-4984-9d31-afef26f20e89 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:12.755436 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec404bb-940e-4984-9d31-afef26f20e89 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:12.755792 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec404bb-940e-4984-9d31-afef26f20e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:12.759563 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-70e77c1f-3f94-4a2a-92d4-71813aca5956 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:18:12.761064 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-70e77c1f-3f94-4a2a-92d4-71813aca5956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:12.783994 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 888/1737] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:18:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:18:12.786588 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e77c1f-3f94-4a2a-92d4-71813aca5956 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:12.799154 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-3ec404bb-940e-4984-9d31-afef26f20e89 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:18:12.800565 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3ec404bb-940e-4984-9d31-afef26f20e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:12.822815 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 850/1738] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:18:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:18:12.824666 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec404bb-940e-4984-9d31-afef26f20e89 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:12.832848 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e77c1f-3f94-4a2a-92d4-71813aca5956 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:12.844837 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad0d394-abc1-4d6c-a326-9560e6036e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:12.845744 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad0d394-abc1-4d6c-a326-9560e6036e7b admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:12.846201 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad0d394-abc1-4d6c-a326-9560e6036e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:12.846636 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad0d394-abc1-4d6c-a326-9560e6036e7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:12.847485 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec404bb-940e-4984-9d31-afef26f20e89 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:12.849059 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad0d394-abc1-4d6c-a326-9560e6036e7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:12.860354 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad0d394-abc1-4d6c-a326-9560e6036e7b admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:12.864775 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff936ae-fd14-46dc-afbf-cf2fdce2e26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:12.868899 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff936ae-fd14-46dc-afbf-cf2fdce2e26e admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:12.870318 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff936ae-fd14-46dc-afbf-cf2fdce2e26e admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:12.870605 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff936ae-fd14-46dc-afbf-cf2fdce2e26e admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:12.871423 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff936ae-fd14-46dc-afbf-cf2fdce2e26e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:18:12.871737 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff936ae-fd14-46dc-afbf-cf2fdce2e26e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:12.873472 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff936ae-fd14-46dc-afbf-cf2fdce2e26e admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:12.898089 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 889/1739] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:18:12 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:18:12.902323 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad0d394-abc1-4d6c-a326-9560e6036e7b admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:12.921482 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-0ad0d394-abc1-4d6c-a326-9560e6036e7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:12.936676 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 851/1740] 10.222.0.42 () {58 vars in 1152 bytes} [Mon Jul 4 09:18:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:18:12.936676 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff936ae-fd14-46dc-afbf-cf2fdce2e26e admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:12.956594 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff936ae-fd14-46dc-afbf-cf2fdce2e26e admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:12.965768 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca466b3b-3e9e-4d3b-a879-76c9a0b2e29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:12.967611 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca466b3b-3e9e-4d3b-a879-76c9a0b2e29f admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:12.969095 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca466b3b-3e9e-4d3b-a879-76c9a0b2e29f admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:12.971783 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca466b3b-3e9e-4d3b-a879-76c9a0b2e29f admin admin] PATH_INFO: `/v3/projects/cbc7258dc7964cd7acdb179a83a91be0/users/610966111b1f4588b08376f052bcc43d/roles/81634e7812344f84afcb29b0dba2687c` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:13.037103 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca466b3b-3e9e-4d3b-a879-76c9a0b2e29f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbc7258dc7964cd7acdb179a83a91be0, user_id=610966111b1f4588b08376f052bcc43d, role_id=81634e7812344f84afcb29b0dba2687c)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:13.042766 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca466b3b-3e9e-4d3b-a879-76c9a0b2e29f admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:13.050295 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad0d394-abc1-4d6c-a326-9560e6036e7b admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:13.072618 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 852/1741] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:18:12 2022] PUT /identity/v3/projects/cbc7258dc7964cd7acdb179a83a91be0/users/610966111b1f4588b08376f052bcc43d/roles/81634e7812344f84afcb29b0dba2687c => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:18:13.073900 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca466b3b-3e9e-4d3b-a879-76c9a0b2e29f admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:13.143378 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:13.186405 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee89927-8d27-495f-9b1b-eab0109baf2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:13.187216 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee89927-8d27-495f-9b1b-eab0109baf2b service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:13.188003 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee89927-8d27-495f-9b1b-eab0109baf2b service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:13.188343 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee89927-8d27-495f-9b1b-eab0109baf2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:13.277636 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca466b3b-3e9e-4d3b-a879-76c9a0b2e29f admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:13.281643 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:13.313226 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee89927-8d27-495f-9b1b-eab0109baf2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:13.314794 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee89927-8d27-495f-9b1b-eab0109baf2b service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:13.317366 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032f183e-33fd-463c-9e73-20d72862f4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:13.318099 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f183e-33fd-463c-9e73-20d72862f4c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:13.321847 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f183e-33fd-463c-9e73-20d72862f4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:13.322016 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f183e-33fd-463c-9e73-20d72862f4c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:13.322745 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032f183e-33fd-463c-9e73-20d72862f4c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:13.334688 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032f183e-33fd-463c-9e73-20d72862f4c0 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:13.356593 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 890/1742] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:18:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:18:13.358337 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4396f6dc-27d8-444d-abf6-4061c62a98d2 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:13.358836 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4396f6dc-27d8-444d-abf6-4061c62a98d2 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:13.359570 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4396f6dc-27d8-444d-abf6-4061c62a98d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:13.409577 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-4396f6dc-27d8-444d-abf6-4061c62a98d2 None None] MFA Rules not processed for user `610966111b1f4588b08376f052bcc43d`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:18:13.411195 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-4396f6dc-27d8-444d-abf6-4061c62a98d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:13.418404 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 853/1743] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:18:13 2022] POST /identity/v3/projects => generated 379 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:18:13.425567 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032f183e-33fd-463c-9e73-20d72862f4c0 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:13.628877 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 891/1744] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:18:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:18:13.632024 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bfce29-4c55-4cb0-9fb6-9bfad8684745 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:13.633425 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bfce29-4c55-4cb0-9fb6-9bfad8684745 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:13.636907 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bfce29-4c55-4cb0-9fb6-9bfad8684745 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:13.638845 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 892/1745] 10.222.0.42 () {54 vars in 921 bytes} [Mon Jul 4 09:18:13 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:18:13.639691 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bfce29-4c55-4cb0-9fb6-9bfad8684745 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:13.642806 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032f183e-33fd-463c-9e73-20d72862f4c0 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:13.658454 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1db0538-2ae7-4f70-9f4e-031430fe0043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:13.659258 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db0538-2ae7-4f70-9f4e-031430fe0043 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:13.661040 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db0538-2ae7-4f70-9f4e-031430fe0043 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:13.661803 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db0538-2ae7-4f70-9f4e-031430fe0043 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:13.663749 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1db0538-2ae7-4f70-9f4e-031430fe0043 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:13.668423 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1db0538-2ae7-4f70-9f4e-031430fe0043 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:13.669388 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bfce29-4c55-4cb0-9fb6-9bfad8684745 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:13.685561 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fadd67e-f8a3-487b-9479-b76c1da89e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:13.686329 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fadd67e-f8a3-487b-9479-b76c1da89e86 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:13.686692 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fadd67e-f8a3-487b-9479-b76c1da89e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:13.687159 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fadd67e-f8a3-487b-9479-b76c1da89e86 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:13.687993 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fadd67e-f8a3-487b-9479-b76c1da89e86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:13.692434 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fadd67e-f8a3-487b-9479-b76c1da89e86 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:13.711476 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 854/1746] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:18:13 2022] POST /identity/v3/users => generated 290 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:18:13.715347 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1db0538-2ae7-4f70-9f4e-031430fe0043 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:13.739583 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1db0538-2ae7-4f70-9f4e-031430fe0043 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:13.761991 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a8f46-85d7-4131-9793-f3ba3e2e509b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:13.763766 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a8f46-85d7-4131-9793-f3ba3e2e509b admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:13.765517 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a8f46-85d7-4131-9793-f3ba3e2e509b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:13.766010 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a8f46-85d7-4131-9793-f3ba3e2e509b admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:13.767326 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4a8f46-85d7-4131-9793-f3ba3e2e509b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:13.769194 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 893/1747] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:18:13 2022] POST /identity/v3/projects => generated 387 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:18:13.773225 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fadd67e-f8a3-487b-9479-b76c1da89e86 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:13.776174 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4a8f46-85d7-4131-9793-f3ba3e2e509b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:13.808562 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 855/1748] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:18:13 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:18:13.809850 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a8f46-85d7-4131-9793-f3ba3e2e509b admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:13.855431 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a8f46-85d7-4131-9793-f3ba3e2e509b admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:13.870923 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fadd67e-f8a3-487b-9479-b76c1da89e86 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:13.874711 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf655a3-6bae-41a7-8eac-fac3dd0cd368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:13.876626 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888c34ee-0348-40e5-9ace-849a015a83d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:13.877593 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c34ee-0348-40e5-9ace-849a015a83d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:13.877912 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf655a3-6bae-41a7-8eac-fac3dd0cd368 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:13.878738 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c34ee-0348-40e5-9ace-849a015a83d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:13.879178 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c34ee-0348-40e5-9ace-849a015a83d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:13.880094 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888c34ee-0348-40e5-9ace-849a015a83d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:13.882193 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888c34ee-0348-40e5-9ace-849a015a83d5 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:13.885889 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf655a3-6bae-41a7-8eac-fac3dd0cd368 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:13.899795 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf655a3-6bae-41a7-8eac-fac3dd0cd368 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:13.902715 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf655a3-6bae-41a7-8eac-fac3dd0cd368 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:13.912120 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf655a3-6bae-41a7-8eac-fac3dd0cd368 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:13.915015 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 894/1749] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:18:13 2022] POST /identity/v3/users => generated 300 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:18:13.916715 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b43e1-f221-4672-8ba2-80707613336a None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:13.917193 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b43e1-f221-4672-8ba2-80707613336a None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:13.917605 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b43e1-f221-4672-8ba2-80707613336a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:13.959203 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-248b43e1-f221-4672-8ba2-80707613336a None None] MFA Rules not processed for user `af3b6e252a8c434a99432bcece6493b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:18:13.960839 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-248b43e1-f221-4672-8ba2-80707613336a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:13.965510 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 856/1750] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:18:13 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:18:13.966219 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf655a3-6bae-41a7-8eac-fac3dd0cd368 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:14.011319 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf655a3-6bae-41a7-8eac-fac3dd0cd368 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:14.023183 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec58120-e43f-4733-be6c-1b6f26966daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:14.024086 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec58120-e43f-4733-be6c-1b6f26966daa admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:14.024553 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec58120-e43f-4733-be6c-1b6f26966daa admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:14.024960 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec58120-e43f-4733-be6c-1b6f26966daa admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:14.025864 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec58120-e43f-4733-be6c-1b6f26966daa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:14.027684 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec58120-e43f-4733-be6c-1b6f26966daa admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:14.034970 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:14.057902 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 857/1751] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:18:13 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:18:14.057902 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5315a-20b1-4683-a663-5c9a5230f1d9 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:14.057902 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5315a-20b1-4683-a663-5c9a5230f1d9 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:14.059557 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5315a-20b1-4683-a663-5c9a5230f1d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:14.153293 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-7fa5315a-20b1-4683-a663-5c9a5230f1d9 None None] MFA Rules not processed for user `6d13b840941349d78da243f9b4c2c72e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:18:14.157996 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-7fa5315a-20b1-4683-a663-5c9a5230f1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:14.170441 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 895/1752] 10.222.0.42 () {58 vars in 1018 bytes} [Mon Jul 4 09:18:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:18:14.171531 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248b43e1-f221-4672-8ba2-80707613336a None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:14.197115 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248b43e1-f221-4672-8ba2-80707613336a None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:14.215702 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b15e2c-7558-4751-aa6f-ee8ce1e9cddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:14.216914 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b15e2c-7558-4751-aa6f-ee8ce1e9cddd admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:14.217198 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b15e2c-7558-4751-aa6f-ee8ce1e9cddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:14.217473 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b15e2c-7558-4751-aa6f-ee8ce1e9cddd admin admin] PATH_INFO: `/v3/projects/4a0d73caf6014d839eaaf57622192fe4/users/ed2b998d699142b29c54a73307c937ba/roles/81634e7812344f84afcb29b0dba2687c` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:14.254313 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b15e2c-7558-4751-aa6f-ee8ce1e9cddd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a0d73caf6014d839eaaf57622192fe4, user_id=ed2b998d699142b29c54a73307c937ba, role_id=81634e7812344f84afcb29b0dba2687c)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:14.260043 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b15e2c-7558-4751-aa6f-ee8ce1e9cddd admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:14.319525 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 896/1753] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:18:14 2022] PUT /identity/v3/projects/4a0d73caf6014d839eaaf57622192fe4/users/ed2b998d699142b29c54a73307c937ba/roles/81634e7812344f84afcb29b0dba2687c => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:18:14.319525 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b15e2c-7558-4751-aa6f-ee8ce1e9cddd admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:14.353790 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 858/1754] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:18:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:18:14.356129 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a6cad-f09f-4cf2-b3e8-61f1fe3fff6d None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:14.356710 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a6cad-f09f-4cf2-b3e8-61f1fe3fff6d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:14.357244 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a6cad-f09f-4cf2-b3e8-61f1fe3fff6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:14.373132 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:14.400417 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-a23a6cad-f09f-4cf2-b3e8-61f1fe3fff6d None None] MFA Rules not processed for user `34b5671b702a4d369463b45fb5dbe07a`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:18:14.402239 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a23a6cad-f09f-4cf2-b3e8-61f1fe3fff6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:14.563108 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 859/1755] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:18:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:18:14.565493 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ece06c-4003-461e-b385-139cbdceb40e None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:14.565898 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ece06c-4003-461e-b385-139cbdceb40e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:14.566297 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ece06c-4003-461e-b385-139cbdceb40e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:14.575244 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b15e2c-7558-4751-aa6f-ee8ce1e9cddd admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:14.586759 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c80bf0-38e2-4df5-ac02-6e6274144cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:14.587943 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c80bf0-38e2-4df5-ac02-6e6274144cb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:14.588358 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c80bf0-38e2-4df5-ac02-6e6274144cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:14.588814 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c80bf0-38e2-4df5-ac02-6e6274144cb3 admin admin] PATH_INFO: `/v3/projects/55d5b6c503e34e838efa92776faaac7f/users/f80c4706272c4f78ad01cc7036117cd0/roles/965049e7ce6144aaad23c15f3a5e37c3` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:14.613258 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-d9ece06c-4003-461e-b385-139cbdceb40e None None] MFA Rules not processed for user `ed2b998d699142b29c54a73307c937ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:18:14.614827 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d9ece06c-4003-461e-b385-139cbdceb40e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:14.626162 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c80bf0-38e2-4df5-ac02-6e6274144cb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55d5b6c503e34e838efa92776faaac7f, user_id=f80c4706272c4f78ad01cc7036117cd0, role_id=965049e7ce6144aaad23c15f3a5e37c3)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:14.629948 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c80bf0-38e2-4df5-ac02-6e6274144cb3 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:14.677027 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 897/1756] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:18:14 2022] PUT /identity/v3/projects/55d5b6c503e34e838efa92776faaac7f/users/f80c4706272c4f78ad01cc7036117cd0/roles/965049e7ce6144aaad23c15f3a5e37c3 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:18:14.683680 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c80bf0-38e2-4df5-ac02-6e6274144cb3 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:14.809357 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 860/1757] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:18:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:18:14.814231 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ece06c-4003-461e-b385-139cbdceb40e None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:14.843174 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ece06c-4003-461e-b385-139cbdceb40e None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:14.925449 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c80bf0-38e2-4df5-ac02-6e6274144cb3 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:14.953636 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba977451-8dae-49c6-b9e1-29cf9a16a797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:14.954339 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba977451-8dae-49c6-b9e1-29cf9a16a797 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:14.954622 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba977451-8dae-49c6-b9e1-29cf9a16a797 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:14.954900 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba977451-8dae-49c6-b9e1-29cf9a16a797 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:14.955644 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba977451-8dae-49c6-b9e1-29cf9a16a797 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:14.957307 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba977451-8dae-49c6-b9e1-29cf9a16a797 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:14.999521 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 898/1758] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:18:14 2022] GET /identity/v3/roles => generated 1420 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:18:15.004249 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba977451-8dae-49c6-b9e1-29cf9a16a797 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:15.034823 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cc7e87-865d-494b-9c6d-9033431798f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:15.038011 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc7e87-865d-494b-9c6d-9033431798f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:15.038317 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc7e87-865d-494b-9c6d-9033431798f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:15.039694 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc7e87-865d-494b-9c6d-9033431798f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:15.041202 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cc7e87-865d-494b-9c6d-9033431798f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:15.042560 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba977451-8dae-49c6-b9e1-29cf9a16a797 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:15.048694 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cc7e87-865d-494b-9c6d-9033431798f6 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:15.055886 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ad31fe-47c3-4033-b910-968fe55788c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:15.056597 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad31fe-47c3-4033-b910-968fe55788c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:15.056873 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad31fe-47c3-4033-b910-968fe55788c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:15.057477 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad31fe-47c3-4033-b910-968fe55788c3 admin admin] PATH_INFO: `/v3/projects/55d5b6c503e34e838efa92776faaac7f/users/f80c4706272c4f78ad01cc7036117cd0/roles/965049e7ce6144aaad23c15f3a5e37c3` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:15.075884 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ad31fe-47c3-4033-b910-968fe55788c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55d5b6c503e34e838efa92776faaac7f, user_id=f80c4706272c4f78ad01cc7036117cd0, role_id=965049e7ce6144aaad23c15f3a5e37c3)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:15.078897 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ad31fe-47c3-4033-b910-968fe55788c3 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:15.124608 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 861/1759] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:18:14 2022] POST /identity/v3/projects => generated 377 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:18:15.126753 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 899/1760] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:18:15 2022] PUT /identity/v3/projects/55d5b6c503e34e838efa92776faaac7f/users/f80c4706272c4f78ad01cc7036117cd0/roles/965049e7ce6144aaad23c15f3a5e37c3 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:18:15.128598 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cc7e87-865d-494b-9c6d-9033431798f6 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:15.140481 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7765f7ac-c06f-4791-8e18-f0dc676d13d5 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:15.140811 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7765f7ac-c06f-4791-8e18-f0dc676d13d5 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:15.141098 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7765f7ac-c06f-4791-8e18-f0dc676d13d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:15.205887 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:15.212520 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:15.242511 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-7765f7ac-c06f-4791-8e18-f0dc676d13d5 None None] MFA Rules not processed for user `f80c4706272c4f78ad01cc7036117cd0`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:18:15.244576 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-7765f7ac-c06f-4791-8e18-f0dc676d13d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:15.252191 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cc7e87-865d-494b-9c6d-9033431798f6 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:15.260791 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc59b26-9d1f-42a1-8c1e-11b455a1145d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:15.261000 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc59b26-9d1f-42a1-8c1e-11b455a1145d admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:15.261218 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc59b26-9d1f-42a1-8c1e-11b455a1145d admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:15.261495 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc59b26-9d1f-42a1-8c1e-11b455a1145d admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:15.262206 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc59b26-9d1f-42a1-8c1e-11b455a1145d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:15.269317 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc59b26-9d1f-42a1-8c1e-11b455a1145d admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:15.319212 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 862/1761] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:18:15 2022] POST /identity/v3/users => generated 295 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:18:15.320816 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc59b26-9d1f-42a1-8c1e-11b455a1145d admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:15.345854 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc59b26-9d1f-42a1-8c1e-11b455a1145d admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:15.358865 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b01a55-5106-4d19-bee8-da88bfaefa5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:15.360490 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b01a55-5106-4d19-bee8-da88bfaefa5a admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:15.361395 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b01a55-5106-4d19-bee8-da88bfaefa5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:15.362764 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b01a55-5106-4d19-bee8-da88bfaefa5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:15.364243 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b01a55-5106-4d19-bee8-da88bfaefa5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:15.367375 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b01a55-5106-4d19-bee8-da88bfaefa5a admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:15.397178 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 900/1762] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:18:15 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:18:15.406113 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 863/1763] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:18:15 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:18:15.409854 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b01a55-5106-4d19-bee8-da88bfaefa5a admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:15.412852 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7765f7ac-c06f-4791-8e18-f0dc676d13d5 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:15.414249 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f5b01a55-5106-4d19-bee8-da88bfaefa5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:15.440270 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7765f7ac-c06f-4791-8e18-f0dc676d13d5 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:15.460744 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860ef600-3640-4590-9aa3-7abf28fd24f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:15.461884 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ef600-3640-4590-9aa3-7abf28fd24f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:15.462304 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ef600-3640-4590-9aa3-7abf28fd24f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:15.462713 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ef600-3640-4590-9aa3-7abf28fd24f4 admin admin] PATH_INFO: `/v3/projects/1aea59da375c48faa904c1bf15d5749f/users/80e1a5d4999e483d886e2f1a9eaeeb7e/roles/965049e7ce6144aaad23c15f3a5e37c3` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:15.495502 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860ef600-3640-4590-9aa3-7abf28fd24f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1aea59da375c48faa904c1bf15d5749f, user_id=80e1a5d4999e483d886e2f1a9eaeeb7e, role_id=965049e7ce6144aaad23c15f3a5e37c3)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:15.503842 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860ef600-3640-4590-9aa3-7abf28fd24f4 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:15.525442 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b01a55-5106-4d19-bee8-da88bfaefa5a admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:15.537590 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 901/1764] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:18:15 2022] PUT /identity/v3/projects/1aea59da375c48faa904c1bf15d5749f/users/80e1a5d4999e483d886e2f1a9eaeeb7e/roles/965049e7ce6144aaad23c15f3a5e37c3 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:18:15.539890 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860ef600-3640-4590-9aa3-7abf28fd24f4 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:15.617118 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296c296a-4b1a-4b27-b262-e417d8af4abe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f86373d65440da97c853fff3c1d0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:15.618666 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c296a-4b1a-4b27-b262-e417d8af4abe service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:15.618955 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c296a-4b1a-4b27-b262-e417d8af4abe service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:15.620565 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c296a-4b1a-4b27-b262-e417d8af4abe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:15.705149 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860ef600-3640-4590-9aa3-7abf28fd24f4 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:15.725184 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a2d11-cf7d-4a11-bf84-e5df1999bc00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:15.725959 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a2d11-cf7d-4a11-bf84-e5df1999bc00 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:15.726244 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a2d11-cf7d-4a11-bf84-e5df1999bc00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:15.726523 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a2d11-cf7d-4a11-bf84-e5df1999bc00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:15.727291 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838a2d11-cf7d-4a11-bf84-e5df1999bc00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:15.729193 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838a2d11-cf7d-4a11-bf84-e5df1999bc00 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:15.749613 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 902/1765] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:18:15 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:18:15.750739 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a2d11-cf7d-4a11-bf84-e5df1999bc00 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:15.778513 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a2d11-cf7d-4a11-bf84-e5df1999bc00 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:15.783058 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296c296a-4b1a-4b27-b262-e417d8af4abe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:15.784674 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296c296a-4b1a-4b27-b262-e417d8af4abe service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:15.789589 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b90f896-4d93-4a97-abfb-bac2ae1aa5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:15.790587 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b90f896-4d93-4a97-abfb-bac2ae1aa5e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:15.790890 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b90f896-4d93-4a97-abfb-bac2ae1aa5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:15.791327 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b90f896-4d93-4a97-abfb-bac2ae1aa5e2 admin admin] PATH_INFO: `/v3/projects/1aea59da375c48faa904c1bf15d5749f/users/80e1a5d4999e483d886e2f1a9eaeeb7e/roles/965049e7ce6144aaad23c15f3a5e37c3` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:15.794582 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b90f896-4d93-4a97-abfb-bac2ae1aa5e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1aea59da375c48faa904c1bf15d5749f, user_id=80e1a5d4999e483d886e2f1a9eaeeb7e, role_id=965049e7ce6144aaad23c15f3a5e37c3)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:15.797806 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b90f896-4d93-4a97-abfb-bac2ae1aa5e2 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:15.826219 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 903/1766] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:18:15 2022] PUT /identity/v3/projects/1aea59da375c48faa904c1bf15d5749f/users/80e1a5d4999e483d886e2f1a9eaeeb7e/roles/965049e7ce6144aaad23c15f3a5e37c3 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:18:15.827863 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce462ff-a59d-43c0-a253-cc753cf21257 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:15.828179 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce462ff-a59d-43c0-a253-cc753cf21257 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:15.828512 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce462ff-a59d-43c0-a253-cc753cf21257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:15.829469 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 864/1767] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:18:15 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:18:15.900129 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-6ce462ff-a59d-43c0-a253-cc753cf21257 None None] MFA Rules not processed for user `80e1a5d4999e483d886e2f1a9eaeeb7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:18:15.902001 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-6ce462ff-a59d-43c0-a253-cc753cf21257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:16.050991 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296c296a-4b1a-4b27-b262-e417d8af4abe service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:16.065872 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296c296a-4b1a-4b27-b262-e417d8af4abe service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:16.072985 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:16.074665 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:16.149337 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 904/1768] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:18:15 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:18:16.156845 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079ad3f7-c4f6-4bd0-8964-fae1d71211e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:16.157924 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ad3f7-c4f6-4bd0-8964-fae1d71211e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:16.158220 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ad3f7-c4f6-4bd0-8964-fae1d71211e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:16.158536 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ad3f7-c4f6-4bd0-8964-fae1d71211e4 admin admin] PATH_INFO: `/v3/users/610966111b1f4588b08376f052bcc43d` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:16.160163 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079ad3f7-c4f6-4bd0-8964-fae1d71211e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=610966111b1f4588b08376f052bcc43d)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:16.162974 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079ad3f7-c4f6-4bd0-8964-fae1d71211e4 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:16.163119 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce462ff-a59d-43c0-a253-cc753cf21257 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:16.232157 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-079ad3f7-c4f6-4bd0-8964-fae1d71211e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '610966111b1f4588b08376f052bcc43d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:16.233243 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-079ad3f7-c4f6-4bd0-8964-fae1d71211e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '610966111b1f4588b08376f052bcc43d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:16.245047 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-079ad3f7-c4f6-4bd0-8964-fae1d71211e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '610966111b1f4588b08376f052bcc43d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:16.245960 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-079ad3f7-c4f6-4bd0-8964-fae1d71211e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '610966111b1f4588b08376f052bcc43d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:16.265282 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-079ad3f7-c4f6-4bd0-8964-fae1d71211e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '610966111b1f4588b08376f052bcc43d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:16.290208 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 865/1769] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:18:16 2022] DELETE /identity/v3/users/610966111b1f4588b08376f052bcc43d => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:18:16.292703 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52731e51-a582-4125-b0f6-8bf815bc38e6 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:16.292825 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52731e51-a582-4125-b0f6-8bf815bc38e6 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:16.294876 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52731e51-a582-4125-b0f6-8bf815bc38e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:16.300331 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce462ff-a59d-43c0-a253-cc753cf21257 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:16.342110 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-52731e51-a582-4125-b0f6-8bf815bc38e6 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:18:16.343847 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-52731e51-a582-4125-b0f6-8bf815bc38e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:16.463522 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 866/1770] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:18:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:18:16.480460 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5312c824-bfb2-485d-ab7b-8ea6215ee4d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f86373d65440da97c853fff3c1d0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:16.481207 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312c824-bfb2-485d-ab7b-8ea6215ee4d3 service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:16.481544 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312c824-bfb2-485d-ab7b-8ea6215ee4d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:16.482107 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312c824-bfb2-485d-ab7b-8ea6215ee4d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:16.484171 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-5312c824-bfb2-485d-ab7b-8ea6215ee4d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:16.525179 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52731e51-a582-4125-b0f6-8bf815bc38e6 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:16.527079 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-52731e51-a582-4125-b0f6-8bf815bc38e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:16.630339 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:16.644874 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5312c824-bfb2-485d-ab7b-8ea6215ee4d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:16.646352 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5312c824-bfb2-485d-ab7b-8ea6215ee4d3 service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:16.671853 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 905/1771] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:18:16 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:18:16.709824 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52731e51-a582-4125-b0f6-8bf815bc38e6 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:16.720690 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812cd8cd-8cd8-42c1-abc5-ffe3d36180f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:16.721541 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812cd8cd-8cd8-42c1-abc5-ffe3d36180f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:16.721929 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812cd8cd-8cd8-42c1-abc5-ffe3d36180f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:16.722303 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812cd8cd-8cd8-42c1-abc5-ffe3d36180f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:16.746085 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812cd8cd-8cd8-42c1-abc5-ffe3d36180f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:16.747320 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812cd8cd-8cd8-42c1-abc5-ffe3d36180f3 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:16.780134 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 867/1772] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:18:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 09:18:17.729998 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5312c824-bfb2-485d-ab7b-8ea6215ee4d3 service cinder] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:17.731741 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-5312c824-bfb2-485d-ab7b-8ea6215ee4d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:17.760520 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5312c824-bfb2-485d-ab7b-8ea6215ee4d3 service cinder] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:17.778413 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb6a83d-a57f-4199-b9dd-400a7f247597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:17.779471 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb6a83d-a57f-4199-b9dd-400a7f247597 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:17.779758 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb6a83d-a57f-4199-b9dd-400a7f247597 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:17.780060 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb6a83d-a57f-4199-b9dd-400a7f247597 admin admin] PATH_INFO: `/v3/projects/5c23df1cac534a149bcc008464e66cea` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:17.781388 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb6a83d-a57f-4199-b9dd-400a7f247597 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c23df1cac534a149bcc008464e66cea)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:17.784047 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb6a83d-a57f-4199-b9dd-400a7f247597 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:17.942365 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-fbb6a83d-a57f-4199-b9dd-400a7f247597 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c23df1cac534a149bcc008464e66cea', 'request_id': 'req-fbb6a83d-a57f-4199-b9dd-400a7f247597'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:17.947505 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:17.988500 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-fbb6a83d-a57f-4199-b9dd-400a7f247597 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c23df1cac534a149bcc008464e66cea', 'request_id': 'req-fbb6a83d-a57f-4199-b9dd-400a7f247597'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:18.005418 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-fbb6a83d-a57f-4199-b9dd-400a7f247597 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c23df1cac534a149bcc008464e66cea', 'request_id': 'req-fbb6a83d-a57f-4199-b9dd-400a7f247597'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:18.018026 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-fbb6a83d-a57f-4199-b9dd-400a7f247597 admin admin] The token cache is being invalidate because project 5c23df1cac534a149bcc008464e66cea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:18:18.018318 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-fbb6a83d-a57f-4199-b9dd-400a7f247597 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:18.025592 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-fbb6a83d-a57f-4199-b9dd-400a7f247597 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:18.030533 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 906/1773] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:18:17 2022] DELETE /identity/v3/projects/5c23df1cac534a149bcc008464e66cea => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:18:18.031817 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812cd8cd-8cd8-42c1-abc5-ffe3d36180f3 service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:18.043488 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812cd8cd-8cd8-42c1-abc5-ffe3d36180f3 service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:18.253281 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd9d8b-a7d4-47b3-889d-66315d7cc8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:18.258056 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd9d8b-a7d4-47b3-889d-66315d7cc8a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:18.259068 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd9d8b-a7d4-47b3-889d-66315d7cc8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:18.259364 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd9d8b-a7d4-47b3-889d-66315d7cc8a0 admin admin] PATH_INFO: `/v3/users/04ecd6c70d834e1bb1a6cf9d9c700c96` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:18.263079 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfd9d8b-a7d4-47b3-889d-66315d7cc8a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04ecd6c70d834e1bb1a6cf9d9c700c96)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:18.267606 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfd9d8b-a7d4-47b3-889d-66315d7cc8a0 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:18.372681 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb6a83d-a57f-4199-b9dd-400a7f247597 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:18.374211 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-fbb6a83d-a57f-4199-b9dd-400a7f247597 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:18.429488 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-cbfd9d8b-a7d4-47b3-889d-66315d7cc8a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04ecd6c70d834e1bb1a6cf9d9c700c96'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:18.432482 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-cbfd9d8b-a7d4-47b3-889d-66315d7cc8a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04ecd6c70d834e1bb1a6cf9d9c700c96'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:18.461232 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-cbfd9d8b-a7d4-47b3-889d-66315d7cc8a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04ecd6c70d834e1bb1a6cf9d9c700c96'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:18.463209 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-cbfd9d8b-a7d4-47b3-889d-66315d7cc8a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04ecd6c70d834e1bb1a6cf9d9c700c96'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:18.482460 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-cbfd9d8b-a7d4-47b3-889d-66315d7cc8a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04ecd6c70d834e1bb1a6cf9d9c700c96'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:18.517522 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 868/1774] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:18:18 2022] DELETE /identity/v3/users/04ecd6c70d834e1bb1a6cf9d9c700c96 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:18:18.518160 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd9d8b-a7d4-47b3-889d-66315d7cc8a0 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:18.519830 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-cbfd9d8b-a7d4-47b3-889d-66315d7cc8a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:18.557223 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb6a83d-a57f-4199-b9dd-400a7f247597 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:18.711098 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8926a64b-c2c2-44ac-bd01-f697725392ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3b6e252a8c434a99432bcece6493b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:18.712932 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926a64b-c2c2-44ac-bd01-f697725392ce service nova] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:18.713287 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926a64b-c2c2-44ac-bd01-f697725392ce service nova] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:18.713503 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926a64b-c2c2-44ac-bd01-f697725392ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:18.718736 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-8926a64b-c2c2-44ac-bd01-f697725392ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:18.769315 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8926a64b-c2c2-44ac-bd01-f697725392ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:18.778163 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8926a64b-c2c2-44ac-bd01-f697725392ce service nova] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:18.825157 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd9d8b-a7d4-47b3-889d-66315d7cc8a0 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:18.830066 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 907/1775] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:18:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:18:18.831313 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8926a64b-c2c2-44ac-bd01-f697725392ce service nova] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:18.836806 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507794ff-f8d5-4c40-a3b2-77a2f9384cf3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f86373d65440da97c853fff3c1d0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:18.837363 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-8926a64b-c2c2-44ac-bd01-f697725392ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:18.837527 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507794ff-f8d5-4c40-a3b2-77a2f9384cf3 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:18.837861 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507794ff-f8d5-4c40-a3b2-77a2f9384cf3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:18.838134 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507794ff-f8d5-4c40-a3b2-77a2f9384cf3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:18.847264 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-507794ff-f8d5-4c40-a3b2-77a2f9384cf3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:18.854503 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:19.062331 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507794ff-f8d5-4c40-a3b2-77a2f9384cf3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:19.065231 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507794ff-f8d5-4c40-a3b2-77a2f9384cf3 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:19.088909 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:19.102912 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8926a64b-c2c2-44ac-bd01-f697725392ce service nova] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:19.132066 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 869/1776] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:18:18 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 615 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:18:19.145515 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d6432f-1a59-4261-af5b-50b66e7c3ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:19.146511 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6432f-1a59-4261-af5b-50b66e7c3ced admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:19.148172 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6432f-1a59-4261-af5b-50b66e7c3ced admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:19.148590 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6432f-1a59-4261-af5b-50b66e7c3ced admin admin] PATH_INFO: `/v3/projects/cbc7258dc7964cd7acdb179a83a91be0` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:19.156928 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d6432f-1a59-4261-af5b-50b66e7c3ced admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbc7258dc7964cd7acdb179a83a91be0)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:19.158746 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d6432f-1a59-4261-af5b-50b66e7c3ced admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:19.432696 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-26d6432f-1a59-4261-af5b-50b66e7c3ced admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbc7258dc7964cd7acdb179a83a91be0', 'request_id': 'req-26d6432f-1a59-4261-af5b-50b66e7c3ced'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:19.452786 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-26d6432f-1a59-4261-af5b-50b66e7c3ced admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbc7258dc7964cd7acdb179a83a91be0', 'request_id': 'req-26d6432f-1a59-4261-af5b-50b66e7c3ced'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:19.470453 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-26d6432f-1a59-4261-af5b-50b66e7c3ced admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbc7258dc7964cd7acdb179a83a91be0', 'request_id': 'req-26d6432f-1a59-4261-af5b-50b66e7c3ced'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:19.501506 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-26d6432f-1a59-4261-af5b-50b66e7c3ced admin admin] The token cache is being invalidate because project cbc7258dc7964cd7acdb179a83a91be0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:18:19.502369 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-26d6432f-1a59-4261-af5b-50b66e7c3ced admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:19.505195 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-26d6432f-1a59-4261-af5b-50b66e7c3ced admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:19.515907 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 908/1777] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:18:18 2022] DELETE /identity/v3/projects/cbc7258dc7964cd7acdb179a83a91be0 => generated 0 bytes in 681 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:18:19.519650 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507794ff-f8d5-4c40-a3b2-77a2f9384cf3 service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:19.558857 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507794ff-f8d5-4c40-a3b2-77a2f9384cf3 service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:19.739308 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666f5973-718d-4c16-92d4-ad3991f2006f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:19.740924 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f5973-718d-4c16-92d4-ad3991f2006f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:19.743703 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f5973-718d-4c16-92d4-ad3991f2006f admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:19.744037 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f5973-718d-4c16-92d4-ad3991f2006f admin admin] PATH_INFO: `/v3/users/f80c4706272c4f78ad01cc7036117cd0` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:19.748029 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666f5973-718d-4c16-92d4-ad3991f2006f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f80c4706272c4f78ad01cc7036117cd0)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:19.753527 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666f5973-718d-4c16-92d4-ad3991f2006f admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:19.885848 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-666f5973-718d-4c16-92d4-ad3991f2006f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f80c4706272c4f78ad01cc7036117cd0'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:19.886550 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-666f5973-718d-4c16-92d4-ad3991f2006f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f80c4706272c4f78ad01cc7036117cd0'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:19.898141 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-666f5973-718d-4c16-92d4-ad3991f2006f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f80c4706272c4f78ad01cc7036117cd0'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:19.899044 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-666f5973-718d-4c16-92d4-ad3991f2006f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f80c4706272c4f78ad01cc7036117cd0'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:19.921212 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-666f5973-718d-4c16-92d4-ad3991f2006f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f80c4706272c4f78ad01cc7036117cd0'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:19.954998 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 870/1778] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:18:19 2022] DELETE /identity/v3/users/f80c4706272c4f78ad01cc7036117cd0 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:18:21.263958 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ad4ff-e628-487b-83dc-582dfbfcdc85 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:21.264622 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ad4ff-e628-487b-83dc-582dfbfcdc85 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:21.264622 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ad4ff-e628-487b-83dc-582dfbfcdc85 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:21.266077 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 909/1779] 10.222.0.42 () {54 vars in 921 bytes} [Mon Jul 4 09:18:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:18:21.502203 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe704a-5d15-4a5f-b727-99e05d4efbea None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:21.503584 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe704a-5d15-4a5f-b727-99e05d4efbea None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:21.504059 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe704a-5d15-4a5f-b727-99e05d4efbea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:21.545645 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-fbfe704a-5d15-4a5f-b727-99e05d4efbea None None] MFA Rules not processed for user `af3b6e252a8c434a99432bcece6493b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:18:21.547383 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-fbfe704a-5d15-4a5f-b727-99e05d4efbea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:21.583307 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:21.683459 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 871/1780] 10.222.0.42 () {58 vars in 1018 bytes} [Mon Jul 4 09:18:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:18:21.982696 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733ad4ff-e628-487b-83dc-582dfbfcdc85 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:21.984649 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-733ad4ff-e628-487b-83dc-582dfbfcdc85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:22.127809 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733ad4ff-e628-487b-83dc-582dfbfcdc85 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:22.134954 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bdee18-681a-4ffd-8718-7d6bd5a91ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:22.136169 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bdee18-681a-4ffd-8718-7d6bd5a91ca3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:22.136718 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bdee18-681a-4ffd-8718-7d6bd5a91ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:22.137261 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bdee18-681a-4ffd-8718-7d6bd5a91ca3 admin admin] PATH_INFO: `/v3/projects/9b9354af17d74b919319d9e3f3c84c71` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:22.138711 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bdee18-681a-4ffd-8718-7d6bd5a91ca3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b9354af17d74b919319d9e3f3c84c71)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:22.141084 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bdee18-681a-4ffd-8718-7d6bd5a91ca3 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:22.231045 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-74bdee18-681a-4ffd-8718-7d6bd5a91ca3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b9354af17d74b919319d9e3f3c84c71', 'request_id': 'req-74bdee18-681a-4ffd-8718-7d6bd5a91ca3'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:22.248499 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-74bdee18-681a-4ffd-8718-7d6bd5a91ca3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b9354af17d74b919319d9e3f3c84c71', 'request_id': 'req-74bdee18-681a-4ffd-8718-7d6bd5a91ca3'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:22.260155 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-74bdee18-681a-4ffd-8718-7d6bd5a91ca3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b9354af17d74b919319d9e3f3c84c71', 'request_id': 'req-74bdee18-681a-4ffd-8718-7d6bd5a91ca3'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:22.262075 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfe704a-5d15-4a5f-b727-99e05d4efbea None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:22.263907 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-fbfe704a-5d15-4a5f-b727-99e05d4efbea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:22.279309 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-74bdee18-681a-4ffd-8718-7d6bd5a91ca3 admin admin] The token cache is being invalidate because project 9b9354af17d74b919319d9e3f3c84c71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:18:22.280090 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-74bdee18-681a-4ffd-8718-7d6bd5a91ca3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:22.280552 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-74bdee18-681a-4ffd-8718-7d6bd5a91ca3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:22.281030 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfe704a-5d15-4a5f-b727-99e05d4efbea None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:22.286404 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 910/1781] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:18:21 2022] DELETE /identity/v3/projects/9b9354af17d74b919319d9e3f3c84c71 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:18:22.289159 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f673ab-b46b-4102-befb-2c6df7b7d4ad None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:22.289722 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f673ab-b46b-4102-befb-2c6df7b7d4ad None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:22.290138 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f673ab-b46b-4102-befb-2c6df7b7d4ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:22.320990 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-34f673ab-b46b-4102-befb-2c6df7b7d4ad None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:18:22.322695 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-34f673ab-b46b-4102-befb-2c6df7b7d4ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:22.340603 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:22.372687 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b517de-6e81-401b-9074-309e4765239c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3b6e252a8c434a99432bcece6493b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:22.373781 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b517de-6e81-401b-9074-309e4765239c service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:22.374249 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b517de-6e81-401b-9074-309e4765239c service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:22.374704 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b517de-6e81-401b-9074-309e4765239c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:22.377505 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c8b517de-6e81-401b-9074-309e4765239c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:22.397199 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b517de-6e81-401b-9074-309e4765239c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:22.399782 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b517de-6e81-401b-9074-309e4765239c service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:22.429422 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 872/1782] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:18:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 09:18:22.429422 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b517de-6e81-401b-9074-309e4765239c service nova] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:22.432251 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c8b517de-6e81-401b-9074-309e4765239c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:22.515572 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 911/1783] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:18:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:18:22.517210 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c47d1-324e-42e3-b3ee-d2491e844156 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:22.517509 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c47d1-324e-42e3-b3ee-d2491e844156 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:22.517795 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c47d1-324e-42e3-b3ee-d2491e844156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:22.560900 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-1e6c47d1-324e-42e3-b3ee-d2491e844156 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:18:22.562131 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-1e6c47d1-324e-42e3-b3ee-d2491e844156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:22.582529 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 912/1784] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:18:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:18:22.588951 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c47d1-324e-42e3-b3ee-d2491e844156 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:22.616169 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c47d1-324e-42e3-b3ee-d2491e844156 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:22.624090 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc1a66e-77ff-4d66-a745-a22a3bfb3860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:22.624852 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc1a66e-77ff-4d66-a745-a22a3bfb3860 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:22.625021 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b517de-6e81-401b-9074-309e4765239c service nova] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:22.625463 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc1a66e-77ff-4d66-a745-a22a3bfb3860 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:22.625463 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc1a66e-77ff-4d66-a745-a22a3bfb3860 admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:22.626135 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc1a66e-77ff-4d66-a745-a22a3bfb3860 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:18:22.626496 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc1a66e-77ff-4d66-a745-a22a3bfb3860 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:22.628238 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc1a66e-77ff-4d66-a745-a22a3bfb3860 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:22.654124 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0960fcd-b116-4f6b-a177-85f087c78b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:22.655193 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0960fcd-b116-4f6b-a177-85f087c78b6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:22.655504 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0960fcd-b116-4f6b-a177-85f087c78b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:22.655739 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0960fcd-b116-4f6b-a177-85f087c78b6f admin admin] PATH_INFO: `/v3/projects/55d5b6c503e34e838efa92776faaac7f` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:22.658508 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 913/1785] 10.222.0.42 () {58 vars in 1152 bytes} [Mon Jul 4 09:18:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:18:22.659418 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc1a66e-77ff-4d66-a745-a22a3bfb3860 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:22.659531 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0960fcd-b116-4f6b-a177-85f087c78b6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=55d5b6c503e34e838efa92776faaac7f)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:22.662293 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0960fcd-b116-4f6b-a177-85f087c78b6f admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:22.689622 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc1a66e-77ff-4d66-a745-a22a3bfb3860 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:22.703722 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6541152b-5713-4696-8d5c-90624f0bc41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:22.704637 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541152b-5713-4696-8d5c-90624f0bc41d admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:22.704936 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541152b-5713-4696-8d5c-90624f0bc41d admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:22.705384 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541152b-5713-4696-8d5c-90624f0bc41d admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:22.706101 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6541152b-5713-4696-8d5c-90624f0bc41d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:22.708070 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6541152b-5713-4696-8d5c-90624f0bc41d admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:22.773146 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:22.785513 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 914/1786] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:18:22 2022] POST /identity/v3/projects => generated 385 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:18:22.785807 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a0960fcd-b116-4f6b-a177-85f087c78b6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55d5b6c503e34e838efa92776faaac7f', 'request_id': 'req-a0960fcd-b116-4f6b-a177-85f087c78b6f'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:22.790008 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6541152b-5713-4696-8d5c-90624f0bc41d admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:22.810416 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a0960fcd-b116-4f6b-a177-85f087c78b6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55d5b6c503e34e838efa92776faaac7f', 'request_id': 'req-a0960fcd-b116-4f6b-a177-85f087c78b6f'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:22.852153 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a0960fcd-b116-4f6b-a177-85f087c78b6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55d5b6c503e34e838efa92776faaac7f', 'request_id': 'req-a0960fcd-b116-4f6b-a177-85f087c78b6f'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:22.879602 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a0960fcd-b116-4f6b-a177-85f087c78b6f admin admin] The token cache is being invalidate because project 55d5b6c503e34e838efa92776faaac7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:18:22.880194 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a0960fcd-b116-4f6b-a177-85f087c78b6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:22.881016 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a0960fcd-b116-4f6b-a177-85f087c78b6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:22.883145 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 873/1787] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:18:22 2022] DELETE /identity/v3/projects/55d5b6c503e34e838efa92776faaac7f => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:18:22.894977 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a6379-d438-4b70-b711-b7013fefa35c None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:22.895435 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a6379-d438-4b70-b711-b7013fefa35c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:22.895536 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a6379-d438-4b70-b711-b7013fefa35c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:22.947858 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6541152b-5713-4696-8d5c-90624f0bc41d admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:22.976934 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa6b938-a883-463a-888b-be4a9edfe61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:22.982497 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa6b938-a883-463a-888b-be4a9edfe61b admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:22.982856 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa6b938-a883-463a-888b-be4a9edfe61b admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:22.984184 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa6b938-a883-463a-888b-be4a9edfe61b admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:22.984985 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa6b938-a883-463a-888b-be4a9edfe61b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:22.990023 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa6b938-a883-463a-888b-be4a9edfe61b admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:23.008127 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-a38a6379-d438-4b70-b711-b7013fefa35c None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:18:23.009515 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a38a6379-d438-4b70-b711-b7013fefa35c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:23.057992 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 874/1788] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:18:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:18:23.064747 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15112f9-6111-4c38-8c4d-d77a5c948697 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:23.064747 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15112f9-6111-4c38-8c4d-d77a5c948697 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:23.064747 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15112f9-6111-4c38-8c4d-d77a5c948697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:23.065649 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 915/1789] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:18:22 2022] POST /identity/v3/users => generated 293 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:18:23.066882 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa6b938-a883-463a-888b-be4a9edfe61b admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:23.070255 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-8aa6b938-a883-463a-888b-be4a9edfe61b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:23.103752 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa6b938-a883-463a-888b-be4a9edfe61b admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:23.111234 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03eb522-93e9-4e1f-98d6-474e2d2a66e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:23.112199 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03eb522-93e9-4e1f-98d6-474e2d2a66e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:23.113518 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03eb522-93e9-4e1f-98d6-474e2d2a66e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:23.114001 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03eb522-93e9-4e1f-98d6-474e2d2a66e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:23.115920 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03eb522-93e9-4e1f-98d6-474e2d2a66e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:23.118348 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03eb522-93e9-4e1f-98d6-474e2d2a66e9 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:23.121443 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-a15112f9-6111-4c38-8c4d-d77a5c948697 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:18:23.123282 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a15112f9-6111-4c38-8c4d-d77a5c948697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:23.137006 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 916/1790] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:18:23 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:18:23.142403 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03eb522-93e9-4e1f-98d6-474e2d2a66e9 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:23.155116 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 875/1791] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:18:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:18:23.165939 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15112f9-6111-4c38-8c4d-d77a5c948697 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:23.167677 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03eb522-93e9-4e1f-98d6-474e2d2a66e9 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:23.191595 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e899d303-cbe8-4d99-b3df-b4c70426f92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:23.192278 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15112f9-6111-4c38-8c4d-d77a5c948697 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:23.192392 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899d303-cbe8-4d99-b3df-b4c70426f92f admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:23.192611 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899d303-cbe8-4d99-b3df-b4c70426f92f admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:23.192893 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899d303-cbe8-4d99-b3df-b4c70426f92f admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:23.194102 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e899d303-cbe8-4d99-b3df-b4c70426f92f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:23.196479 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e899d303-cbe8-4d99-b3df-b4c70426f92f admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:23.206473 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcab11a6-c2a2-4e3d-9fac-667b8de32b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:23.207442 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcab11a6-c2a2-4e3d-9fac-667b8de32b41 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:23.209060 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcab11a6-c2a2-4e3d-9fac-667b8de32b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:23.209482 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcab11a6-c2a2-4e3d-9fac-667b8de32b41 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:23.211113 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 917/1792] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:18:23 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:18:23.211983 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcab11a6-c2a2-4e3d-9fac-667b8de32b41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:18:23.215926 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e899d303-cbe8-4d99-b3df-b4c70426f92f admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:23.216555 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcab11a6-c2a2-4e3d-9fac-667b8de32b41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:23.218437 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcab11a6-c2a2-4e3d-9fac-667b8de32b41 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:23.245032 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 876/1793] 10.222.0.42 () {58 vars in 1152 bytes} [Mon Jul 4 09:18:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:18:23.247838 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e899d303-cbe8-4d99-b3df-b4c70426f92f admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:23.250267 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcab11a6-c2a2-4e3d-9fac-667b8de32b41 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:23.257389 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f118c509-119f-4231-a667-5e2e7c63b2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:23.258429 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118c509-119f-4231-a667-5e2e7c63b2e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:23.258781 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118c509-119f-4231-a667-5e2e7c63b2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:23.259109 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118c509-119f-4231-a667-5e2e7c63b2e1 admin admin] PATH_INFO: `/v3/projects/d169fe6ed8eb4c6a8b9525a0a74ed2f9/users/90d8b60d73544afc86dc7d2c798c7515/roles/81634e7812344f84afcb29b0dba2687c` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:23.272112 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcab11a6-c2a2-4e3d-9fac-667b8de32b41 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:23.279037 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb70097-c04f-4367-8e6e-4765c26e6704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:23.279701 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb70097-c04f-4367-8e6e-4765c26e6704 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:23.280028 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb70097-c04f-4367-8e6e-4765c26e6704 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:23.280301 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb70097-c04f-4367-8e6e-4765c26e6704 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:23.280991 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb70097-c04f-4367-8e6e-4765c26e6704 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:23.282927 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb70097-c04f-4367-8e6e-4765c26e6704 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:23.284482 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f118c509-119f-4231-a667-5e2e7c63b2e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d169fe6ed8eb4c6a8b9525a0a74ed2f9, user_id=90d8b60d73544afc86dc7d2c798c7515, role_id=81634e7812344f84afcb29b0dba2687c)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:23.288228 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f118c509-119f-4231-a667-5e2e7c63b2e1 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:23.316890 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 918/1794] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:18:23 2022] PUT /identity/v3/projects/d169fe6ed8eb4c6a8b9525a0a74ed2f9/users/90d8b60d73544afc86dc7d2c798c7515/roles/81634e7812344f84afcb29b0dba2687c => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:18:23.323948 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d47928d-80ac-41f4-9a57-dd59fea8756b None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:23.324938 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d47928d-80ac-41f4-9a57-dd59fea8756b None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:23.327275 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d47928d-80ac-41f4-9a57-dd59fea8756b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:23.331778 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 877/1795] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:18:23 2022] POST /identity/v3/projects => generated 387 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:18:23.335610 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb70097-c04f-4367-8e6e-4765c26e6704 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:23.370967 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-6d47928d-80ac-41f4-9a57-dd59fea8756b None None] MFA Rules not processed for user `90d8b60d73544afc86dc7d2c798c7515`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:18:23.372402 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-6d47928d-80ac-41f4-9a57-dd59fea8756b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:23.383092 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:23.438700 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb70097-c04f-4367-8e6e-4765c26e6704 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:23.461924 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80b7697-14de-42d4-bb49-c726df49853b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:23.462548 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b7697-14de-42d4-bb49-c726df49853b admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:23.462844 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b7697-14de-42d4-bb49-c726df49853b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:23.465597 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b7697-14de-42d4-bb49-c726df49853b admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:23.466415 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80b7697-14de-42d4-bb49-c726df49853b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:23.468452 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80b7697-14de-42d4-bb49-c726df49853b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:23.513528 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 878/1796] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:18:23 2022] POST /identity/v3/users => generated 294 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:18:23.518245 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 919/1797] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:18:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:18:23.518397 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80b7697-14de-42d4-bb49-c726df49853b admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:23.523136 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d47928d-80ac-41f4-9a57-dd59fea8756b None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:23.528791 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80b7697-14de-42d4-bb49-c726df49853b admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:23.537230 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b077895e-231c-4d89-b83e-95555cce75c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:23.538829 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b077895e-231c-4d89-b83e-95555cce75c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:23.539297 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b077895e-231c-4d89-b83e-95555cce75c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:23.539768 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b077895e-231c-4d89-b83e-95555cce75c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:23.540858 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b077895e-231c-4d89-b83e-95555cce75c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:23.543188 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b077895e-231c-4d89-b83e-95555cce75c3 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:23.545463 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d47928d-80ac-41f4-9a57-dd59fea8756b None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:23.562260 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d43b79-2922-4711-ac22-d0eabf29104e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:23.562492 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 879/1798] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:18:23 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:18:23.563652 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b077895e-231c-4d89-b83e-95555cce75c3 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:23.566053 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d43b79-2922-4711-ac22-d0eabf29104e admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:23.566336 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d43b79-2922-4711-ac22-d0eabf29104e admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:23.566616 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d43b79-2922-4711-ac22-d0eabf29104e admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:23.567326 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d43b79-2922-4711-ac22-d0eabf29104e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:23.569282 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d43b79-2922-4711-ac22-d0eabf29104e admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:23.578827 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b077895e-231c-4d89-b83e-95555cce75c3 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:23.587728 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a342db6e-7829-4aee-89a3-30adb96e34ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:23.588797 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a342db6e-7829-4aee-89a3-30adb96e34ec admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:23.590090 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a342db6e-7829-4aee-89a3-30adb96e34ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:23.590860 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a342db6e-7829-4aee-89a3-30adb96e34ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:23.594892 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a342db6e-7829-4aee-89a3-30adb96e34ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:23.595452 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a342db6e-7829-4aee-89a3-30adb96e34ec admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:23.608211 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 880/1799] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:18:23 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:18:23.612371 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a342db6e-7829-4aee-89a3-30adb96e34ec admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:23.627118 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a342db6e-7829-4aee-89a3-30adb96e34ec admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:23.632761 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 920/1800] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:18:23 2022] POST /identity/v3/projects => generated 387 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:18:23.637015 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d43b6ca-5119-4023-b35d-880312bf99cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:23.637321 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d43b79-2922-4711-ac22-d0eabf29104e admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:23.638701 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43b6ca-5119-4023-b35d-880312bf99cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:23.639151 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43b6ca-5119-4023-b35d-880312bf99cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:23.639637 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43b6ca-5119-4023-b35d-880312bf99cb admin admin] PATH_INFO: `/v3/projects/df5bcabde61f4cdeb95e3c68850b3692/users/bea7730d767049908e52819d625dff1b/roles/81634e7812344f84afcb29b0dba2687c` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:23.676295 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d43b6ca-5119-4023-b35d-880312bf99cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=df5bcabde61f4cdeb95e3c68850b3692, user_id=bea7730d767049908e52819d625dff1b, role_id=81634e7812344f84afcb29b0dba2687c)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:23.685000 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d43b6ca-5119-4023-b35d-880312bf99cb admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:23.721750 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 881/1801] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:18:23 2022] PUT /identity/v3/projects/df5bcabde61f4cdeb95e3c68850b3692/users/bea7730d767049908e52819d625dff1b/roles/81634e7812344f84afcb29b0dba2687c => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:18:23.732901 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b14723d-2f42-4a56-bd40-6575c53b86a5 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:23.733185 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b14723d-2f42-4a56-bd40-6575c53b86a5 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:23.734498 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b14723d-2f42-4a56-bd40-6575c53b86a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:23.774299 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d43b79-2922-4711-ac22-d0eabf29104e admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:23.789581 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-5b14723d-2f42-4a56-bd40-6575c53b86a5 None None] MFA Rules not processed for user `bea7730d767049908e52819d625dff1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:18:23.791025 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-5b14723d-2f42-4a56-bd40-6575c53b86a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:23.822394 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=90,keystone:DELETE=4,keystone:INSERT=6 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:23.863475 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c81e619-0ad8-4474-9a6c-42c0016c3399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:23.864566 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c81e619-0ad8-4474-9a6c-42c0016c3399 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:23.864948 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c81e619-0ad8-4474-9a6c-42c0016c3399 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:23.866433 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c81e619-0ad8-4474-9a6c-42c0016c3399 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:23.867184 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c81e619-0ad8-4474-9a6c-42c0016c3399 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:23.869380 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c81e619-0ad8-4474-9a6c-42c0016c3399 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:23.915596 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 921/1802] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:18:23 2022] POST /identity/v3/users => generated 300 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:18:23.916883 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c81e619-0ad8-4474-9a6c-42c0016c3399 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:23.920289 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-6c81e619-0ad8-4474-9a6c-42c0016c3399 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:23.922200 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 882/1803] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:18:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:18:23.923257 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b14723d-2f42-4a56-bd40-6575c53b86a5 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:23.935306 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c81e619-0ad8-4474-9a6c-42c0016c3399 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:23.935784 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b14723d-2f42-4a56-bd40-6575c53b86a5 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:23.941857 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7fa696-9a79-4e3e-a935-8b0e73531a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:23.942209 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e76bfd-c06d-4f49-a940-162baf3f2467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:23.942975 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e76bfd-c06d-4f49-a940-162baf3f2467 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:23.943345 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e76bfd-c06d-4f49-a940-162baf3f2467 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:23.943657 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7fa696-9a79-4e3e-a935-8b0e73531a21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:23.943764 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e76bfd-c06d-4f49-a940-162baf3f2467 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:23.944241 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7fa696-9a79-4e3e-a935-8b0e73531a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:23.944673 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e76bfd-c06d-4f49-a940-162baf3f2467 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:23.945098 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7fa696-9a79-4e3e-a935-8b0e73531a21 admin admin] PATH_INFO: `/v3/users/ed2b998d699142b29c54a73307c937ba` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:23.947050 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e76bfd-c06d-4f49-a940-162baf3f2467 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:23.947896 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7fa696-9a79-4e3e-a935-8b0e73531a21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed2b998d699142b29c54a73307c937ba)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:23.950583 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7fa696-9a79-4e3e-a935-8b0e73531a21 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:23.962400 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 883/1804] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:18:23 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:18:23.967272 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e76bfd-c06d-4f49-a940-162baf3f2467 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:23.979506 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e76bfd-c06d-4f49-a940-162baf3f2467 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:23.980671 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:23.990383 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32e402c-5cae-4255-9b4c-5a31656da77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:23.993313 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e402c-5cae-4255-9b4c-5a31656da77d admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:23.993911 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e402c-5cae-4255-9b4c-5a31656da77d admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:23.994528 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e402c-5cae-4255-9b4c-5a31656da77d admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:23.995829 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32e402c-5cae-4255-9b4c-5a31656da77d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:24.001343 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32e402c-5cae-4255-9b4c-5a31656da77d admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:24.019647 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-8f7fa696-9a79-4e3e-a935-8b0e73531a21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed2b998d699142b29c54a73307c937ba'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:24.032393 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-8f7fa696-9a79-4e3e-a935-8b0e73531a21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed2b998d699142b29c54a73307c937ba'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:24.033186 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-8f7fa696-9a79-4e3e-a935-8b0e73531a21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed2b998d699142b29c54a73307c937ba'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:24.033874 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-8f7fa696-9a79-4e3e-a935-8b0e73531a21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed2b998d699142b29c54a73307c937ba'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:24.047107 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 884/1805] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:18:23 2022] POST /identity/v3/projects => generated 387 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:18:24.050575 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32e402c-5cae-4255-9b4c-5a31656da77d admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:24.051759 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-8f7fa696-9a79-4e3e-a935-8b0e73531a21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed2b998d699142b29c54a73307c937ba'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:24.053928 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b32e402c-5cae-4255-9b4c-5a31656da77d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:24.069299 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 922/1806] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:18:23 2022] DELETE /identity/v3/users/ed2b998d699142b29c54a73307c937ba => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:18:24.070203 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7fa696-9a79-4e3e-a935-8b0e73531a21 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:24.071682 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-8f7fa696-9a79-4e3e-a935-8b0e73531a21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:24.151953 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7fa696-9a79-4e3e-a935-8b0e73531a21 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:24.157334 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8bb7a6-89e7-4c8c-b261-03adde4c697f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:24.158096 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8bb7a6-89e7-4c8c-b261-03adde4c697f admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:24.158381 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8bb7a6-89e7-4c8c-b261-03adde4c697f admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:24.158653 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8bb7a6-89e7-4c8c-b261-03adde4c697f admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:24.160603 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8bb7a6-89e7-4c8c-b261-03adde4c697f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:24.163327 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8bb7a6-89e7-4c8c-b261-03adde4c697f admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:24.181803 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32e402c-5cae-4255-9b4c-5a31656da77d admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:24.205725 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47030e46-ec67-4233-882d-7a23161db36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:24.206823 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47030e46-ec67-4233-882d-7a23161db36e admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:24.207112 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47030e46-ec67-4233-882d-7a23161db36e admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:24.207390 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47030e46-ec67-4233-882d-7a23161db36e admin admin] PATH_INFO: `/v3/projects/75ca869918da41fe99715ee3b175a163/users/a05d22d4e97d4a90ac840f40344b1f6c/roles/965049e7ce6144aaad23c15f3a5e37c3` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:24.212738 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 923/1807] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:18:24 2022] POST /identity/v3/users => generated 294 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:18:24.214170 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5fe0cf-fc35-4b9b-a5c8-38eb1db18d07 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:24.214463 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5fe0cf-fc35-4b9b-a5c8-38eb1db18d07 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:24.214740 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5fe0cf-fc35-4b9b-a5c8-38eb1db18d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:24.231027 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47030e46-ec67-4233-882d-7a23161db36e admin admin] RBAC: Authorizing `identity:create_grant(project_id=75ca869918da41fe99715ee3b175a163, user_id=a05d22d4e97d4a90ac840f40344b1f6c, role_id=965049e7ce6144aaad23c15f3a5e37c3)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:24.234199 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47030e46-ec67-4233-882d-7a23161db36e admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:24.242502 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-7d5fe0cf-fc35-4b9b-a5c8-38eb1db18d07 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:18:24.244735 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-7d5fe0cf-fc35-4b9b-a5c8-38eb1db18d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:24.258907 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 885/1808] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:18:24 2022] PUT /identity/v3/projects/75ca869918da41fe99715ee3b175a163/users/a05d22d4e97d4a90ac840f40344b1f6c/roles/965049e7ce6144aaad23c15f3a5e37c3 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:18:24.260114 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47030e46-ec67-4233-882d-7a23161db36e admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:24.338416 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 924/1809] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:18:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:18:24.340962 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5fe0cf-fc35-4b9b-a5c8-38eb1db18d07 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:24.358071 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5fe0cf-fc35-4b9b-a5c8-38eb1db18d07 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:24.365197 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47030e46-ec67-4233-882d-7a23161db36e admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:24.367171 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a868e039-0f8f-47dc-a840-ee5fdaedc0a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:24.367860 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a868e039-0f8f-47dc-a840-ee5fdaedc0a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:24.368173 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a868e039-0f8f-47dc-a840-ee5fdaedc0a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:24.368454 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a868e039-0f8f-47dc-a840-ee5fdaedc0a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:24.369412 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a868e039-0f8f-47dc-a840-ee5fdaedc0a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:24.371184 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0272e5-8674-48a2-875d-91e5c9062527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:24.371308 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a868e039-0f8f-47dc-a840-ee5fdaedc0a0 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:24.372050 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0272e5-8674-48a2-875d-91e5c9062527 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:24.372444 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0272e5-8674-48a2-875d-91e5c9062527 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:24.372904 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0272e5-8674-48a2-875d-91e5c9062527 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:24.373926 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0272e5-8674-48a2-875d-91e5c9062527 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:24.375771 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0272e5-8674-48a2-875d-91e5c9062527 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:24.378614 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:24.388844 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 925/1810] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:18:24 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:18:24.389961 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a868e039-0f8f-47dc-a840-ee5fdaedc0a0 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:24.392325 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-a868e039-0f8f-47dc-a840-ee5fdaedc0a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:24.396392 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 886/1811] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:18:24 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:18:24.396392 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0272e5-8674-48a2-875d-91e5c9062527 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:24.416122 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0272e5-8674-48a2-875d-91e5c9062527 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:24.423436 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2141db0-7d37-4bad-8a78-bf155428261f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:24.424840 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2141db0-7d37-4bad-8a78-bf155428261f admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:24.425334 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2141db0-7d37-4bad-8a78-bf155428261f admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:24.426283 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2141db0-7d37-4bad-8a78-bf155428261f admin admin] PATH_INFO: `/v3/projects/75ca869918da41fe99715ee3b175a163/users/a05d22d4e97d4a90ac840f40344b1f6c/roles/965049e7ce6144aaad23c15f3a5e37c3` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:24.428739 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2141db0-7d37-4bad-8a78-bf155428261f admin admin] RBAC: Authorizing `identity:create_grant(project_id=75ca869918da41fe99715ee3b175a163, user_id=a05d22d4e97d4a90ac840f40344b1f6c, role_id=965049e7ce6144aaad23c15f3a5e37c3)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:24.434257 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2141db0-7d37-4bad-8a78-bf155428261f admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:24.437872 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:24.487305 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 887/1812] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:18:24 2022] PUT /identity/v3/projects/75ca869918da41fe99715ee3b175a163/users/a05d22d4e97d4a90ac840f40344b1f6c/roles/965049e7ce6144aaad23c15f3a5e37c3 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:18:24.489130 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2141db0-7d37-4bad-8a78-bf155428261f admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:24.525647 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a868e039-0f8f-47dc-a840-ee5fdaedc0a0 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:24.577406 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2141db0-7d37-4bad-8a78-bf155428261f admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:24.583167 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d594d45f-733e-416a-be8a-92d2c98c1cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:24.584036 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594d45f-733e-416a-be8a-92d2c98c1cbd admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:24.584421 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594d45f-733e-416a-be8a-92d2c98c1cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:24.584805 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594d45f-733e-416a-be8a-92d2c98c1cbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:24.585641 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d594d45f-733e-416a-be8a-92d2c98c1cbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:24.589412 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d594d45f-733e-416a-be8a-92d2c98c1cbd admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:24.592291 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eab8fe-9d8c-4ad1-b6ea-1455ae71375b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:24.605456 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eab8fe-9d8c-4ad1-b6ea-1455ae71375b service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:24.605749 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eab8fe-9d8c-4ad1-b6ea-1455ae71375b service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:24.606033 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eab8fe-9d8c-4ad1-b6ea-1455ae71375b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:24.610798 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 888/1813] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:18:24 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:18:24.612716 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b506d0e-bcad-49bf-8aaa-794b2a4ef8ce None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:24.613152 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b506d0e-bcad-49bf-8aaa-794b2a4ef8ce None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:24.613501 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b506d0e-bcad-49bf-8aaa-794b2a4ef8ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:24.635260 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eab8fe-9d8c-4ad1-b6ea-1455ae71375b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:24.639077 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eab8fe-9d8c-4ad1-b6ea-1455ae71375b service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:24.668846 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 926/1814] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:18:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:18:24.669929 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eab8fe-9d8c-4ad1-b6ea-1455ae71375b service neutron] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:24.681150 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-8b506d0e-bcad-49bf-8aaa-794b2a4ef8ce None None] MFA Rules not processed for user `a05d22d4e97d4a90ac840f40344b1f6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:18:24.682828 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-8b506d0e-bcad-49bf-8aaa-794b2a4ef8ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:24.690088 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eab8fe-9d8c-4ad1-b6ea-1455ae71375b service neutron] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:24.697423 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6721a50-699d-421e-a390-fec44f917f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:24.698338 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6721a50-699d-421e-a390-fec44f917f3f admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:24.698624 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6721a50-699d-421e-a390-fec44f917f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:24.698901 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6721a50-699d-421e-a390-fec44f917f3f admin admin] PATH_INFO: `/v3/projects/3f5c2d6c8ced424b85156fcfbb720290/users/e3470e8aa30d4be49ca8fa3e1f3eb7d6/roles/81634e7812344f84afcb29b0dba2687c` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:24.722334 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6721a50-699d-421e-a390-fec44f917f3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f5c2d6c8ced424b85156fcfbb720290, user_id=e3470e8aa30d4be49ca8fa3e1f3eb7d6, role_id=81634e7812344f84afcb29b0dba2687c)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:24.726020 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6721a50-699d-421e-a390-fec44f917f3f admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:24.760857 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 927/1815] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:18:24 2022] PUT /identity/v3/projects/3f5c2d6c8ced424b85156fcfbb720290/users/e3470e8aa30d4be49ca8fa3e1f3eb7d6/roles/81634e7812344f84afcb29b0dba2687c => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:18:24.763385 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bbd6f7-e546-48e0-bf38-1e21858ae6d5 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:24.763925 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bbd6f7-e546-48e0-bf38-1e21858ae6d5 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:24.764619 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bbd6f7-e546-48e0-bf38-1e21858ae6d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:24.816941 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-a7bbd6f7-e546-48e0-bf38-1e21858ae6d5 None None] MFA Rules not processed for user `e3470e8aa30d4be49ca8fa3e1f3eb7d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:18:24.818625 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-a7bbd6f7-e546-48e0-bf38-1e21858ae6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:24.833755 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 889/1816] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:18:24 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:18:24.845629 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b506d0e-bcad-49bf-8aaa-794b2a4ef8ce None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:24.848919 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-8b506d0e-bcad-49bf-8aaa-794b2a4ef8ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:24.929053 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b506d0e-bcad-49bf-8aaa-794b2a4ef8ce None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:24.944759 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 928/1817] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:18:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:18:24.946948 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bbd6f7-e546-48e0-bf38-1e21858ae6d5 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:24.964434 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:25.014179 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:25.015739 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca684da-e79b-42ab-bce3-93f98620d8c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f86373d65440da97c853fff3c1d0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:25.016486 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca684da-e79b-42ab-bce3-93f98620d8c1 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:25.017261 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca684da-e79b-42ab-bce3-93f98620d8c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:25.017261 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca684da-e79b-42ab-bce3-93f98620d8c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:25.045083 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bbd6f7-e546-48e0-bf38-1e21858ae6d5 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:25.055979 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efa5d6d-1004-4b89-8be6-6bade7e0238c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:25.056707 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa5d6d-1004-4b89-8be6-6bade7e0238c admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:25.057086 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa5d6d-1004-4b89-8be6-6bade7e0238c admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:25.057437 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa5d6d-1004-4b89-8be6-6bade7e0238c admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:25.058511 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efa5d6d-1004-4b89-8be6-6bade7e0238c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:25.062300 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efa5d6d-1004-4b89-8be6-6bade7e0238c admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:25.107018 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca684da-e79b-42ab-bce3-93f98620d8c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:25.110046 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca684da-e79b-42ab-bce3-93f98620d8c1 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:25.115728 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 929/1818] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:18:24 2022] POST /identity/v3/projects => generated 387 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:18:25.117106 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efa5d6d-1004-4b89-8be6-6bade7e0238c admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:25.130006 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 890/1819] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:18:24 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:18:25.178543 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca684da-e79b-42ab-bce3-93f98620d8c1 service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:25.202411 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca684da-e79b-42ab-bce3-93f98620d8c1 service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:25.211905 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efa5d6d-1004-4b89-8be6-6bade7e0238c admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:25.217882 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9544826-bab9-425a-9462-6d81e882a13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:25.218827 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ef2525-520b-43ac-8d3e-c084f6d17144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:25.219664 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ef2525-520b-43ac-8d3e-c084f6d17144 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:25.219984 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ef2525-520b-43ac-8d3e-c084f6d17144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:25.220270 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ef2525-520b-43ac-8d3e-c084f6d17144 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:25.222799 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9544826-bab9-425a-9462-6d81e882a13a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:25.222799 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9544826-bab9-425a-9462-6d81e882a13a admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:25.223070 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9544826-bab9-425a-9462-6d81e882a13a admin admin] PATH_INFO: `/v3/users/90d8b60d73544afc86dc7d2c798c7515` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:25.227409 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9544826-bab9-425a-9462-6d81e882a13a admin admin] RBAC: Authorizing `identity:delete_user(user_id=90d8b60d73544afc86dc7d2c798c7515)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:25.233774 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9544826-bab9-425a-9462-6d81e882a13a admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:25.234375 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ef2525-520b-43ac-8d3e-c084f6d17144 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:25.237360 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ef2525-520b-43ac-8d3e-c084f6d17144 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:25.272676 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 930/1820] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:18:25 2022] POST /identity/v3/users => generated 300 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:18:25.276635 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ef2525-520b-43ac-8d3e-c084f6d17144 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:25.307298 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ef2525-520b-43ac-8d3e-c084f6d17144 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:25.334162 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fe4976-91cb-46d6-b8c4-1f1a0d2a6679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:25.336307 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe4976-91cb-46d6-b8c4-1f1a0d2a6679 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:25.336795 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe4976-91cb-46d6-b8c4-1f1a0d2a6679 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:25.337246 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe4976-91cb-46d6-b8c4-1f1a0d2a6679 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:25.339047 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fe4976-91cb-46d6-b8c4-1f1a0d2a6679 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:25.344558 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fe4976-91cb-46d6-b8c4-1f1a0d2a6679 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:25.361498 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a9544826-bab9-425a-9462-6d81e882a13a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90d8b60d73544afc86dc7d2c798c7515'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:25.362375 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a9544826-bab9-425a-9462-6d81e882a13a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90d8b60d73544afc86dc7d2c798c7515'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:25.365859 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 931/1821] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:18:25 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:18:25.370722 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fe4976-91cb-46d6-b8c4-1f1a0d2a6679 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:25.373430 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-05fe4976-91cb-46d6-b8c4-1f1a0d2a6679 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:25.382595 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a9544826-bab9-425a-9462-6d81e882a13a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90d8b60d73544afc86dc7d2c798c7515'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:25.383318 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a9544826-bab9-425a-9462-6d81e882a13a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90d8b60d73544afc86dc7d2c798c7515'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:25.402911 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fe4976-91cb-46d6-b8c4-1f1a0d2a6679 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:25.410999 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf3c961-9635-44ba-bc70-bac2d41fa846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:25.411895 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a9544826-bab9-425a-9462-6d81e882a13a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90d8b60d73544afc86dc7d2c798c7515'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:25.412004 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf3c961-9635-44ba-bc70-bac2d41fa846 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:25.412248 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf3c961-9635-44ba-bc70-bac2d41fa846 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:25.412552 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf3c961-9635-44ba-bc70-bac2d41fa846 admin admin] PATH_INFO: `/v3/projects/a31debc3704d48fe97ed564f311f7600/users/e4046dda529747c9b47de3c2d491a681/roles/965049e7ce6144aaad23c15f3a5e37c3` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:25.437370 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 891/1822] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:18:25 2022] DELETE /identity/v3/users/90d8b60d73544afc86dc7d2c798c7515 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:18:25.442215 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf3c961-9635-44ba-bc70-bac2d41fa846 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a31debc3704d48fe97ed564f311f7600, user_id=e4046dda529747c9b47de3c2d491a681, role_id=965049e7ce6144aaad23c15f3a5e37c3)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:25.442973 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbd392d-efb9-40b5-868a-90c17720ac2e None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:25.443314 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbd392d-efb9-40b5-868a-90c17720ac2e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:25.443594 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbd392d-efb9-40b5-868a-90c17720ac2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:25.446470 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf3c961-9635-44ba-bc70-bac2d41fa846 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:25.492768 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 932/1823] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:18:25 2022] PUT /identity/v3/projects/a31debc3704d48fe97ed564f311f7600/users/e4046dda529747c9b47de3c2d491a681/roles/965049e7ce6144aaad23c15f3a5e37c3 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:18:25.493838 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf3c961-9635-44ba-bc70-bac2d41fa846 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:25.494294 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-1cbd392d-efb9-40b5-868a-90c17720ac2e None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:18:25.497696 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-1cbd392d-efb9-40b5-868a-90c17720ac2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:25.609372 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf3c961-9635-44ba-bc70-bac2d41fa846 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:25.615647 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbece5e-9ba4-4d8f-a49b-888639dfa6c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:25.616125 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbece5e-9ba4-4d8f-a49b-888639dfa6c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:25.616417 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbece5e-9ba4-4d8f-a49b-888639dfa6c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:25.616700 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbece5e-9ba4-4d8f-a49b-888639dfa6c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:25.618829 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbece5e-9ba4-4d8f-a49b-888639dfa6c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:25.619709 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbece5e-9ba4-4d8f-a49b-888639dfa6c7 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:25.633893 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 933/1824] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:18:25 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:18:25.641470 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbece5e-9ba4-4d8f-a49b-888639dfa6c7 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:25.651101 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:25.667420 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbece5e-9ba4-4d8f-a49b-888639dfa6c7 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:25.680702 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a0ec44-d945-4447-ba3a-d3d8504e7fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:25.688631 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a0ec44-d945-4447-ba3a-d3d8504e7fd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:25.689055 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a0ec44-d945-4447-ba3a-d3d8504e7fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:25.689680 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a0ec44-d945-4447-ba3a-d3d8504e7fd4 admin admin] PATH_INFO: `/v3/projects/a31debc3704d48fe97ed564f311f7600/users/e4046dda529747c9b47de3c2d491a681/roles/965049e7ce6144aaad23c15f3a5e37c3` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:25.694148 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a0ec44-d945-4447-ba3a-d3d8504e7fd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a31debc3704d48fe97ed564f311f7600, user_id=e4046dda529747c9b47de3c2d491a681, role_id=965049e7ce6144aaad23c15f3a5e37c3)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:25.700576 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a0ec44-d945-4447-ba3a-d3d8504e7fd4 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:25.742263 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 934/1825] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:18:25 2022] PUT /identity/v3/projects/a31debc3704d48fe97ed564f311f7600/users/e4046dda529747c9b47de3c2d491a681/roles/965049e7ce6144aaad23c15f3a5e37c3 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:18:25.744167 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b9193-08ee-4027-bc48-1d2ece2b1aa6 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:25.744470 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b9193-08ee-4027-bc48-1d2ece2b1aa6 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:25.744753 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b9193-08ee-4027-bc48-1d2ece2b1aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:25.751177 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:25.758759 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 892/1826] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:18:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:18:25.804340 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-067b9193-08ee-4027-bc48-1d2ece2b1aa6 None None] MFA Rules not processed for user `e4046dda529747c9b47de3c2d491a681`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:18:25.805914 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-067b9193-08ee-4027-bc48-1d2ece2b1aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:25.808841 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbd392d-efb9-40b5-868a-90c17720ac2e None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:25.812500 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-1cbd392d-efb9-40b5-868a-90c17720ac2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:25.951481 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbd392d-efb9-40b5-868a-90c17720ac2e None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:25.989309 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 935/1827] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:18:25 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:18:25.997472 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b9193-08ee-4027-bc48-1d2ece2b1aa6 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:26.002913 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-067b9193-08ee-4027-bc48-1d2ece2b1aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:26.116335 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b9193-08ee-4027-bc48-1d2ece2b1aa6 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:26.122090 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf24d79-4a72-4944-b0f3-3f6928c35e7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:26.122956 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf24d79-4a72-4944-b0f3-3f6928c35e7b service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:26.123403 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf24d79-4a72-4944-b0f3-3f6928c35e7b service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:26.123816 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf24d79-4a72-4944-b0f3-3f6928c35e7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:26.134159 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118f160b-b081-4f2a-8f31-b2038285bb88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f86373d65440da97c853fff3c1d0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:26.135163 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f160b-b081-4f2a-8f31-b2038285bb88 service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:26.139598 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f160b-b081-4f2a-8f31-b2038285bb88 service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:26.140108 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f160b-b081-4f2a-8f31-b2038285bb88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:26.178012 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118f160b-b081-4f2a-8f31-b2038285bb88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:26.190448 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118f160b-b081-4f2a-8f31-b2038285bb88 service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:26.219557 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 936/1828] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:18:25 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 09:18:26.297636 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf24d79-4a72-4944-b0f3-3f6928c35e7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:26.301827 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf24d79-4a72-4944-b0f3-3f6928c35e7b service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:26.348115 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 893/1829] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:18:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:18:26.434152 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118f160b-b081-4f2a-8f31-b2038285bb88 service cinder] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:26.436078 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-118f160b-b081-4f2a-8f31-b2038285bb88 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:26.450796 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118f160b-b081-4f2a-8f31-b2038285bb88 service cinder] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:26.456807 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f14d78-fb14-46a8-aba3-f57d5860122c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:26.458050 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f14d78-fb14-46a8-aba3-f57d5860122c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:26.458669 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f14d78-fb14-46a8-aba3-f57d5860122c admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:26.458776 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f14d78-fb14-46a8-aba3-f57d5860122c admin admin] PATH_INFO: `/v3/projects/4a0d73caf6014d839eaaf57622192fe4` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:26.460329 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f14d78-fb14-46a8-aba3-f57d5860122c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a0d73caf6014d839eaaf57622192fe4)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:26.463354 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f14d78-fb14-46a8-aba3-f57d5860122c admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:26.530442 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-d8f14d78-fb14-46a8-aba3-f57d5860122c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a0d73caf6014d839eaaf57622192fe4', 'request_id': 'req-d8f14d78-fb14-46a8-aba3-f57d5860122c'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:26.552944 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-d8f14d78-fb14-46a8-aba3-f57d5860122c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a0d73caf6014d839eaaf57622192fe4', 'request_id': 'req-d8f14d78-fb14-46a8-aba3-f57d5860122c'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:26.563254 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-d8f14d78-fb14-46a8-aba3-f57d5860122c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a0d73caf6014d839eaaf57622192fe4', 'request_id': 'req-d8f14d78-fb14-46a8-aba3-f57d5860122c'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:26.576980 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-d8f14d78-fb14-46a8-aba3-f57d5860122c admin admin] The token cache is being invalidate because project 4a0d73caf6014d839eaaf57622192fe4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:18:26.577269 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-d8f14d78-fb14-46a8-aba3-f57d5860122c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:26.577962 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-d8f14d78-fb14-46a8-aba3-f57d5860122c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:26.584051 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 937/1830] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:18:26 2022] DELETE /identity/v3/projects/4a0d73caf6014d839eaaf57622192fe4 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:18:26.584173 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf24d79-4a72-4944-b0f3-3f6928c35e7b service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:26.595897 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf24d79-4a72-4944-b0f3-3f6928c35e7b service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:26.865720 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:26.892883 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2def7f-01ad-4c09-82cc-7625660ef052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:26.892883 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2def7f-01ad-4c09-82cc-7625660ef052 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:26.892883 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2def7f-01ad-4c09-82cc-7625660ef052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:26.892883 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2def7f-01ad-4c09-82cc-7625660ef052 admin admin] PATH_INFO: `/v3/users/80e1a5d4999e483d886e2f1a9eaeeb7e` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:26.894241 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2def7f-01ad-4c09-82cc-7625660ef052 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80e1a5d4999e483d886e2f1a9eaeeb7e)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:26.897030 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2def7f-01ad-4c09-82cc-7625660ef052 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:26.991276 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8c2def7f-01ad-4c09-82cc-7625660ef052 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80e1a5d4999e483d886e2f1a9eaeeb7e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:26.998004 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8c2def7f-01ad-4c09-82cc-7625660ef052 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80e1a5d4999e483d886e2f1a9eaeeb7e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:27.029322 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8c2def7f-01ad-4c09-82cc-7625660ef052 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80e1a5d4999e483d886e2f1a9eaeeb7e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:27.034300 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8c2def7f-01ad-4c09-82cc-7625660ef052 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80e1a5d4999e483d886e2f1a9eaeeb7e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:27.083661 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8c2def7f-01ad-4c09-82cc-7625660ef052 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80e1a5d4999e483d886e2f1a9eaeeb7e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:27.097056 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f14d78-fb14-46a8-aba3-f57d5860122c admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:27.100042 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-d8f14d78-fb14-46a8-aba3-f57d5860122c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:27.110692 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 894/1831] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:18:26 2022] DELETE /identity/v3/users/80e1a5d4999e483d886e2f1a9eaeeb7e => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:18:27.143063 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:27.240684 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f14d78-fb14-46a8-aba3-f57d5860122c admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:27.310146 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9bbab9-a4fb-40a6-ba56-0ede1a555c69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f86373d65440da97c853fff3c1d0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:27.310966 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9bbab9-a4fb-40a6-ba56-0ede1a555c69 service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:27.311351 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9bbab9-a4fb-40a6-ba56-0ede1a555c69 service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:27.311725 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9bbab9-a4fb-40a6-ba56-0ede1a555c69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:27.313920 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-3e9bbab9-a4fb-40a6-ba56-0ede1a555c69 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:27.392460 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9bbab9-a4fb-40a6-ba56-0ede1a555c69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:27.394067 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9bbab9-a4fb-40a6-ba56-0ede1a555c69 service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:27.406919 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 938/1832] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:18:27 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:18:27.564503 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444efe3d-096e-4086-a62d-b16cdf72a828 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:27.565055 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444efe3d-096e-4086-a62d-b16cdf72a828 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:27.565501 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444efe3d-096e-4086-a62d-b16cdf72a828 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:27.567028 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 895/1833] 10.222.0.42 () {54 vars in 921 bytes} [Mon Jul 4 09:18:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:18:27.640446 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a19944-5d7e-49a8-925b-815e714fed70 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:27.640910 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a19944-5d7e-49a8-925b-815e714fed70 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:27.641013 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a19944-5d7e-49a8-925b-815e714fed70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:27.689432 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-d7a19944-5d7e-49a8-925b-815e714fed70 None None] MFA Rules not processed for user `af3b6e252a8c434a99432bcece6493b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:18:27.694246 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-d7a19944-5d7e-49a8-925b-815e714fed70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:27.886860 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 939/1834] 10.222.0.42 () {58 vars in 1018 bytes} [Mon Jul 4 09:18:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:18:27.970966 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444efe3d-096e-4086-a62d-b16cdf72a828 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:27.973866 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-444efe3d-096e-4086-a62d-b16cdf72a828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:28.002421 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444efe3d-096e-4086-a62d-b16cdf72a828 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:28.010113 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a2c624-b821-4227-afe1-d8337dd1b38c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3b6e252a8c434a99432bcece6493b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:28.011082 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2c624-b821-4227-afe1-d8337dd1b38c service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:28.011500 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2c624-b821-4227-afe1-d8337dd1b38c service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:28.011949 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2c624-b821-4227-afe1-d8337dd1b38c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:28.022638 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a2c624-b821-4227-afe1-d8337dd1b38c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:28.024717 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a2c624-b821-4227-afe1-d8337dd1b38c service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:28.037481 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 896/1835] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:18:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:18:28.275057 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a19944-5d7e-49a8-925b-815e714fed70 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:28.276533 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-d7a19944-5d7e-49a8-925b-815e714fed70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:28.300818 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:28.354980 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a19944-5d7e-49a8-925b-815e714fed70 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:28.359778 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ba34f0-23e4-4492-a53f-14d178814554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:28.360728 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba34f0-23e4-4492-a53f-14d178814554 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:28.361036 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba34f0-23e4-4492-a53f-14d178814554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:28.361312 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba34f0-23e4-4492-a53f-14d178814554 admin admin] PATH_INFO: `/v3/projects/d169fe6ed8eb4c6a8b9525a0a74ed2f9` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:28.362599 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ba34f0-23e4-4492-a53f-14d178814554 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d169fe6ed8eb4c6a8b9525a0a74ed2f9)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:28.367094 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ba34f0-23e4-4492-a53f-14d178814554 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:28.442207 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-b2ba34f0-23e4-4492-a53f-14d178814554 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd169fe6ed8eb4c6a8b9525a0a74ed2f9', 'request_id': 'req-b2ba34f0-23e4-4492-a53f-14d178814554'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:28.468473 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-b2ba34f0-23e4-4492-a53f-14d178814554 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd169fe6ed8eb4c6a8b9525a0a74ed2f9', 'request_id': 'req-b2ba34f0-23e4-4492-a53f-14d178814554'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:28.479366 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-b2ba34f0-23e4-4492-a53f-14d178814554 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd169fe6ed8eb4c6a8b9525a0a74ed2f9', 'request_id': 'req-b2ba34f0-23e4-4492-a53f-14d178814554'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:28.492055 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-b2ba34f0-23e4-4492-a53f-14d178814554 admin admin] The token cache is being invalidate because project d169fe6ed8eb4c6a8b9525a0a74ed2f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:18:28.492385 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-b2ba34f0-23e4-4492-a53f-14d178814554 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:28.493043 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-b2ba34f0-23e4-4492-a53f-14d178814554 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:28.494813 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 940/1836] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:18:28 2022] DELETE /identity/v3/projects/d169fe6ed8eb4c6a8b9525a0a74ed2f9 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:18:28.498983 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a2c624-b821-4227-afe1-d8337dd1b38c service nova] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:28.509345 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a2c624-b821-4227-afe1-d8337dd1b38c service nova] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:28.601111 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ba34f0-23e4-4492-a53f-14d178814554 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:28.603769 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-b2ba34f0-23e4-4492-a53f-14d178814554 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:28.620345 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e56ab2-e927-4307-8267-9de8eec3e6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:28.621010 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e56ab2-e927-4307-8267-9de8eec3e6ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:28.621376 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e56ab2-e927-4307-8267-9de8eec3e6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:28.621723 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e56ab2-e927-4307-8267-9de8eec3e6ea admin admin] PATH_INFO: `/v3/users/a05d22d4e97d4a90ac840f40344b1f6c` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:28.623228 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e56ab2-e927-4307-8267-9de8eec3e6ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=a05d22d4e97d4a90ac840f40344b1f6c)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:28.627969 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e56ab2-e927-4307-8267-9de8eec3e6ea admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:28.756051 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-83e56ab2-e927-4307-8267-9de8eec3e6ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a05d22d4e97d4a90ac840f40344b1f6c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:28.757654 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-83e56ab2-e927-4307-8267-9de8eec3e6ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a05d22d4e97d4a90ac840f40344b1f6c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:28.772428 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-83e56ab2-e927-4307-8267-9de8eec3e6ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a05d22d4e97d4a90ac840f40344b1f6c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:28.774914 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-83e56ab2-e927-4307-8267-9de8eec3e6ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a05d22d4e97d4a90ac840f40344b1f6c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:28.777867 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ba34f0-23e4-4492-a53f-14d178814554 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:28.783050 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdf8a2a-858e-4153-b36c-719948e6bb14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:28.784125 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf8a2a-858e-4153-b36c-719948e6bb14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:28.784533 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf8a2a-858e-4153-b36c-719948e6bb14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:28.784931 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf8a2a-858e-4153-b36c-719948e6bb14 admin admin] PATH_INFO: `/v3/projects/1aea59da375c48faa904c1bf15d5749f` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:28.786606 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdf8a2a-858e-4153-b36c-719948e6bb14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1aea59da375c48faa904c1bf15d5749f)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:28.788515 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdf8a2a-858e-4153-b36c-719948e6bb14 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:28.801697 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:28.827307 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-83e56ab2-e927-4307-8267-9de8eec3e6ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a05d22d4e97d4a90ac840f40344b1f6c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:28.847844 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 897/1837] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:18:28 2022] DELETE /identity/v3/users/a05d22d4e97d4a90ac840f40344b1f6c => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:18:28.866468 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:28.868258 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-fbdf8a2a-858e-4153-b36c-719948e6bb14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1aea59da375c48faa904c1bf15d5749f', 'request_id': 'req-fbdf8a2a-858e-4153-b36c-719948e6bb14'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:28.885905 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-fbdf8a2a-858e-4153-b36c-719948e6bb14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1aea59da375c48faa904c1bf15d5749f', 'request_id': 'req-fbdf8a2a-858e-4153-b36c-719948e6bb14'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:28.905272 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-fbdf8a2a-858e-4153-b36c-719948e6bb14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1aea59da375c48faa904c1bf15d5749f', 'request_id': 'req-fbdf8a2a-858e-4153-b36c-719948e6bb14'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:28.932826 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-fbdf8a2a-858e-4153-b36c-719948e6bb14 admin admin] The token cache is being invalidate because project 1aea59da375c48faa904c1bf15d5749f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:18:28.933650 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-fbdf8a2a-858e-4153-b36c-719948e6bb14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:28.934726 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-fbdf8a2a-858e-4153-b36c-719948e6bb14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:28.936955 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 941/1838] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:18:28 2022] DELETE /identity/v3/projects/1aea59da375c48faa904c1bf15d5749f => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:18:28.942866 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9813fd-b034-4e16-a63f-50ffc5bd1be2 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:28.944250 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9813fd-b034-4e16-a63f-50ffc5bd1be2 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:28.945046 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9813fd-b034-4e16-a63f-50ffc5bd1be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:28.991567 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-fc9813fd-b034-4e16-a63f-50ffc5bd1be2 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:18:28.992328 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-fc9813fd-b034-4e16-a63f-50ffc5bd1be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:29.125174 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 898/1839] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:18:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:18:29.127686 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09685ff6-cbc8-460f-ac52-6c72c5e5bcff None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:29.128062 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09685ff6-cbc8-460f-ac52-6c72c5e5bcff None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:29.128293 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09685ff6-cbc8-460f-ac52-6c72c5e5bcff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:29.163698 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-09685ff6-cbc8-460f-ac52-6c72c5e5bcff None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:18:29.166192 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-09685ff6-cbc8-460f-ac52-6c72c5e5bcff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:29.186436 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 942/1840] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:18:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:18:29.191052 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9813fd-b034-4e16-a63f-50ffc5bd1be2 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:29.208693 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9813fd-b034-4e16-a63f-50ffc5bd1be2 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:29.223586 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8cb6cf-fd3b-463d-904b-02ba55908f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:29.224503 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8cb6cf-fd3b-463d-904b-02ba55908f60 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:29.224792 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8cb6cf-fd3b-463d-904b-02ba55908f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:29.225041 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8cb6cf-fd3b-463d-904b-02ba55908f60 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:29.225851 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8cb6cf-fd3b-463d-904b-02ba55908f60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:18:29.226156 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8cb6cf-fd3b-463d-904b-02ba55908f60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:29.228583 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8cb6cf-fd3b-463d-904b-02ba55908f60 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:29.258298 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 899/1841] 10.222.0.42 () {58 vars in 1152 bytes} [Mon Jul 4 09:18:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:18:29.260200 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09685ff6-cbc8-460f-ac52-6c72c5e5bcff None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:29.275662 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09685ff6-cbc8-460f-ac52-6c72c5e5bcff None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:29.289002 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c24aa49-103b-4889-a2a8-f6f26c85dd42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:29.289715 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24aa49-103b-4889-a2a8-f6f26c85dd42 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:29.290003 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24aa49-103b-4889-a2a8-f6f26c85dd42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:29.290925 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24aa49-103b-4889-a2a8-f6f26c85dd42 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:29.293186 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c24aa49-103b-4889-a2a8-f6f26c85dd42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:29.299365 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c24aa49-103b-4889-a2a8-f6f26c85dd42 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:29.346170 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 943/1842] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:18:29 2022] POST /identity/v3/projects => generated 383 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:18:29.350394 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8cb6cf-fd3b-463d-904b-02ba55908f60 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:29.361287 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8cb6cf-fd3b-463d-904b-02ba55908f60 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:29.499101 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e52214e-9c8c-42ff-ad6f-a51faecd7442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:29.499905 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e52214e-9c8c-42ff-ad6f-a51faecd7442 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:29.500318 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e52214e-9c8c-42ff-ad6f-a51faecd7442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:29.500660 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e52214e-9c8c-42ff-ad6f-a51faecd7442 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:29.501437 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e52214e-9c8c-42ff-ad6f-a51faecd7442 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:29.503599 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e52214e-9c8c-42ff-ad6f-a51faecd7442 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:29.528350 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 900/1843] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:18:29 2022] POST /identity/v3/users => generated 292 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:18:29.532420 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c24aa49-103b-4889-a2a8-f6f26c85dd42 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:29.549256 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c24aa49-103b-4889-a2a8-f6f26c85dd42 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:29.556611 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ae87af-7e2e-44cc-8ad0-85f49a110063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:29.557377 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ae87af-7e2e-44cc-8ad0-85f49a110063 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:29.557714 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ae87af-7e2e-44cc-8ad0-85f49a110063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:29.557993 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ae87af-7e2e-44cc-8ad0-85f49a110063 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:29.558788 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ae87af-7e2e-44cc-8ad0-85f49a110063 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:29.560601 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ae87af-7e2e-44cc-8ad0-85f49a110063 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:29.575726 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 944/1844] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:18:29 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:18:29.579555 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e52214e-9c8c-42ff-ad6f-a51faecd7442 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:29.594687 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e52214e-9c8c-42ff-ad6f-a51faecd7442 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:29.601219 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3591d90-68af-4b22-a58f-f2be176d2033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:29.601981 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3591d90-68af-4b22-a58f-f2be176d2033 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:29.602503 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3591d90-68af-4b22-a58f-f2be176d2033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:29.603289 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3591d90-68af-4b22-a58f-f2be176d2033 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:29.603673 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3591d90-68af-4b22-a58f-f2be176d2033 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:29.606108 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3591d90-68af-4b22-a58f-f2be176d2033 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:29.640638 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ae87af-7e2e-44cc-8ad0-85f49a110063 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:29.642465 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 901/1845] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:18:29 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:18:29.653896 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ae87af-7e2e-44cc-8ad0-85f49a110063 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:29.671324 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c742558-5f7d-4138-8c22-21c17e1d4a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:29.672286 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c742558-5f7d-4138-8c22-21c17e1d4a65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:29.672567 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c742558-5f7d-4138-8c22-21c17e1d4a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:29.672843 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c742558-5f7d-4138-8c22-21c17e1d4a65 admin admin] PATH_INFO: `/v3/projects/60452d1855544097a963dd3986e825a2/users/02b381dbddd74bbb8b4d21adcf609ce0/roles/81634e7812344f84afcb29b0dba2687c` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:29.714607 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c742558-5f7d-4138-8c22-21c17e1d4a65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60452d1855544097a963dd3986e825a2, user_id=02b381dbddd74bbb8b4d21adcf609ce0, role_id=81634e7812344f84afcb29b0dba2687c)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:29.717432 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c742558-5f7d-4138-8c22-21c17e1d4a65 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:29.737091 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 945/1846] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:18:29 2022] PUT /identity/v3/projects/60452d1855544097a963dd3986e825a2/users/02b381dbddd74bbb8b4d21adcf609ce0/roles/81634e7812344f84afcb29b0dba2687c => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:18:29.750474 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf91b6-0f8c-4ca7-ad50-8c0b2029afdf None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:29.750845 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf91b6-0f8c-4ca7-ad50-8c0b2029afdf None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:29.751141 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf91b6-0f8c-4ca7-ad50-8c0b2029afdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:29.793772 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-95bf91b6-0f8c-4ca7-ad50-8c0b2029afdf None None] MFA Rules not processed for user `02b381dbddd74bbb8b4d21adcf609ce0`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:18:29.795169 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-95bf91b6-0f8c-4ca7-ad50-8c0b2029afdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:29.850419 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:29.921486 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 902/1847] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:18:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:18:29.922806 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c742558-5f7d-4138-8c22-21c17e1d4a65 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:30.007991 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c742558-5f7d-4138-8c22-21c17e1d4a65 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:30.012849 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb2da20-09f8-48ce-a9a3-e0bce073c8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:30.013652 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb2da20-09f8-48ce-a9a3-e0bce073c8b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:30.014245 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb2da20-09f8-48ce-a9a3-e0bce073c8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:30.014358 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb2da20-09f8-48ce-a9a3-e0bce073c8b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:30.017008 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb2da20-09f8-48ce-a9a3-e0bce073c8b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:30.018546 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb2da20-09f8-48ce-a9a3-e0bce073c8b4 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:30.049616 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 946/1848] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:18:29 2022] POST /identity/v3/projects => generated 381 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:18:30.053925 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bf91b6-0f8c-4ca7-ad50-8c0b2029afdf None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:30.067286 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bf91b6-0f8c-4ca7-ad50-8c0b2029afdf None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:30.124490 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb2da20-09f8-48ce-a9a3-e0bce073c8b4 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:30.126797 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-8bb2da20-09f8-48ce-a9a3-e0bce073c8b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:30.137893 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0f4517-6f7d-4663-a2fe-14bc751db969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:30.138650 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f4517-6f7d-4663-a2fe-14bc751db969 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:30.141240 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f4517-6f7d-4663-a2fe-14bc751db969 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:30.141597 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f4517-6f7d-4663-a2fe-14bc751db969 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:30.142614 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0f4517-6f7d-4663-a2fe-14bc751db969 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:30.144656 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0f4517-6f7d-4663-a2fe-14bc751db969 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:30.188975 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 903/1849] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:18:30 2022] POST /identity/v3/users => generated 297 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:18:30.192936 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0f4517-6f7d-4663-a2fe-14bc751db969 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:30.202471 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0f4517-6f7d-4663-a2fe-14bc751db969 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:30.207036 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c61274-bc7f-452f-bb10-437384bacee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:30.207661 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c61274-bc7f-452f-bb10-437384bacee9 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:30.207999 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c61274-bc7f-452f-bb10-437384bacee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:30.208291 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c61274-bc7f-452f-bb10-437384bacee9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:30.209037 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c61274-bc7f-452f-bb10-437384bacee9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:30.210641 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c61274-bc7f-452f-bb10-437384bacee9 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:30.211644 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:30.215927 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb2da20-09f8-48ce-a9a3-e0bce073c8b4 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:30.222149 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 904/1850] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:18:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:18:30.222295 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d92c91c-6d14-436f-9f0d-e94a0f3bf25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:30.223250 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d92c91c-6d14-436f-9f0d-e94a0f3bf25b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:30.223593 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d92c91c-6d14-436f-9f0d-e94a0f3bf25b admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:30.223892 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d92c91c-6d14-436f-9f0d-e94a0f3bf25b admin admin] PATH_INFO: `/v3/projects/75ca869918da41fe99715ee3b175a163` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:30.225668 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d92c91c-6d14-436f-9f0d-e94a0f3bf25b admin admin] RBAC: Authorizing `identity:delete_project(project_id=75ca869918da41fe99715ee3b175a163)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:30.227554 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d92c91c-6d14-436f-9f0d-e94a0f3bf25b admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:30.228438 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c61274-bc7f-452f-bb10-437384bacee9 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:30.242742 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c61274-bc7f-452f-bb10-437384bacee9 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:30.248396 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2d9788-b85f-410b-b421-ad600d86033c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:30.249597 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d9788-b85f-410b-b421-ad600d86033c admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:30.250252 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d9788-b85f-410b-b421-ad600d86033c admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:30.250252 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d9788-b85f-410b-b421-ad600d86033c admin admin] PATH_INFO: `/v3/projects/259ffae7bcb84ccc94a36b2471932a26/users/d74e9de8c7b347038c0ba798e3d56a3c/roles/965049e7ce6144aaad23c15f3a5e37c3` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:30.268215 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2d9788-b85f-410b-b421-ad600d86033c admin admin] RBAC: Authorizing `identity:create_grant(project_id=259ffae7bcb84ccc94a36b2471932a26, user_id=d74e9de8c7b347038c0ba798e3d56a3c, role_id=965049e7ce6144aaad23c15f3a5e37c3)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:30.271045 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2d9788-b85f-410b-b421-ad600d86033c admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:30.283651 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-2d92c91c-6d14-436f-9f0d-e94a0f3bf25b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75ca869918da41fe99715ee3b175a163', 'request_id': 'req-2d92c91c-6d14-436f-9f0d-e94a0f3bf25b'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:30.291086 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 905/1851] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:18:30 2022] PUT /identity/v3/projects/259ffae7bcb84ccc94a36b2471932a26/users/d74e9de8c7b347038c0ba798e3d56a3c/roles/965049e7ce6144aaad23c15f3a5e37c3 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:18:30.292247 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2d9788-b85f-410b-b421-ad600d86033c admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:30.296576 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-2d92c91c-6d14-436f-9f0d-e94a0f3bf25b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75ca869918da41fe99715ee3b175a163', 'request_id': 'req-2d92c91c-6d14-436f-9f0d-e94a0f3bf25b'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:30.304412 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-2d92c91c-6d14-436f-9f0d-e94a0f3bf25b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75ca869918da41fe99715ee3b175a163', 'request_id': 'req-2d92c91c-6d14-436f-9f0d-e94a0f3bf25b'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:30.318811 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-2d92c91c-6d14-436f-9f0d-e94a0f3bf25b admin admin] The token cache is being invalidate because project 75ca869918da41fe99715ee3b175a163 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:18:30.319387 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-2d92c91c-6d14-436f-9f0d-e94a0f3bf25b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:30.320252 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-2d92c91c-6d14-436f-9f0d-e94a0f3bf25b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:30.322212 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 947/1852] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:18:30 2022] DELETE /identity/v3/projects/75ca869918da41fe99715ee3b175a163 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:18:30.330219 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c667f6a-43c0-4769-9412-977fff5c03fd None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:30.330662 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c667f6a-43c0-4769-9412-977fff5c03fd None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:30.331078 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c667f6a-43c0-4769-9412-977fff5c03fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:30.369125 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-5c667f6a-43c0-4769-9412-977fff5c03fd None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:18:30.370431 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-5c667f6a-43c0-4769-9412-977fff5c03fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:30.424051 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2d9788-b85f-410b-b421-ad600d86033c admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:30.437338 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731274e4-bdf2-43d8-a3f6-a772a5533416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:30.439862 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731274e4-bdf2-43d8-a3f6-a772a5533416 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:30.440344 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731274e4-bdf2-43d8-a3f6-a772a5533416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:30.441229 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731274e4-bdf2-43d8-a3f6-a772a5533416 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:30.443262 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731274e4-bdf2-43d8-a3f6-a772a5533416 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:30.448040 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731274e4-bdf2-43d8-a3f6-a772a5533416 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:30.482424 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 906/1853] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:18:30 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:18:30.483951 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731274e4-bdf2-43d8-a3f6-a772a5533416 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:30.487635 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-731274e4-bdf2-43d8-a3f6-a772a5533416 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:30.522661 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731274e4-bdf2-43d8-a3f6-a772a5533416 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:30.535768 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 948/1854] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:18:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:18:30.537577 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ceff1-dc8c-4f72-8cf5-65409d480a12 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:30.537871 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ceff1-dc8c-4f72-8cf5-65409d480a12 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:30.538160 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ceff1-dc8c-4f72-8cf5-65409d480a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:30.541760 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069fcbe-df00-4be7-a85c-9850b0d6ed06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:30.543108 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069fcbe-df00-4be7-a85c-9850b0d6ed06 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:30.543392 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069fcbe-df00-4be7-a85c-9850b0d6ed06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:30.543851 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069fcbe-df00-4be7-a85c-9850b0d6ed06 admin admin] PATH_INFO: `/v3/projects/259ffae7bcb84ccc94a36b2471932a26/users/d74e9de8c7b347038c0ba798e3d56a3c/roles/965049e7ce6144aaad23c15f3a5e37c3` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:30.548238 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a069fcbe-df00-4be7-a85c-9850b0d6ed06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=259ffae7bcb84ccc94a36b2471932a26, user_id=d74e9de8c7b347038c0ba798e3d56a3c, role_id=965049e7ce6144aaad23c15f3a5e37c3)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:30.557482 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a069fcbe-df00-4be7-a85c-9850b0d6ed06 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:30.584285 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 907/1855] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:18:30 2022] PUT /identity/v3/projects/259ffae7bcb84ccc94a36b2471932a26/users/d74e9de8c7b347038c0ba798e3d56a3c/roles/965049e7ce6144aaad23c15f3a5e37c3 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:18:30.584607 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-889ceff1-dc8c-4f72-8cf5-65409d480a12 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:18:30.585876 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-889ceff1-dc8c-4f72-8cf5-65409d480a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:30.595740 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3973900-dc2f-4ce8-aefd-91ffb6a1fc76 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:30.596206 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3973900-dc2f-4ce8-aefd-91ffb6a1fc76 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:30.596490 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3973900-dc2f-4ce8-aefd-91ffb6a1fc76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:30.641964 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:30.691365 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-c3973900-dc2f-4ce8-aefd-91ffb6a1fc76 None None] MFA Rules not processed for user `d74e9de8c7b347038c0ba798e3d56a3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:18:30.693590 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c3973900-dc2f-4ce8-aefd-91ffb6a1fc76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:30.732045 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 949/1856] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:18:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:18:30.736452 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889ceff1-dc8c-4f72-8cf5-65409d480a12 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:30.755227 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889ceff1-dc8c-4f72-8cf5-65409d480a12 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:30.768313 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daefb14c-9426-4692-b479-9bca83b19801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:30.768998 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daefb14c-9426-4692-b479-9bca83b19801 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:30.769281 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daefb14c-9426-4692-b479-9bca83b19801 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:30.769551 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daefb14c-9426-4692-b479-9bca83b19801 admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:30.773825 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daefb14c-9426-4692-b479-9bca83b19801 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:18:30.775956 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daefb14c-9426-4692-b479-9bca83b19801 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:30.784298 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daefb14c-9426-4692-b479-9bca83b19801 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:30.807054 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 950/1857] 10.222.0.42 () {58 vars in 1152 bytes} [Mon Jul 4 09:18:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:18:30.812065 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daefb14c-9426-4692-b479-9bca83b19801 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:30.834260 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daefb14c-9426-4692-b479-9bca83b19801 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:30.846255 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450bec91-5038-4e69-b7d3-e894b3bd8800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:30.848737 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450bec91-5038-4e69-b7d3-e894b3bd8800 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:30.850119 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450bec91-5038-4e69-b7d3-e894b3bd8800 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:30.851197 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450bec91-5038-4e69-b7d3-e894b3bd8800 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:30.852450 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450bec91-5038-4e69-b7d3-e894b3bd8800 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:30.860035 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450bec91-5038-4e69-b7d3-e894b3bd8800 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:30.893512 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:30.906661 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 908/1858] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:18:30 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:18:30.918771 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3973900-dc2f-4ce8-aefd-91ffb6a1fc76 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:30.924508 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 951/1859] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:18:30 2022] POST /identity/v3/projects => generated 409 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:18:30.925021 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c3973900-dc2f-4ce8-aefd-91ffb6a1fc76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:30.926921 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450bec91-5038-4e69-b7d3-e894b3bd8800 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:31.026373 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450bec91-5038-4e69-b7d3-e894b3bd8800 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:31.041644 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bca1e3-edaf-42d9-b17c-a38d04dc6e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:31.042903 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bca1e3-edaf-42d9-b17c-a38d04dc6e9d admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:31.047296 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bca1e3-edaf-42d9-b17c-a38d04dc6e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:31.047296 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bca1e3-edaf-42d9-b17c-a38d04dc6e9d admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:31.047812 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bca1e3-edaf-42d9-b17c-a38d04dc6e9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:31.055149 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bca1e3-edaf-42d9-b17c-a38d04dc6e9d admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:31.090216 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 952/1860] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:18:30 2022] POST /identity/v3/users => generated 305 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:18:31.093122 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bca1e3-edaf-42d9-b17c-a38d04dc6e9d admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:31.093429 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3973900-dc2f-4ce8-aefd-91ffb6a1fc76 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:31.117816 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bca1e3-edaf-42d9-b17c-a38d04dc6e9d admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:31.133013 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12249595-5ea0-4e45-863d-30cf02bd5fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:31.134180 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12249595-5ea0-4e45-863d-30cf02bd5fab admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:31.134482 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12249595-5ea0-4e45-863d-30cf02bd5fab admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:31.134775 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12249595-5ea0-4e45-863d-30cf02bd5fab admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:31.135525 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12249595-5ea0-4e45-863d-30cf02bd5fab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:31.137224 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12249595-5ea0-4e45-863d-30cf02bd5fab admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:31.155005 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 953/1861] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:18:31 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:18:31.160050 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12249595-5ea0-4e45-863d-30cf02bd5fab admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:31.193694 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12249595-5ea0-4e45-863d-30cf02bd5fab admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:31.202176 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308e3efb-d1d8-47c8-9e32-0884d2bd06e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:31.202859 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e3efb-d1d8-47c8-9e32-0884d2bd06e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:31.203149 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e3efb-d1d8-47c8-9e32-0884d2bd06e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:31.203429 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e3efb-d1d8-47c8-9e32-0884d2bd06e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:31.204198 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308e3efb-d1d8-47c8-9e32-0884d2bd06e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:31.205204 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2b491a-05c8-480b-9c36-aef9e25dafca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f86373d65440da97c853fff3c1d0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:31.205822 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308e3efb-d1d8-47c8-9e32-0884d2bd06e8 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:31.206491 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2b491a-05c8-480b-9c36-aef9e25dafca service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:31.207264 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2b491a-05c8-480b-9c36-aef9e25dafca service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:31.207701 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2b491a-05c8-480b-9c36-aef9e25dafca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:31.222224 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 954/1862] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:18:31 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:18:31.223342 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308e3efb-d1d8-47c8-9e32-0884d2bd06e8 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:31.238938 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308e3efb-d1d8-47c8-9e32-0884d2bd06e8 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:31.252132 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad708f-369b-4b8c-a54f-101484a5ca2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:31.253118 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad708f-369b-4b8c-a54f-101484a5ca2f admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:31.253410 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad708f-369b-4b8c-a54f-101484a5ca2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:31.253685 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad708f-369b-4b8c-a54f-101484a5ca2f admin admin] PATH_INFO: `/v3/projects/8f10566df7434b098e954422a3b9ec04/users/ab45224e1afe4109bb94a7998db08d6b/roles/81634e7812344f84afcb29b0dba2687c` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:31.291122 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ad708f-369b-4b8c-a54f-101484a5ca2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f10566df7434b098e954422a3b9ec04, user_id=ab45224e1afe4109bb94a7998db08d6b, role_id=81634e7812344f84afcb29b0dba2687c)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:31.298505 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ad708f-369b-4b8c-a54f-101484a5ca2f admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:31.310979 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2b491a-05c8-480b-9c36-aef9e25dafca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:31.313157 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2b491a-05c8-480b-9c36-aef9e25dafca service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:31.322212 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:31.327252 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 955/1863] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:18:31 2022] PUT /identity/v3/projects/8f10566df7434b098e954422a3b9ec04/users/ab45224e1afe4109bb94a7998db08d6b/roles/81634e7812344f84afcb29b0dba2687c => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:18:31.337848 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbf8e02-244c-4b7a-bae8-0ab8d5b24202 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:31.339495 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 909/1864] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:18:30 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 09:18:31.339826 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbf8e02-244c-4b7a-bae8-0ab8d5b24202 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:31.340144 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbf8e02-244c-4b7a-bae8-0ab8d5b24202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:31.381694 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-ebbf8e02-244c-4b7a-bae8-0ab8d5b24202 None None] MFA Rules not processed for user `ab45224e1afe4109bb94a7998db08d6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:18:31.384503 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-ebbf8e02-244c-4b7a-bae8-0ab8d5b24202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:31.484710 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2b491a-05c8-480b-9c36-aef9e25dafca service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:31.497321 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2b491a-05c8-480b-9c36-aef9e25dafca service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:31.519742 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 956/1865] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:18:31 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:18:31.527974 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbf8e02-244c-4b7a-bae8-0ab8d5b24202 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:31.569062 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada29f5b-e4c6-4cab-82f6-244a4a89b80e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f86373d65440da97c853fff3c1d0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:31.570275 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada29f5b-e4c6-4cab-82f6-244a4a89b80e service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:31.570766 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada29f5b-e4c6-4cab-82f6-244a4a89b80e service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:31.570941 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:31.571252 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada29f5b-e4c6-4cab-82f6-244a4a89b80e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:31.575497 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ada29f5b-e4c6-4cab-82f6-244a4a89b80e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:31.619146 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbf8e02-244c-4b7a-bae8-0ab8d5b24202 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:31.624076 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39bac88-07fc-438e-b7b7-16344289cd17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:31.625162 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39bac88-07fc-438e-b7b7-16344289cd17 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:31.625162 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39bac88-07fc-438e-b7b7-16344289cd17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:31.625395 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39bac88-07fc-438e-b7b7-16344289cd17 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:31.625974 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39bac88-07fc-438e-b7b7-16344289cd17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:31.627932 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39bac88-07fc-438e-b7b7-16344289cd17 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:31.658703 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 957/1866] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:18:31 2022] POST /identity/v3/projects => generated 409 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:18:31.659492 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada29f5b-e4c6-4cab-82f6-244a4a89b80e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:31.661219 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada29f5b-e4c6-4cab-82f6-244a4a89b80e service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:31.662503 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39bac88-07fc-438e-b7b7-16344289cd17 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:31.672432 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 910/1867] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:18:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 09:18:31.748265 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39bac88-07fc-438e-b7b7-16344289cd17 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:31.753860 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331a2262-8612-4fd8-8545-ef40cc906088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:31.754708 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a2262-8612-4fd8-8545-ef40cc906088 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:31.755066 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a2262-8612-4fd8-8545-ef40cc906088 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:31.755391 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a2262-8612-4fd8-8545-ef40cc906088 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:31.756242 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331a2262-8612-4fd8-8545-ef40cc906088 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:31.758218 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331a2262-8612-4fd8-8545-ef40cc906088 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:31.781653 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 958/1868] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:18:31 2022] POST /identity/v3/users => generated 311 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:18:31.785455 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada29f5b-e4c6-4cab-82f6-244a4a89b80e service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:31.810081 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada29f5b-e4c6-4cab-82f6-244a4a89b80e service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:31.817157 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360f3e89-2f86-4bea-aec0-9ec53ae76567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:31.817991 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360f3e89-2f86-4bea-aec0-9ec53ae76567 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:31.818372 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360f3e89-2f86-4bea-aec0-9ec53ae76567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:31.818659 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360f3e89-2f86-4bea-aec0-9ec53ae76567 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:31.820609 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360f3e89-2f86-4bea-aec0-9ec53ae76567 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:31.823002 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360f3e89-2f86-4bea-aec0-9ec53ae76567 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:31.851188 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 911/1869] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:18:31 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:18:31.857752 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331a2262-8612-4fd8-8545-ef40cc906088 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:31.870352 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331a2262-8612-4fd8-8545-ef40cc906088 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:31.877610 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38eb859-7d74-487c-8970-0049a297822c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:31.878704 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38eb859-7d74-487c-8970-0049a297822c admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:31.879049 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38eb859-7d74-487c-8970-0049a297822c admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:31.884558 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38eb859-7d74-487c-8970-0049a297822c admin admin] PATH_INFO: `/v3/projects/5744c2814c694ddb825d968ff05141f9/users/7098616553a043869a63ddd8e319f58d/roles/965049e7ce6144aaad23c15f3a5e37c3` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:31.910049 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38eb859-7d74-487c-8970-0049a297822c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5744c2814c694ddb825d968ff05141f9, user_id=7098616553a043869a63ddd8e319f58d, role_id=965049e7ce6144aaad23c15f3a5e37c3)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:31.914414 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38eb859-7d74-487c-8970-0049a297822c admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:31.935439 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 959/1870] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:18:31 2022] PUT /identity/v3/projects/5744c2814c694ddb825d968ff05141f9/users/7098616553a043869a63ddd8e319f58d/roles/965049e7ce6144aaad23c15f3a5e37c3 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:18:31.939929 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360f3e89-2f86-4bea-aec0-9ec53ae76567 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:31.973554 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360f3e89-2f86-4bea-aec0-9ec53ae76567 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:32.104143 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e8c30d-1eee-47ae-90dd-7f3e9e1a7efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:32.106450 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e8c30d-1eee-47ae-90dd-7f3e9e1a7efb admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:32.107139 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e8c30d-1eee-47ae-90dd-7f3e9e1a7efb admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:32.107619 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e8c30d-1eee-47ae-90dd-7f3e9e1a7efb admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:32.110461 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e8c30d-1eee-47ae-90dd-7f3e9e1a7efb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:32.114472 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e8c30d-1eee-47ae-90dd-7f3e9e1a7efb admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:32.132393 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 912/1871] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:18:31 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:18:32.133217 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38eb859-7d74-487c-8970-0049a297822c admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:32.146850 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38eb859-7d74-487c-8970-0049a297822c admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:32.164165 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d980a75-0bfd-4716-8f04-53da621e5d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:32.165161 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d980a75-0bfd-4716-8f04-53da621e5d56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:32.165637 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d980a75-0bfd-4716-8f04-53da621e5d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:32.166119 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d980a75-0bfd-4716-8f04-53da621e5d56 admin admin] PATH_INFO: `/v3/projects/5744c2814c694ddb825d968ff05141f9/users/7098616553a043869a63ddd8e319f58d/roles/965049e7ce6144aaad23c15f3a5e37c3` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:32.168410 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d980a75-0bfd-4716-8f04-53da621e5d56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5744c2814c694ddb825d968ff05141f9, user_id=7098616553a043869a63ddd8e319f58d, role_id=965049e7ce6144aaad23c15f3a5e37c3)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:32.171738 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d980a75-0bfd-4716-8f04-53da621e5d56 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:32.198763 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 960/1872] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:18:32 2022] PUT /identity/v3/projects/5744c2814c694ddb825d968ff05141f9/users/7098616553a043869a63ddd8e319f58d/roles/965049e7ce6144aaad23c15f3a5e37c3 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:18:32.199929 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34426a-f250-4385-b5fa-87a88f81f443 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:32.200219 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34426a-f250-4385-b5fa-87a88f81f443 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:32.200498 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34426a-f250-4385-b5fa-87a88f81f443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:32.242154 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-5b34426a-f250-4385-b5fa-87a88f81f443 None None] MFA Rules not processed for user `7098616553a043869a63ddd8e319f58d`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:18:32.244160 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-5b34426a-f250-4385-b5fa-87a88f81f443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:32.300897 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:32.363653 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d980a75-0bfd-4716-8f04-53da621e5d56 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:32.397942 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 913/1873] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:18:32 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:18:32.446077 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b34426a-f250-4385-b5fa-87a88f81f443 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:32.447810 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-5b34426a-f250-4385-b5fa-87a88f81f443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:32.510499 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d980a75-0bfd-4716-8f04-53da621e5d56 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:32.518239 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3765a562-ab28-4eb4-8b7f-4b6e1f5255ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f86373d65440da97c853fff3c1d0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:32.520310 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765a562-ab28-4eb4-8b7f-4b6e1f5255ed service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:32.520815 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765a562-ab28-4eb4-8b7f-4b6e1f5255ed service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:32.521917 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765a562-ab28-4eb4-8b7f-4b6e1f5255ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:32.524773 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-3765a562-ab28-4eb4-8b7f-4b6e1f5255ed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:32.558694 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:32.565981 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b34426a-f250-4385-b5fa-87a88f81f443 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:32.578668 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2cf3a1-13b8-43a6-b18b-c37d8d97cc5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f86373d65440da97c853fff3c1d0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:32.579330 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2cf3a1-13b8-43a6-b18b-c37d8d97cc5c service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:32.579608 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2cf3a1-13b8-43a6-b18b-c37d8d97cc5c service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:32.579887 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2cf3a1-13b8-43a6-b18b-c37d8d97cc5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:32.592622 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2cf3a1-13b8-43a6-b18b-c37d8d97cc5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:32.594075 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2cf3a1-13b8-43a6-b18b-c37d8d97cc5c service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:32.605405 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 914/1874] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:18:32 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 09:18:32.613577 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3765a562-ab28-4eb4-8b7f-4b6e1f5255ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:32.615608 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3765a562-ab28-4eb4-8b7f-4b6e1f5255ed service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:32.630614 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 961/1875] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:18:32 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:18:32.801032 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2cf3a1-13b8-43a6-b18b-c37d8d97cc5c service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:32.812845 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2cf3a1-13b8-43a6-b18b-c37d8d97cc5c service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:32.817399 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c58c3c5-b708-43a3-b599-977a82d07071 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f86373d65440da97c853fff3c1d0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:32.818113 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58c3c5-b708-43a3-b599-977a82d07071 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:32.818479 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58c3c5-b708-43a3-b599-977a82d07071 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:32.818887 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58c3c5-b708-43a3-b599-977a82d07071 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:32.897806 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c58c3c5-b708-43a3-b599-977a82d07071 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:32.899284 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c58c3c5-b708-43a3-b599-977a82d07071 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:32.910775 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 915/1876] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:18:32 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:18:34.626203 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3765a562-ab28-4eb4-8b7f-4b6e1f5255ed service cinder] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:34.711928 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3765a562-ab28-4eb4-8b7f-4b6e1f5255ed service cinder] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:34.717888 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93155b6-eca0-4bb1-9be3-bbd94a593902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:34.719017 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93155b6-eca0-4bb1-9be3-bbd94a593902 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:34.719378 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93155b6-eca0-4bb1-9be3-bbd94a593902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:34.719647 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93155b6-eca0-4bb1-9be3-bbd94a593902 admin admin] PATH_INFO: `/v3/users/02b381dbddd74bbb8b4d21adcf609ce0` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:34.721232 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93155b6-eca0-4bb1-9be3-bbd94a593902 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02b381dbddd74bbb8b4d21adcf609ce0)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:34.723293 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93155b6-eca0-4bb1-9be3-bbd94a593902 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:34.781517 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-f93155b6-eca0-4bb1-9be3-bbd94a593902 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02b381dbddd74bbb8b4d21adcf609ce0'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:34.795428 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-f93155b6-eca0-4bb1-9be3-bbd94a593902 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02b381dbddd74bbb8b4d21adcf609ce0'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:34.796171 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-f93155b6-eca0-4bb1-9be3-bbd94a593902 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02b381dbddd74bbb8b4d21adcf609ce0'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:34.799961 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-f93155b6-eca0-4bb1-9be3-bbd94a593902 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02b381dbddd74bbb8b4d21adcf609ce0'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:34.813916 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-f93155b6-eca0-4bb1-9be3-bbd94a593902 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02b381dbddd74bbb8b4d21adcf609ce0'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:34.827254 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 962/1877] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:18:34 2022] DELETE /identity/v3/users/02b381dbddd74bbb8b4d21adcf609ce0 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:18:34.832248 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00714ba-f334-44a8-853b-0a24d67e4367 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:34.833431 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00714ba-f334-44a8-853b-0a24d67e4367 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:34.833928 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00714ba-f334-44a8-853b-0a24d67e4367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:34.853015 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-c00714ba-f334-44a8-853b-0a24d67e4367 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:18:34.854306 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c00714ba-f334-44a8-853b-0a24d67e4367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:34.915812 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 916/1878] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:18:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:18:34.925711 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93155b6-eca0-4bb1-9be3-bbd94a593902 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:34.927258 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-f93155b6-eca0-4bb1-9be3-bbd94a593902 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:34.975578 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:34.993974 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93155b6-eca0-4bb1-9be3-bbd94a593902 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:34.998053 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94683c3a-cf86-4b2f-b026-ff2627ea7787 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:34.998838 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94683c3a-cf86-4b2f-b026-ff2627ea7787 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:34.999152 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94683c3a-cf86-4b2f-b026-ff2627ea7787 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:34.999476 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94683c3a-cf86-4b2f-b026-ff2627ea7787 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:35.009212 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94683c3a-cf86-4b2f-b026-ff2627ea7787 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:35.010818 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94683c3a-cf86-4b2f-b026-ff2627ea7787 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:35.021889 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 963/1879] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:18:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:18:35.113515 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00714ba-f334-44a8-853b-0a24d67e4367 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:35.115062 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c00714ba-f334-44a8-853b-0a24d67e4367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:35.128083 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00714ba-f334-44a8-853b-0a24d67e4367 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:35.132777 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7a2dd5-1504-4df0-a90f-8202b79c1073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:35.133725 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a2dd5-1504-4df0-a90f-8202b79c1073 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:35.134074 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a2dd5-1504-4df0-a90f-8202b79c1073 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:35.134434 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a2dd5-1504-4df0-a90f-8202b79c1073 admin admin] PATH_INFO: `/v3/users/bea7730d767049908e52819d625dff1b` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:35.135692 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7a2dd5-1504-4df0-a90f-8202b79c1073 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bea7730d767049908e52819d625dff1b)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:35.137764 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7a2dd5-1504-4df0-a90f-8202b79c1073 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:35.139451 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:35.190839 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-2a7a2dd5-1504-4df0-a90f-8202b79c1073 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bea7730d767049908e52819d625dff1b'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:35.191480 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-2a7a2dd5-1504-4df0-a90f-8202b79c1073 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bea7730d767049908e52819d625dff1b'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:35.199938 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-2a7a2dd5-1504-4df0-a90f-8202b79c1073 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bea7730d767049908e52819d625dff1b'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:35.200614 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-2a7a2dd5-1504-4df0-a90f-8202b79c1073 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bea7730d767049908e52819d625dff1b'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:35.214583 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-2a7a2dd5-1504-4df0-a90f-8202b79c1073 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bea7730d767049908e52819d625dff1b'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:35.227460 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 917/1880] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:18:35 2022] DELETE /identity/v3/users/bea7730d767049908e52819d625dff1b => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:18:35.232221 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f90c6-e52d-4b66-a404-08555747b541 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:35.232625 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f90c6-e52d-4b66-a404-08555747b541 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:35.232965 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f90c6-e52d-4b66-a404-08555747b541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:35.249768 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-9c1f90c6-e52d-4b66-a404-08555747b541 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:18:35.251051 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-9c1f90c6-e52d-4b66-a404-08555747b541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:35.315284 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 964/1881] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:18:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:18:35.328263 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7a2dd5-1504-4df0-a90f-8202b79c1073 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:35.330943 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-2a7a2dd5-1504-4df0-a90f-8202b79c1073 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:35.354503 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1f90c6-e52d-4b66-a404-08555747b541 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:35.355790 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-9c1f90c6-e52d-4b66-a404-08555747b541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:35.379802 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1f90c6-e52d-4b66-a404-08555747b541 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:35.391373 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd489f9a-7bc4-4f08-a274-051f5c8be442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:35.392299 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd489f9a-7bc4-4f08-a274-051f5c8be442 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:35.392577 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd489f9a-7bc4-4f08-a274-051f5c8be442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:35.392996 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd489f9a-7bc4-4f08-a274-051f5c8be442 admin admin] PATH_INFO: `/v3/projects/60452d1855544097a963dd3986e825a2` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:35.394684 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd489f9a-7bc4-4f08-a274-051f5c8be442 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60452d1855544097a963dd3986e825a2)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:35.397023 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd489f9a-7bc4-4f08-a274-051f5c8be442 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:35.428861 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7a2dd5-1504-4df0-a90f-8202b79c1073 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:35.432752 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e9ef36-6fd4-4005-a275-f4215531b4ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:35.433541 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9ef36-6fd4-4005-a275-f4215531b4ec service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:35.433829 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9ef36-6fd4-4005-a275-f4215531b4ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:35.434133 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9ef36-6fd4-4005-a275-f4215531b4ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:35.443315 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e9ef36-6fd4-4005-a275-f4215531b4ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:35.444681 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-fd489f9a-7bc4-4f08-a274-051f5c8be442 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60452d1855544097a963dd3986e825a2', 'request_id': 'req-fd489f9a-7bc4-4f08-a274-051f5c8be442'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:35.444840 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e9ef36-6fd4-4005-a275-f4215531b4ec service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:35.452371 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-fd489f9a-7bc4-4f08-a274-051f5c8be442 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60452d1855544097a963dd3986e825a2', 'request_id': 'req-fd489f9a-7bc4-4f08-a274-051f5c8be442'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:35.455039 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 918/1882] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:18:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:18:35.458769 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-fd489f9a-7bc4-4f08-a274-051f5c8be442 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60452d1855544097a963dd3986e825a2', 'request_id': 'req-fd489f9a-7bc4-4f08-a274-051f5c8be442'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:35.471354 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-fd489f9a-7bc4-4f08-a274-051f5c8be442 admin admin] The token cache is being invalidate because project 60452d1855544097a963dd3986e825a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:18:35.472010 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-fd489f9a-7bc4-4f08-a274-051f5c8be442 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:35.472516 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-fd489f9a-7bc4-4f08-a274-051f5c8be442 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:35.474418 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 965/1883] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:18:35 2022] DELETE /identity/v3/projects/60452d1855544097a963dd3986e825a2 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:18:35.478805 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e9ef36-6fd4-4005-a275-f4215531b4ec service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:35.489478 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e9ef36-6fd4-4005-a275-f4215531b4ec service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:35.580163 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8473feb2-6ac6-4555-8e98-d3966a4ac2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:35.582817 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473feb2-6ac6-4555-8e98-d3966a4ac2b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:35.583688 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473feb2-6ac6-4555-8e98-d3966a4ac2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:35.584268 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473feb2-6ac6-4555-8e98-d3966a4ac2b0 admin admin] PATH_INFO: `/v3/users/d74e9de8c7b347038c0ba798e3d56a3c` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:35.587957 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8473feb2-6ac6-4555-8e98-d3966a4ac2b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d74e9de8c7b347038c0ba798e3d56a3c)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:35.591457 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8473feb2-6ac6-4555-8e98-d3966a4ac2b0 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:35.628729 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:35.691529 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8473feb2-6ac6-4555-8e98-d3966a4ac2b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd74e9de8c7b347038c0ba798e3d56a3c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:35.693134 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8473feb2-6ac6-4555-8e98-d3966a4ac2b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd74e9de8c7b347038c0ba798e3d56a3c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:35.714000 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8473feb2-6ac6-4555-8e98-d3966a4ac2b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd74e9de8c7b347038c0ba798e3d56a3c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:35.714750 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8473feb2-6ac6-4555-8e98-d3966a4ac2b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd74e9de8c7b347038c0ba798e3d56a3c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:35.742518 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8473feb2-6ac6-4555-8e98-d3966a4ac2b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd74e9de8c7b347038c0ba798e3d56a3c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:35.779102 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 919/1884] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:18:35 2022] DELETE /identity/v3/users/d74e9de8c7b347038c0ba798e3d56a3c => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:18:36.013300 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd489f9a-7bc4-4f08-a274-051f5c8be442 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:36.014790 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-fd489f9a-7bc4-4f08-a274-051f5c8be442 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:36.029316 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd489f9a-7bc4-4f08-a274-051f5c8be442 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:36.163623 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b901605-50aa-464f-9a6a-54b30f5dc202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:36.164572 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b901605-50aa-464f-9a6a-54b30f5dc202 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:36.164851 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b901605-50aa-464f-9a6a-54b30f5dc202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:36.165133 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b901605-50aa-464f-9a6a-54b30f5dc202 admin admin] PATH_INFO: `/v3/projects/df5bcabde61f4cdeb95e3c68850b3692` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:36.166521 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b901605-50aa-464f-9a6a-54b30f5dc202 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df5bcabde61f4cdeb95e3c68850b3692)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:36.169325 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b901605-50aa-464f-9a6a-54b30f5dc202 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:36.195491 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:36.258679 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-8b901605-50aa-464f-9a6a-54b30f5dc202 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df5bcabde61f4cdeb95e3c68850b3692', 'request_id': 'req-8b901605-50aa-464f-9a6a-54b30f5dc202'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:36.267279 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-8b901605-50aa-464f-9a6a-54b30f5dc202 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df5bcabde61f4cdeb95e3c68850b3692', 'request_id': 'req-8b901605-50aa-464f-9a6a-54b30f5dc202'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:36.275633 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-8b901605-50aa-464f-9a6a-54b30f5dc202 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df5bcabde61f4cdeb95e3c68850b3692', 'request_id': 'req-8b901605-50aa-464f-9a6a-54b30f5dc202'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:36.290802 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-8b901605-50aa-464f-9a6a-54b30f5dc202 admin admin] The token cache is being invalidate because project df5bcabde61f4cdeb95e3c68850b3692 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:18:36.291082 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-8b901605-50aa-464f-9a6a-54b30f5dc202 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:36.291902 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-8b901605-50aa-464f-9a6a-54b30f5dc202 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:36.294029 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 966/1885] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:18:36 2022] DELETE /identity/v3/projects/df5bcabde61f4cdeb95e3c68850b3692 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:18:36.298484 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8473feb2-6ac6-4555-8e98-d3966a4ac2b0 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:36.300899 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-8473feb2-6ac6-4555-8e98-d3966a4ac2b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:36.315028 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8473feb2-6ac6-4555-8e98-d3966a4ac2b0 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:36.377579 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a372ddb-6311-4163-b93c-4beb75f914ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:36.378576 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a372ddb-6311-4163-b93c-4beb75f914ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:36.378878 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a372ddb-6311-4163-b93c-4beb75f914ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:36.379155 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a372ddb-6311-4163-b93c-4beb75f914ed admin admin] PATH_INFO: `/v3/users/e3470e8aa30d4be49ca8fa3e1f3eb7d6` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:36.380391 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a372ddb-6311-4163-b93c-4beb75f914ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3470e8aa30d4be49ca8fa3e1f3eb7d6)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:36.382344 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a372ddb-6311-4163-b93c-4beb75f914ed admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:36.436889 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-1a372ddb-6311-4163-b93c-4beb75f914ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3470e8aa30d4be49ca8fa3e1f3eb7d6'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:36.437678 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-1a372ddb-6311-4163-b93c-4beb75f914ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3470e8aa30d4be49ca8fa3e1f3eb7d6'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:36.446699 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-1a372ddb-6311-4163-b93c-4beb75f914ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3470e8aa30d4be49ca8fa3e1f3eb7d6'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:36.447468 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-1a372ddb-6311-4163-b93c-4beb75f914ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3470e8aa30d4be49ca8fa3e1f3eb7d6'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:36.462461 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-1a372ddb-6311-4163-b93c-4beb75f914ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3470e8aa30d4be49ca8fa3e1f3eb7d6'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:36.476983 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b901605-50aa-464f-9a6a-54b30f5dc202 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:36.478646 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-8b901605-50aa-464f-9a6a-54b30f5dc202 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:36.481898 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 920/1886] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:18:36 2022] DELETE /identity/v3/users/e3470e8aa30d4be49ca8fa3e1f3eb7d6 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:18:36.493657 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b901605-50aa-464f-9a6a-54b30f5dc202 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:36.576595 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f598f2ef-2b28-49b3-87fa-29b50ca85a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:36.577616 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f598f2ef-2b28-49b3-87fa-29b50ca85a43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:36.577913 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f598f2ef-2b28-49b3-87fa-29b50ca85a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:36.578213 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f598f2ef-2b28-49b3-87fa-29b50ca85a43 admin admin] PATH_INFO: `/v3/projects/259ffae7bcb84ccc94a36b2471932a26` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:36.580121 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f598f2ef-2b28-49b3-87fa-29b50ca85a43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=259ffae7bcb84ccc94a36b2471932a26)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:36.582488 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f598f2ef-2b28-49b3-87fa-29b50ca85a43 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:36.649811 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-f598f2ef-2b28-49b3-87fa-29b50ca85a43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '259ffae7bcb84ccc94a36b2471932a26', 'request_id': 'req-f598f2ef-2b28-49b3-87fa-29b50ca85a43'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:36.660312 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-f598f2ef-2b28-49b3-87fa-29b50ca85a43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '259ffae7bcb84ccc94a36b2471932a26', 'request_id': 'req-f598f2ef-2b28-49b3-87fa-29b50ca85a43'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:36.671200 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-f598f2ef-2b28-49b3-87fa-29b50ca85a43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '259ffae7bcb84ccc94a36b2471932a26', 'request_id': 'req-f598f2ef-2b28-49b3-87fa-29b50ca85a43'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:36.691313 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-f598f2ef-2b28-49b3-87fa-29b50ca85a43 admin admin] The token cache is being invalidate because project 259ffae7bcb84ccc94a36b2471932a26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:18:36.691632 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-f598f2ef-2b28-49b3-87fa-29b50ca85a43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:36.692403 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-f598f2ef-2b28-49b3-87fa-29b50ca85a43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:36.694423 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 967/1887] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:18:36 2022] DELETE /identity/v3/projects/259ffae7bcb84ccc94a36b2471932a26 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:18:36.699252 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a130f-1154-4516-9373-530c4200a5e4 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:36.699784 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a130f-1154-4516-9373-530c4200a5e4 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:36.700113 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a130f-1154-4516-9373-530c4200a5e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:36.726531 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-ff6a130f-1154-4516-9373-530c4200a5e4 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:18:36.727814 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ff6a130f-1154-4516-9373-530c4200a5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:36.754516 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:36.849361 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 921/1888] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:18:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:18:36.850716 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f598f2ef-2b28-49b3-87fa-29b50ca85a43 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:36.850989 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7dab81-5143-4f11-8ab9-be4a256cb1ef None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:36.851358 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7dab81-5143-4f11-8ab9-be4a256cb1ef None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:36.851712 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7dab81-5143-4f11-8ab9-be4a256cb1ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:36.853772 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-f598f2ef-2b28-49b3-87fa-29b50ca85a43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:36.873009 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f598f2ef-2b28-49b3-87fa-29b50ca85a43 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:36.894976 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-4e7dab81-5143-4f11-8ab9-be4a256cb1ef None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:18:36.896569 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-4e7dab81-5143-4f11-8ab9-be4a256cb1ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:36.901842 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799985b3-e5de-4b2f-b734-b3a755159b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:36.902767 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799985b3-e5de-4b2f-b734-b3a755159b37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:36.903056 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799985b3-e5de-4b2f-b734-b3a755159b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:36.903333 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799985b3-e5de-4b2f-b734-b3a755159b37 admin admin] PATH_INFO: `/v3/projects/3f5c2d6c8ced424b85156fcfbb720290` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:36.905257 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799985b3-e5de-4b2f-b734-b3a755159b37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f5c2d6c8ced424b85156fcfbb720290)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:36.909372 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 922/1889] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:18:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:18:36.910392 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799985b3-e5de-4b2f-b734-b3a755159b37 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:36.913741 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7dab81-5143-4f11-8ab9-be4a256cb1ef None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:36.925489 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7dab81-5143-4f11-8ab9-be4a256cb1ef None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:36.933131 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06b99fb-0b6b-4e4b-8898-c0c023d3a827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:36.934074 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b99fb-0b6b-4e4b-8898-c0c023d3a827 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:36.934500 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b99fb-0b6b-4e4b-8898-c0c023d3a827 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:36.934914 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b99fb-0b6b-4e4b-8898-c0c023d3a827 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:36.936843 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06b99fb-0b6b-4e4b-8898-c0c023d3a827 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:18:36.937300 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06b99fb-0b6b-4e4b-8898-c0c023d3a827 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:36.938264 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:36.942634 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06b99fb-0b6b-4e4b-8898-c0c023d3a827 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:36.959358 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 923/1890] 10.222.0.42 () {58 vars in 1152 bytes} [Mon Jul 4 09:18:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:18:36.963807 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06b99fb-0b6b-4e4b-8898-c0c023d3a827 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:36.980965 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-799985b3-e5de-4b2f-b734-b3a755159b37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f5c2d6c8ced424b85156fcfbb720290', 'request_id': 'req-799985b3-e5de-4b2f-b734-b3a755159b37'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:36.983534 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06b99fb-0b6b-4e4b-8898-c0c023d3a827 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:36.995667 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-799985b3-e5de-4b2f-b734-b3a755159b37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f5c2d6c8ced424b85156fcfbb720290', 'request_id': 'req-799985b3-e5de-4b2f-b734-b3a755159b37'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:37.004483 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-799985b3-e5de-4b2f-b734-b3a755159b37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f5c2d6c8ced424b85156fcfbb720290', 'request_id': 'req-799985b3-e5de-4b2f-b734-b3a755159b37'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:37.019373 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-799985b3-e5de-4b2f-b734-b3a755159b37 admin admin] The token cache is being invalidate because project 3f5c2d6c8ced424b85156fcfbb720290 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:18:37.020770 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-799985b3-e5de-4b2f-b734-b3a755159b37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:37.024368 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-799985b3-e5de-4b2f-b734-b3a755159b37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:37.026355 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 968/1891] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:18:36 2022] DELETE /identity/v3/projects/3f5c2d6c8ced424b85156fcfbb720290 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:18:37.032236 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799985b3-e5de-4b2f-b734-b3a755159b37 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:37.033935 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-799985b3-e5de-4b2f-b734-b3a755159b37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:37.065668 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3951c9a2-d816-4913-8863-466015439b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:37.066366 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3951c9a2-d816-4913-8863-466015439b28 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:37.066648 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3951c9a2-d816-4913-8863-466015439b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:37.066924 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3951c9a2-d816-4913-8863-466015439b28 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:37.067614 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3951c9a2-d816-4913-8863-466015439b28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:37.070493 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3951c9a2-d816-4913-8863-466015439b28 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:37.136514 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 924/1892] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:18:36 2022] POST /identity/v3/projects => generated 373 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:18:37.138157 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3951c9a2-d816-4913-8863-466015439b28 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:37.142263 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3951c9a2-d816-4913-8863-466015439b28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:37.151116 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799985b3-e5de-4b2f-b734-b3a755159b37 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:37.221184 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24b757f-f162-4443-8b82-36be96d2238d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:37.222366 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b757f-f162-4443-8b82-36be96d2238d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:37.222794 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b757f-f162-4443-8b82-36be96d2238d admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:37.223214 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b757f-f162-4443-8b82-36be96d2238d admin admin] PATH_INFO: `/v3/users/e4046dda529747c9b47de3c2d491a681` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:37.224973 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24b757f-f162-4443-8b82-36be96d2238d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4046dda529747c9b47de3c2d491a681)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:37.227953 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24b757f-f162-4443-8b82-36be96d2238d admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:37.235169 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3951c9a2-d816-4913-8863-466015439b28 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:37.239530 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3270de69-e01c-4545-886e-8ed71f76a95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:37.240243 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3270de69-e01c-4545-886e-8ed71f76a95e admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:37.240525 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3270de69-e01c-4545-886e-8ed71f76a95e admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:37.240800 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3270de69-e01c-4545-886e-8ed71f76a95e admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:37.241496 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3270de69-e01c-4545-886e-8ed71f76a95e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:37.243475 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3270de69-e01c-4545-886e-8ed71f76a95e admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:37.267342 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 925/1893] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:18:37 2022] POST /identity/v3/users => generated 287 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:18:37.274290 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3270de69-e01c-4545-886e-8ed71f76a95e admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:37.300896 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3270de69-e01c-4545-886e-8ed71f76a95e admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:37.310794 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-b24b757f-f162-4443-8b82-36be96d2238d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4046dda529747c9b47de3c2d491a681'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:37.322735 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-b24b757f-f162-4443-8b82-36be96d2238d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4046dda529747c9b47de3c2d491a681'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:37.323824 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-b24b757f-f162-4443-8b82-36be96d2238d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4046dda529747c9b47de3c2d491a681'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:37.324743 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-b24b757f-f162-4443-8b82-36be96d2238d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4046dda529747c9b47de3c2d491a681'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:37.327119 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74078357-e1b9-4737-9677-a11e9c36c138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:37.327545 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:37.327812 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74078357-e1b9-4737-9677-a11e9c36c138 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:37.328145 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74078357-e1b9-4737-9677-a11e9c36c138 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:37.328420 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74078357-e1b9-4737-9677-a11e9c36c138 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:37.329782 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74078357-e1b9-4737-9677-a11e9c36c138 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:37.331596 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74078357-e1b9-4737-9677-a11e9c36c138 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:37.345141 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-b24b757f-f162-4443-8b82-36be96d2238d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4046dda529747c9b47de3c2d491a681'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:37.363295 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 926/1894] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:18:37 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:18:37.365104 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74078357-e1b9-4737-9677-a11e9c36c138 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:37.367168 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-74078357-e1b9-4737-9677-a11e9c36c138 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:37.368033 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 969/1895] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:18:37 2022] DELETE /identity/v3/users/e4046dda529747c9b47de3c2d491a681 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:18:37.377338 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:37.382101 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74078357-e1b9-4737-9677-a11e9c36c138 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:37.496634 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c93d8d-6528-4862-bc35-f558dd6bfadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:37.497656 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c93d8d-6528-4862-bc35-f558dd6bfadf admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:37.498211 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c93d8d-6528-4862-bc35-f558dd6bfadf admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:37.498636 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c93d8d-6528-4862-bc35-f558dd6bfadf admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:37.499664 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c93d8d-6528-4862-bc35-f558dd6bfadf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:37.503652 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c93d8d-6528-4862-bc35-f558dd6bfadf admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:37.528039 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 927/1896] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:18:37 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:18:37.532506 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24b757f-f162-4443-8b82-36be96d2238d admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:37.548123 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24b757f-f162-4443-8b82-36be96d2238d admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:37.559042 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6781b78c-da6f-4bd0-9082-02fb961a14ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:37.559042 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6781b78c-da6f-4bd0-9082-02fb961a14ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:37.559042 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6781b78c-da6f-4bd0-9082-02fb961a14ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:37.559042 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6781b78c-da6f-4bd0-9082-02fb961a14ba admin admin] PATH_INFO: `/v3/projects/bd6bbb1975e540d8959e79d42d5242e9/users/2b1324ce08b7464189020e582e1c6f2c/roles/81634e7812344f84afcb29b0dba2687c` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:37.583527 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6781b78c-da6f-4bd0-9082-02fb961a14ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd6bbb1975e540d8959e79d42d5242e9, user_id=2b1324ce08b7464189020e582e1c6f2c, role_id=81634e7812344f84afcb29b0dba2687c)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:37.583527 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6781b78c-da6f-4bd0-9082-02fb961a14ba admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:37.603264 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 970/1897] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:18:37 2022] PUT /identity/v3/projects/bd6bbb1975e540d8959e79d42d5242e9/users/2b1324ce08b7464189020e582e1c6f2c/roles/81634e7812344f84afcb29b0dba2687c => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:18:37.614326 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2288c3-5ca2-4d0b-a57f-bf377d86aab0 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:37.614512 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2288c3-5ca2-4d0b-a57f-bf377d86aab0 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:37.614770 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2288c3-5ca2-4d0b-a57f-bf377d86aab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:37.635679 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-9d2288c3-5ca2-4d0b-a57f-bf377d86aab0 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:18:37.637573 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9d2288c3-5ca2-4d0b-a57f-bf377d86aab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:37.719569 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 928/1898] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:18:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:18:37.743102 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6781b78c-da6f-4bd0-9082-02fb961a14ba admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:37.744925 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-6781b78c-da6f-4bd0-9082-02fb961a14ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:37.852814 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6781b78c-da6f-4bd0-9082-02fb961a14ba admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:37.866716 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cd727a-0548-4733-a535-b6a1db0f046d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:37.867413 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd727a-0548-4733-a535-b6a1db0f046d service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:37.867708 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd727a-0548-4733-a535-b6a1db0f046d service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:37.868208 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd727a-0548-4733-a535-b6a1db0f046d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:37.889436 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cd727a-0548-4733-a535-b6a1db0f046d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:37.890975 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cd727a-0548-4733-a535-b6a1db0f046d service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:37.924954 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 971/1899] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:18:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:18:38.031109 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2288c3-5ca2-4d0b-a57f-bf377d86aab0 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:38.033198 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9d2288c3-5ca2-4d0b-a57f-bf377d86aab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:38.046711 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2288c3-5ca2-4d0b-a57f-bf377d86aab0 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:38.052447 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ecfde0-cf0d-4fc5-86d1-27816e713d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:38.052902 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ecfde0-cf0d-4fc5-86d1-27816e713d09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:38.053268 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ecfde0-cf0d-4fc5-86d1-27816e713d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:38.053613 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ecfde0-cf0d-4fc5-86d1-27816e713d09 admin admin] PATH_INFO: `/v3/projects/a31debc3704d48fe97ed564f311f7600` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:38.055232 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ecfde0-cf0d-4fc5-86d1-27816e713d09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a31debc3704d48fe97ed564f311f7600)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:38.057915 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ecfde0-cf0d-4fc5-86d1-27816e713d09 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:38.146273 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-21ecfde0-cf0d-4fc5-86d1-27816e713d09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a31debc3704d48fe97ed564f311f7600', 'request_id': 'req-21ecfde0-cf0d-4fc5-86d1-27816e713d09'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:38.153280 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-21ecfde0-cf0d-4fc5-86d1-27816e713d09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a31debc3704d48fe97ed564f311f7600', 'request_id': 'req-21ecfde0-cf0d-4fc5-86d1-27816e713d09'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:38.164249 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-21ecfde0-cf0d-4fc5-86d1-27816e713d09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a31debc3704d48fe97ed564f311f7600', 'request_id': 'req-21ecfde0-cf0d-4fc5-86d1-27816e713d09'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:38.182010 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-21ecfde0-cf0d-4fc5-86d1-27816e713d09 admin admin] The token cache is being invalidate because project a31debc3704d48fe97ed564f311f7600 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:18:38.182476 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-21ecfde0-cf0d-4fc5-86d1-27816e713d09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:38.183241 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-21ecfde0-cf0d-4fc5-86d1-27816e713d09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:38.189563 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 929/1900] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:18:38 2022] DELETE /identity/v3/projects/a31debc3704d48fe97ed564f311f7600 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:18:38.191472 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f8fc8e-35d7-48a0-aac0-fe0eb867d690 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:38.191966 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f8fc8e-35d7-48a0-aac0-fe0eb867d690 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:38.192155 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f8fc8e-35d7-48a0-aac0-fe0eb867d690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:38.214183 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-f1f8fc8e-35d7-48a0-aac0-fe0eb867d690 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:18:38.215463 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-f1f8fc8e-35d7-48a0-aac0-fe0eb867d690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:38.326320 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 972/1901] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:18:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:18:38.334613 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eaf9d9-fc78-453b-a19b-540c65edb2e2 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:38.335122 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eaf9d9-fc78-453b-a19b-540c65edb2e2 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:38.335246 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eaf9d9-fc78-453b-a19b-540c65edb2e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:38.372182 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-b0eaf9d9-fc78-453b-a19b-540c65edb2e2 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:18:38.373655 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b0eaf9d9-fc78-453b-a19b-540c65edb2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:38.382689 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 930/1902] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:18:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:18:38.387148 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f8fc8e-35d7-48a0-aac0-fe0eb867d690 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:38.398132 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f8fc8e-35d7-48a0-aac0-fe0eb867d690 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:38.404725 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bf2bc4-d501-40c0-a55a-b68d53415f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:38.405484 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf2bc4-d501-40c0-a55a-b68d53415f94 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:38.405876 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf2bc4-d501-40c0-a55a-b68d53415f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:38.406226 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf2bc4-d501-40c0-a55a-b68d53415f94 admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:38.407038 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bf2bc4-d501-40c0-a55a-b68d53415f94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:18:38.407622 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bf2bc4-d501-40c0-a55a-b68d53415f94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:38.409419 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bf2bc4-d501-40c0-a55a-b68d53415f94 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:38.428964 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 973/1903] 10.222.0.42 () {58 vars in 1152 bytes} [Mon Jul 4 09:18:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:18:38.433887 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eaf9d9-fc78-453b-a19b-540c65edb2e2 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:38.446182 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eaf9d9-fc78-453b-a19b-540c65edb2e2 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:38.451284 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f427fb7-9169-42a6-b4d8-599e13906bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:38.451988 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f427fb7-9169-42a6-b4d8-599e13906bbf admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:38.452271 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f427fb7-9169-42a6-b4d8-599e13906bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:38.452544 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f427fb7-9169-42a6-b4d8-599e13906bbf admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:38.453404 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f427fb7-9169-42a6-b4d8-599e13906bbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:38.455317 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f427fb7-9169-42a6-b4d8-599e13906bbf admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:38.472088 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:38.490611 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 931/1904] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:18:38 2022] POST /identity/v3/projects => generated 399 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:18:38.494784 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bf2bc4-d501-40c0-a55a-b68d53415f94 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:38.505856 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bf2bc4-d501-40c0-a55a-b68d53415f94 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:38.550089 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:38.574970 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163bcb8f-f811-4053-9c47-087cba1860bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:38.575956 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163bcb8f-f811-4053-9c47-087cba1860bb admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:38.576319 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163bcb8f-f811-4053-9c47-087cba1860bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:38.576675 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163bcb8f-f811-4053-9c47-087cba1860bb admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:38.577437 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163bcb8f-f811-4053-9c47-087cba1860bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:38.579476 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163bcb8f-f811-4053-9c47-087cba1860bb admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:38.606045 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 974/1905] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:18:38 2022] POST /identity/v3/users => generated 300 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:18:38.607642 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f427fb7-9169-42a6-b4d8-599e13906bbf admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:38.620466 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f427fb7-9169-42a6-b4d8-599e13906bbf admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:38.625945 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84efc547-018b-4073-b76a-f07733391f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:38.626687 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84efc547-018b-4073-b76a-f07733391f8a admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:38.626973 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84efc547-018b-4073-b76a-f07733391f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:38.627251 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84efc547-018b-4073-b76a-f07733391f8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:38.628238 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84efc547-018b-4073-b76a-f07733391f8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:38.629807 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84efc547-018b-4073-b76a-f07733391f8a admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:38.640760 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 932/1906] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:18:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:18:38.644819 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163bcb8f-f811-4053-9c47-087cba1860bb admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:38.657206 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163bcb8f-f811-4053-9c47-087cba1860bb admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:38.663068 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eccd27-8f4d-4459-8e56-1bd3e75692ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:38.663836 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eccd27-8f4d-4459-8e56-1bd3e75692ab admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:38.664154 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eccd27-8f4d-4459-8e56-1bd3e75692ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:38.664428 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eccd27-8f4d-4459-8e56-1bd3e75692ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:38.665156 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eccd27-8f4d-4459-8e56-1bd3e75692ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:38.666990 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eccd27-8f4d-4459-8e56-1bd3e75692ab admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:38.688278 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 975/1907] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:18:38 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:18:38.689898 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84efc547-018b-4073-b76a-f07733391f8a admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:38.702599 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84efc547-018b-4073-b76a-f07733391f8a admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:38.708182 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87960108-1db1-4ac7-b6f7-dcc83146e0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:38.709175 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87960108-1db1-4ac7-b6f7-dcc83146e0bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:38.709558 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87960108-1db1-4ac7-b6f7-dcc83146e0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:38.709920 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87960108-1db1-4ac7-b6f7-dcc83146e0bc admin admin] PATH_INFO: `/v3/projects/a23c183b31dc4bfa9d1d3a02ec49797f/users/d6de0bd708764873a44d23274f5ffb95/roles/81634e7812344f84afcb29b0dba2687c` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:38.728039 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87960108-1db1-4ac7-b6f7-dcc83146e0bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a23c183b31dc4bfa9d1d3a02ec49797f, user_id=d6de0bd708764873a44d23274f5ffb95, role_id=81634e7812344f84afcb29b0dba2687c)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:38.730748 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87960108-1db1-4ac7-b6f7-dcc83146e0bc admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:38.752692 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 933/1908] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:18:38 2022] PUT /identity/v3/projects/a23c183b31dc4bfa9d1d3a02ec49797f/users/d6de0bd708764873a44d23274f5ffb95/roles/81634e7812344f84afcb29b0dba2687c => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:18:38.757090 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee2734-3383-4cec-ba6f-4ae54e222631 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:38.757415 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee2734-3383-4cec-ba6f-4ae54e222631 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:38.757693 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee2734-3383-4cec-ba6f-4ae54e222631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:38.773458 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87960108-1db1-4ac7-b6f7-dcc83146e0bc admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:38.775426 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-87960108-1db1-4ac7-b6f7-dcc83146e0bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:38.792769 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-dbee2734-3383-4cec-ba6f-4ae54e222631 None None] MFA Rules not processed for user `d6de0bd708764873a44d23274f5ffb95`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:18:38.794195 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-dbee2734-3383-4cec-ba6f-4ae54e222631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:38.870188 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87960108-1db1-4ac7-b6f7-dcc83146e0bc admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:38.887366 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75461b9f-bc99-4d2a-8ab8-ecec1d902675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:38.888309 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75461b9f-bc99-4d2a-8ab8-ecec1d902675 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:38.888593 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75461b9f-bc99-4d2a-8ab8-ecec1d902675 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:38.888868 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75461b9f-bc99-4d2a-8ab8-ecec1d902675 admin admin] PATH_INFO: `/v3/users/ab45224e1afe4109bb94a7998db08d6b` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:38.890343 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75461b9f-bc99-4d2a-8ab8-ecec1d902675 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab45224e1afe4109bb94a7998db08d6b)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:38.892366 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75461b9f-bc99-4d2a-8ab8-ecec1d902675 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:38.912482 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 976/1909] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:18:38 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:18:38.913931 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbee2734-3383-4cec-ba6f-4ae54e222631 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:38.928744 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbee2734-3383-4cec-ba6f-4ae54e222631 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:38.935527 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a73c885-e270-404f-9986-e0f703cdfce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:38.937427 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a73c885-e270-404f-9986-e0f703cdfce4 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:38.938023 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a73c885-e270-404f-9986-e0f703cdfce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:38.938616 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a73c885-e270-404f-9986-e0f703cdfce4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:38.939610 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a73c885-e270-404f-9986-e0f703cdfce4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:38.942769 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a73c885-e270-404f-9986-e0f703cdfce4 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:38.979828 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-75461b9f-bc99-4d2a-8ab8-ecec1d902675 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab45224e1afe4109bb94a7998db08d6b'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:38.980570 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-75461b9f-bc99-4d2a-8ab8-ecec1d902675 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab45224e1afe4109bb94a7998db08d6b'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:38.990861 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 977/1910] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:18:38 2022] POST /identity/v3/projects => generated 399 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:18:38.992457 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-75461b9f-bc99-4d2a-8ab8-ecec1d902675 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab45224e1afe4109bb94a7998db08d6b'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:38.993400 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-75461b9f-bc99-4d2a-8ab8-ecec1d902675 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab45224e1afe4109bb94a7998db08d6b'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:38.995021 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a73c885-e270-404f-9986-e0f703cdfce4 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:38.998357 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-5a73c885-e270-404f-9986-e0f703cdfce4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:39.023241 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-75461b9f-bc99-4d2a-8ab8-ecec1d902675 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab45224e1afe4109bb94a7998db08d6b'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:39.045659 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 934/1911] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:18:38 2022] DELETE /identity/v3/users/ab45224e1afe4109bb94a7998db08d6b => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:18:39.050429 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21965ab0-1b7b-4a44-8825-95640de1ae8f None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:39.050721 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21965ab0-1b7b-4a44-8825-95640de1ae8f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:39.050997 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21965ab0-1b7b-4a44-8825-95640de1ae8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:39.069716 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-21965ab0-1b7b-4a44-8825-95640de1ae8f None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:18:39.070979 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-21965ab0-1b7b-4a44-8825-95640de1ae8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:39.099754 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a73c885-e270-404f-9986-e0f703cdfce4 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:39.109926 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:39.138450 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:39.155049 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 935/1912] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:18:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:18:39.175669 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21965ab0-1b7b-4a44-8825-95640de1ae8f None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:39.176910 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-21965ab0-1b7b-4a44-8825-95640de1ae8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:39.200973 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6a4441-8b49-4492-b67e-318955fa8141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:39.205074 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a4441-8b49-4492-b67e-318955fa8141 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:39.205765 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a4441-8b49-4492-b67e-318955fa8141 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:39.206511 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a4441-8b49-4492-b67e-318955fa8141 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:39.215730 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6a4441-8b49-4492-b67e-318955fa8141 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:39.218102 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6a4441-8b49-4492-b67e-318955fa8141 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:39.270965 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 978/1913] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:18:38 2022] POST /identity/v3/users => generated 306 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:18:39.273728 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c7c91-8140-43c8-9cb6-72d469a06065 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:39.274016 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c7c91-8140-43c8-9cb6-72d469a06065 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:39.275217 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21965ab0-1b7b-4a44-8825-95640de1ae8f None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:39.275656 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c7c91-8140-43c8-9cb6-72d469a06065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:39.282708 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8a6afe-20ba-4a9c-adcb-1480808c8f84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:39.284082 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a6afe-20ba-4a9c-adcb-1480808c8f84 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:39.284939 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a6afe-20ba-4a9c-adcb-1480808c8f84 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:39.286115 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a6afe-20ba-4a9c-adcb-1480808c8f84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:39.315500 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8a6afe-20ba-4a9c-adcb-1480808c8f84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:39.315500 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8a6afe-20ba-4a9c-adcb-1480808c8f84 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:39.330054 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 936/1914] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:18:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 09:18:39.331022 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8a6afe-20ba-4a9c-adcb-1480808c8f84 service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:39.369286 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-822c7c91-8140-43c8-9cb6-72d469a06065 None None] MFA Rules not processed for user `2b1324ce08b7464189020e582e1c6f2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:18:39.372020 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-822c7c91-8140-43c8-9cb6-72d469a06065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:39.372442 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8a6afe-20ba-4a9c-adcb-1480808c8f84 service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:39.380519 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc26cc8-209d-48e2-b39e-4ad8a5452282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:39.381714 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc26cc8-209d-48e2-b39e-4ad8a5452282 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:39.382414 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc26cc8-209d-48e2-b39e-4ad8a5452282 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:39.382731 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc26cc8-209d-48e2-b39e-4ad8a5452282 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:39.384178 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc26cc8-209d-48e2-b39e-4ad8a5452282 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:39.387191 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc26cc8-209d-48e2-b39e-4ad8a5452282 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:39.417063 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 937/1915] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:18:39 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:18:39.418542 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc26cc8-209d-48e2-b39e-4ad8a5452282 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:39.438775 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc26cc8-209d-48e2-b39e-4ad8a5452282 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:39.457478 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04219fc9-cf05-42a0-bf9c-cdf15cf9cf66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:39.460068 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04219fc9-cf05-42a0-bf9c-cdf15cf9cf66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:39.460358 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04219fc9-cf05-42a0-bf9c-cdf15cf9cf66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:39.460632 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04219fc9-cf05-42a0-bf9c-cdf15cf9cf66 admin admin] PATH_INFO: `/v3/projects/3c7bdfabb2994315a48903248be5f159/users/57e7033338f44cb59685c24d0a2b042d/roles/965049e7ce6144aaad23c15f3a5e37c3` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:39.496497 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 979/1916] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:18:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:18:39.496692 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04219fc9-cf05-42a0-bf9c-cdf15cf9cf66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c7bdfabb2994315a48903248be5f159, user_id=57e7033338f44cb59685c24d0a2b042d, role_id=965049e7ce6144aaad23c15f3a5e37c3)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:39.497427 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04219fc9-cf05-42a0-bf9c-cdf15cf9cf66 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:39.498708 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c7c91-8140-43c8-9cb6-72d469a06065 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:39.502879 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-822c7c91-8140-43c8-9cb6-72d469a06065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:39.521664 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 938/1917] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:18:39 2022] PUT /identity/v3/projects/3c7bdfabb2994315a48903248be5f159/users/57e7033338f44cb59685c24d0a2b042d/roles/965049e7ce6144aaad23c15f3a5e37c3 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:18:39.527913 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04219fc9-cf05-42a0-bf9c-cdf15cf9cf66 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:39.533397 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c7c91-8140-43c8-9cb6-72d469a06065 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:39.660615 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04219fc9-cf05-42a0-bf9c-cdf15cf9cf66 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:39.677111 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344ee71a-6bfc-42c2-9350-55fc491c71b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:39.677806 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ee71a-6bfc-42c2-9350-55fc491c71b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:39.678093 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ee71a-6bfc-42c2-9350-55fc491c71b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:39.678370 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ee71a-6bfc-42c2-9350-55fc491c71b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:39.679166 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344ee71a-6bfc-42c2-9350-55fc491c71b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:39.680873 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344ee71a-6bfc-42c2-9350-55fc491c71b3 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:39.683494 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b4fd5a-7d2a-46a7-830c-b7b45354a2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:39.687135 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b4fd5a-7d2a-46a7-830c-b7b45354a2a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:39.687917 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b4fd5a-7d2a-46a7-830c-b7b45354a2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:39.688404 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b4fd5a-7d2a-46a7-830c-b7b45354a2a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:39.689397 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b4fd5a-7d2a-46a7-830c-b7b45354a2a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:39.697069 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b4fd5a-7d2a-46a7-830c-b7b45354a2a2 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:39.709937 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 939/1918] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:18:39 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:18:39.714504 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344ee71a-6bfc-42c2-9350-55fc491c71b3 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:39.736378 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344ee71a-6bfc-42c2-9350-55fc491c71b3 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:39.747704 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba6af5f-1bdd-4118-99c4-58354edc7827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:39.748697 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba6af5f-1bdd-4118-99c4-58354edc7827 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:39.748981 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba6af5f-1bdd-4118-99c4-58354edc7827 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:39.749302 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba6af5f-1bdd-4118-99c4-58354edc7827 admin admin] PATH_INFO: `/v3/projects/3c7bdfabb2994315a48903248be5f159/users/57e7033338f44cb59685c24d0a2b042d/roles/965049e7ce6144aaad23c15f3a5e37c3` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:39.752546 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba6af5f-1bdd-4118-99c4-58354edc7827 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c7bdfabb2994315a48903248be5f159, user_id=57e7033338f44cb59685c24d0a2b042d, role_id=965049e7ce6144aaad23c15f3a5e37c3)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:39.761660 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba6af5f-1bdd-4118-99c4-58354edc7827 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:39.779792 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 980/1919] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:18:39 2022] POST /identity/v3/projects => generated 373 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:18:39.780848 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b4fd5a-7d2a-46a7-830c-b7b45354a2a2 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:39.797381 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 940/1920] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:18:39 2022] PUT /identity/v3/projects/3c7bdfabb2994315a48903248be5f159/users/57e7033338f44cb59685c24d0a2b042d/roles/965049e7ce6144aaad23c15f3a5e37c3 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:18:39.799759 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a25b013-2eb2-4520-9601-123f196f3711 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:39.800086 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a25b013-2eb2-4520-9601-123f196f3711 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:39.800486 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a25b013-2eb2-4520-9601-123f196f3711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:39.862989 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-5a25b013-2eb2-4520-9601-123f196f3711 None None] MFA Rules not processed for user `57e7033338f44cb59685c24d0a2b042d`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:18:39.864270 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-5a25b013-2eb2-4520-9601-123f196f3711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:39.889823 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:39.910793 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:39.939195 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b4fd5a-7d2a-46a7-830c-b7b45354a2a2 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:40.015179 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 941/1921] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:18:39 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:18:40.030588 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a25b013-2eb2-4520-9601-123f196f3711 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:40.033704 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-5a25b013-2eb2-4520-9601-123f196f3711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:40.056247 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9369f0cc-6f61-4b80-b78a-3dc1e6715d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:40.056941 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9369f0cc-6f61-4b80-b78a-3dc1e6715d52 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:40.057219 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9369f0cc-6f61-4b80-b78a-3dc1e6715d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:40.057491 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9369f0cc-6f61-4b80-b78a-3dc1e6715d52 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:40.058186 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9369f0cc-6f61-4b80-b78a-3dc1e6715d52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:40.060272 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9369f0cc-6f61-4b80-b78a-3dc1e6715d52 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:40.107796 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 981/1922] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:18:39 2022] POST /identity/v3/users => generated 293 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:18:40.113612 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9369f0cc-6f61-4b80-b78a-3dc1e6715d52 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:40.133565 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9369f0cc-6f61-4b80-b78a-3dc1e6715d52 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:40.145003 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04cfee0-5a25-4b8d-ba7a-f4939789dfd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:40.147078 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04cfee0-5a25-4b8d-ba7a-f4939789dfd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:40.149617 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04cfee0-5a25-4b8d-ba7a-f4939789dfd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:40.149906 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04cfee0-5a25-4b8d-ba7a-f4939789dfd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:40.150691 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04cfee0-5a25-4b8d-ba7a-f4939789dfd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:40.152356 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04cfee0-5a25-4b8d-ba7a-f4939789dfd2 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:40.158903 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a25b013-2eb2-4520-9601-123f196f3711 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:40.173271 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 982/1923] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:18:40 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:18:40.173896 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850679ef-6b5b-4c6a-864d-084a6ccd264f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f86373d65440da97c853fff3c1d0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:40.175337 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850679ef-6b5b-4c6a-864d-084a6ccd264f service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:40.175610 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850679ef-6b5b-4c6a-864d-084a6ccd264f service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:40.176096 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850679ef-6b5b-4c6a-864d-084a6ccd264f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:40.177277 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04cfee0-5a25-4b8d-ba7a-f4939789dfd2 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:40.190029 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04cfee0-5a25-4b8d-ba7a-f4939789dfd2 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:40.192444 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850679ef-6b5b-4c6a-864d-084a6ccd264f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:40.194228 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850679ef-6b5b-4c6a-864d-084a6ccd264f service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:40.196987 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef53d4-d2f9-4d1e-b8a9-ecd4c12b5279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:40.198171 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef53d4-d2f9-4d1e-b8a9-ecd4c12b5279 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:40.198736 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef53d4-d2f9-4d1e-b8a9-ecd4c12b5279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:40.199205 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef53d4-d2f9-4d1e-b8a9-ecd4c12b5279 admin admin] PATH_INFO: `/v3/projects/49608c5d792b402cb19f8917446b6a4a/users/7b9b5a3e202e462099bc70ced249a367/roles/965049e7ce6144aaad23c15f3a5e37c3` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:40.208757 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 942/1924] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:18:40 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:18:40.219720 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ef53d4-d2f9-4d1e-b8a9-ecd4c12b5279 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49608c5d792b402cb19f8917446b6a4a, user_id=7b9b5a3e202e462099bc70ced249a367, role_id=965049e7ce6144aaad23c15f3a5e37c3)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:40.222425 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ef53d4-d2f9-4d1e-b8a9-ecd4c12b5279 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:40.253778 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 983/1925] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:18:40 2022] PUT /identity/v3/projects/49608c5d792b402cb19f8917446b6a4a/users/7b9b5a3e202e462099bc70ced249a367/roles/965049e7ce6144aaad23c15f3a5e37c3 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:18:40.256997 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850679ef-6b5b-4c6a-864d-084a6ccd264f service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:40.269402 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850679ef-6b5b-4c6a-864d-084a6ccd264f service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:40.318618 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef53d4-d2f9-4d1e-b8a9-ecd4c12b5279 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:40.364931 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd48caf-17c6-4cf9-a078-f0bfb17bd3f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:40.366165 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd48caf-17c6-4cf9-a078-f0bfb17bd3f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:40.366925 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd48caf-17c6-4cf9-a078-f0bfb17bd3f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:40.367400 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd48caf-17c6-4cf9-a078-f0bfb17bd3f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:40.368457 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd48caf-17c6-4cf9-a078-f0bfb17bd3f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:40.370423 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd48caf-17c6-4cf9-a078-f0bfb17bd3f3 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:40.382878 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 943/1926] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:18:40 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:18:40.388321 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd48caf-17c6-4cf9-a078-f0bfb17bd3f3 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:40.454201 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd48caf-17c6-4cf9-a078-f0bfb17bd3f3 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:40.464957 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a77d4d6-60d5-4f9d-ac95-a82c08146ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:40.466263 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77d4d6-60d5-4f9d-ac95-a82c08146ac7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:40.467372 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77d4d6-60d5-4f9d-ac95-a82c08146ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:40.467898 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77d4d6-60d5-4f9d-ac95-a82c08146ac7 admin admin] PATH_INFO: `/v3/projects/49608c5d792b402cb19f8917446b6a4a/users/7b9b5a3e202e462099bc70ced249a367/roles/965049e7ce6144aaad23c15f3a5e37c3` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:40.471020 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a77d4d6-60d5-4f9d-ac95-a82c08146ac7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49608c5d792b402cb19f8917446b6a4a, user_id=7b9b5a3e202e462099bc70ced249a367, role_id=965049e7ce6144aaad23c15f3a5e37c3)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:40.475360 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef53d4-d2f9-4d1e-b8a9-ecd4c12b5279 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:40.493900 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4716217-8a5d-4768-9f6c-bde5e6eb69ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f86373d65440da97c853fff3c1d0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:40.494991 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4716217-8a5d-4768-9f6c-bde5e6eb69ec service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:40.495693 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4716217-8a5d-4768-9f6c-bde5e6eb69ec service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:40.496198 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4716217-8a5d-4768-9f6c-bde5e6eb69ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:40.498804 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-c4716217-8a5d-4768-9f6c-bde5e6eb69ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:40.506439 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a77d4d6-60d5-4f9d-ac95-a82c08146ac7 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:40.544279 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 944/1927] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:18:40 2022] PUT /identity/v3/projects/49608c5d792b402cb19f8917446b6a4a/users/7b9b5a3e202e462099bc70ced249a367/roles/965049e7ce6144aaad23c15f3a5e37c3 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:18:40.544279 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a77d4d6-60d5-4f9d-ac95-a82c08146ac7 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:40.544594 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-4a77d4d6-60d5-4f9d-ac95-a82c08146ac7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:40.622270 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:40.628462 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4716217-8a5d-4768-9f6c-bde5e6eb69ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:40.631408 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:40.631552 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4716217-8a5d-4768-9f6c-bde5e6eb69ec service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:40.643863 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 984/1928] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:18:40 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 09:18:40.656097 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a77d4d6-60d5-4f9d-ac95-a82c08146ac7 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:40.662762 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410f0d80-8ebf-492c-9bc0-c8902f36adcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:40.663842 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f0d80-8ebf-492c-9bc0-c8902f36adcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:40.664219 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f0d80-8ebf-492c-9bc0-c8902f36adcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:40.664561 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f0d80-8ebf-492c-9bc0-c8902f36adcb admin admin] PATH_INFO: `/v3/projects/8f10566df7434b098e954422a3b9ec04` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:40.665895 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410f0d80-8ebf-492c-9bc0-c8902f36adcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f10566df7434b098e954422a3b9ec04)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:40.669125 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410f0d80-8ebf-492c-9bc0-c8902f36adcb admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:40.738013 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-410f0d80-8ebf-492c-9bc0-c8902f36adcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f10566df7434b098e954422a3b9ec04', 'request_id': 'req-410f0d80-8ebf-492c-9bc0-c8902f36adcb'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:40.745280 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-410f0d80-8ebf-492c-9bc0-c8902f36adcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f10566df7434b098e954422a3b9ec04', 'request_id': 'req-410f0d80-8ebf-492c-9bc0-c8902f36adcb'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:40.765854 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-410f0d80-8ebf-492c-9bc0-c8902f36adcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f10566df7434b098e954422a3b9ec04', 'request_id': 'req-410f0d80-8ebf-492c-9bc0-c8902f36adcb'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:40.782972 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-410f0d80-8ebf-492c-9bc0-c8902f36adcb admin admin] The token cache is being invalidate because project 8f10566df7434b098e954422a3b9ec04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:18:40.783259 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-410f0d80-8ebf-492c-9bc0-c8902f36adcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:40.784008 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-410f0d80-8ebf-492c-9bc0-c8902f36adcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:40.786012 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 945/1929] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:18:40 2022] DELETE /identity/v3/projects/8f10566df7434b098e954422a3b9ec04 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:18:40.790379 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4716217-8a5d-4768-9f6c-bde5e6eb69ec service cinder] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:40.806828 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4716217-8a5d-4768-9f6c-bde5e6eb69ec service cinder] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:40.894072 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc22480-99fe-486a-95a1-3979538f1666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:40.896132 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc22480-99fe-486a-95a1-3979538f1666 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:40.896132 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc22480-99fe-486a-95a1-3979538f1666 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:40.896132 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc22480-99fe-486a-95a1-3979538f1666 admin admin] PATH_INFO: `/v3/users/7098616553a043869a63ddd8e319f58d` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:40.896694 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc22480-99fe-486a-95a1-3979538f1666 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7098616553a043869a63ddd8e319f58d)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:40.898740 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc22480-99fe-486a-95a1-3979538f1666 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:40.962277 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-1cc22480-99fe-486a-95a1-3979538f1666 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7098616553a043869a63ddd8e319f58d'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:40.974538 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-1cc22480-99fe-486a-95a1-3979538f1666 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7098616553a043869a63ddd8e319f58d'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:40.976311 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-1cc22480-99fe-486a-95a1-3979538f1666 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7098616553a043869a63ddd8e319f58d'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:40.977135 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-1cc22480-99fe-486a-95a1-3979538f1666 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7098616553a043869a63ddd8e319f58d'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:41.000054 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-1cc22480-99fe-486a-95a1-3979538f1666 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7098616553a043869a63ddd8e319f58d'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:41.031643 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 985/1930] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:18:40 2022] DELETE /identity/v3/users/7098616553a043869a63ddd8e319f58d => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:18:41.723067 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410f0d80-8ebf-492c-9bc0-c8902f36adcb admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:41.725768 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-410f0d80-8ebf-492c-9bc0-c8902f36adcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:41.748844 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410f0d80-8ebf-492c-9bc0-c8902f36adcb admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:41.846880 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a389ebc9-4c99-4e5f-ab00-00b08173f968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:41.849068 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a389ebc9-4c99-4e5f-ab00-00b08173f968 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:41.849599 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a389ebc9-4c99-4e5f-ab00-00b08173f968 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:41.850332 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a389ebc9-4c99-4e5f-ab00-00b08173f968 admin admin] PATH_INFO: `/v3/projects/5744c2814c694ddb825d968ff05141f9` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:41.852070 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a389ebc9-4c99-4e5f-ab00-00b08173f968 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5744c2814c694ddb825d968ff05141f9)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:41.854254 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a389ebc9-4c99-4e5f-ab00-00b08173f968 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:41.922261 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a389ebc9-4c99-4e5f-ab00-00b08173f968 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5744c2814c694ddb825d968ff05141f9', 'request_id': 'req-a389ebc9-4c99-4e5f-ab00-00b08173f968'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:41.928344 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a389ebc9-4c99-4e5f-ab00-00b08173f968 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5744c2814c694ddb825d968ff05141f9', 'request_id': 'req-a389ebc9-4c99-4e5f-ab00-00b08173f968'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:41.936893 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a389ebc9-4c99-4e5f-ab00-00b08173f968 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5744c2814c694ddb825d968ff05141f9', 'request_id': 'req-a389ebc9-4c99-4e5f-ab00-00b08173f968'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:41.950271 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a389ebc9-4c99-4e5f-ab00-00b08173f968 admin admin] The token cache is being invalidate because project 5744c2814c694ddb825d968ff05141f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:18:41.950549 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a389ebc9-4c99-4e5f-ab00-00b08173f968 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:41.951190 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a389ebc9-4c99-4e5f-ab00-00b08173f968 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:41.952792 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 946/1931] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:18:41 2022] DELETE /identity/v3/projects/5744c2814c694ddb825d968ff05141f9 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:18:41.957711 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6744703a-658c-4c0b-a310-5da288f00c60 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:41.958200 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6744703a-658c-4c0b-a310-5da288f00c60 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:41.958293 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6744703a-658c-4c0b-a310-5da288f00c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:41.979510 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-6744703a-658c-4c0b-a310-5da288f00c60 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:18:41.981281 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-6744703a-658c-4c0b-a310-5da288f00c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:42.089142 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 986/1932] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:18:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:18:42.097160 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76282fdc-ce06-4d2d-a9d2-02b29fdd7c6e None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:42.097504 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76282fdc-ce06-4d2d-a9d2-02b29fdd7c6e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:42.097780 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76282fdc-ce06-4d2d-a9d2-02b29fdd7c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:42.104634 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:42.134595 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-76282fdc-ce06-4d2d-a9d2-02b29fdd7c6e None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:18:42.135898 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-76282fdc-ce06-4d2d-a9d2-02b29fdd7c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:42.147797 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 947/1933] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:18:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:18:42.153166 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6744703a-658c-4c0b-a310-5da288f00c60 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:42.168115 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6744703a-658c-4c0b-a310-5da288f00c60 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:42.173744 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba054b3e-8305-43d1-8fda-b6d58424eb3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:42.174703 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba054b3e-8305-43d1-8fda-b6d58424eb3a admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:42.175329 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba054b3e-8305-43d1-8fda-b6d58424eb3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:42.175912 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba054b3e-8305-43d1-8fda-b6d58424eb3a admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:42.177061 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba054b3e-8305-43d1-8fda-b6d58424eb3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:18:42.177643 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba054b3e-8305-43d1-8fda-b6d58424eb3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:42.179764 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba054b3e-8305-43d1-8fda-b6d58424eb3a admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:42.189856 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:42.194730 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 987/1934] 10.222.0.42 () {58 vars in 1152 bytes} [Mon Jul 4 09:18:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:18:42.199066 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76282fdc-ce06-4d2d-a9d2-02b29fdd7c6e None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:42.216252 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76282fdc-ce06-4d2d-a9d2-02b29fdd7c6e None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:42.222421 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c04a79a-9d3e-4d6d-976d-16eb22087de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:42.223093 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c04a79a-9d3e-4d6d-976d-16eb22087de7 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:42.223377 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c04a79a-9d3e-4d6d-976d-16eb22087de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:42.223655 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c04a79a-9d3e-4d6d-976d-16eb22087de7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:42.224774 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c04a79a-9d3e-4d6d-976d-16eb22087de7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:42.226743 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c04a79a-9d3e-4d6d-976d-16eb22087de7 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:42.267586 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 948/1935] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:18:42 2022] POST /identity/v3/projects => generated 383 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:18:42.267760 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba054b3e-8305-43d1-8fda-b6d58424eb3a admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:42.282502 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba054b3e-8305-43d1-8fda-b6d58424eb3a admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:42.401629 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2011c5-63ea-455e-bd3e-53f3d403bad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:42.403851 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2011c5-63ea-455e-bd3e-53f3d403bad4 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:42.404558 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2011c5-63ea-455e-bd3e-53f3d403bad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:42.405003 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2011c5-63ea-455e-bd3e-53f3d403bad4 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:42.405989 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2011c5-63ea-455e-bd3e-53f3d403bad4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:42.408600 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2011c5-63ea-455e-bd3e-53f3d403bad4 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:42.437016 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 988/1936] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:18:42 2022] POST /identity/v3/users => generated 292 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:18:42.440741 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c04a79a-9d3e-4d6d-976d-16eb22087de7 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:42.456268 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c04a79a-9d3e-4d6d-976d-16eb22087de7 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:42.462268 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643db67e-4002-45bf-921e-c9d70927c50f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:42.462945 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643db67e-4002-45bf-921e-c9d70927c50f admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:42.463227 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643db67e-4002-45bf-921e-c9d70927c50f admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:42.463503 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643db67e-4002-45bf-921e-c9d70927c50f admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:42.465231 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643db67e-4002-45bf-921e-c9d70927c50f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:42.467416 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643db67e-4002-45bf-921e-c9d70927c50f admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:42.483247 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 949/1937] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:18:42 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:18:42.484759 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2011c5-63ea-455e-bd3e-53f3d403bad4 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:42.491717 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50629a2-1856-4b8a-b247-3be9920095e7 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:42.492162 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50629a2-1856-4b8a-b247-3be9920095e7 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:42.492441 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50629a2-1856-4b8a-b247-3be9920095e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:42.499809 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2011c5-63ea-455e-bd3e-53f3d403bad4 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:42.506253 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6eae74-b29f-4f8b-a2b5-7bd78fe76e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:42.507239 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6eae74-b29f-4f8b-a2b5-7bd78fe76e10 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:42.507818 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6eae74-b29f-4f8b-a2b5-7bd78fe76e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:42.508326 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6eae74-b29f-4f8b-a2b5-7bd78fe76e10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:42.509305 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6eae74-b29f-4f8b-a2b5-7bd78fe76e10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:42.511499 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6eae74-b29f-4f8b-a2b5-7bd78fe76e10 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:42.528888 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 989/1938] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:18:42 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:18:42.532234 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6eae74-b29f-4f8b-a2b5-7bd78fe76e10 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:42.543287 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-e50629a2-1856-4b8a-b247-3be9920095e7 None None] MFA Rules not processed for user `7b9b5a3e202e462099bc70ced249a367`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:18:42.545595 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e50629a2-1856-4b8a-b247-3be9920095e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:42.551909 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6eae74-b29f-4f8b-a2b5-7bd78fe76e10 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:42.566601 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b60d41-4986-4368-8023-c74920738c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:42.567514 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b60d41-4986-4368-8023-c74920738c15 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:42.567798 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b60d41-4986-4368-8023-c74920738c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:42.568454 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b60d41-4986-4368-8023-c74920738c15 admin admin] PATH_INFO: `/v3/projects/c9e3d9bfc7154cb28140cfd90878e1bd/users/26c5aca4e0564f85a4be76378846060f/roles/81634e7812344f84afcb29b0dba2687c` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:42.617490 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b60d41-4986-4368-8023-c74920738c15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9e3d9bfc7154cb28140cfd90878e1bd, user_id=26c5aca4e0564f85a4be76378846060f, role_id=81634e7812344f84afcb29b0dba2687c)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:42.620308 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b60d41-4986-4368-8023-c74920738c15 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:42.660251 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 990/1939] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:18:42 2022] PUT /identity/v3/projects/c9e3d9bfc7154cb28140cfd90878e1bd/users/26c5aca4e0564f85a4be76378846060f/roles/81634e7812344f84afcb29b0dba2687c => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:18:42.662100 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a38c0-1fd2-4281-a0fc-1e43b129b5e4 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:42.662440 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a38c0-1fd2-4281-a0fc-1e43b129b5e4 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:42.662725 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a38c0-1fd2-4281-a0fc-1e43b129b5e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:42.768015 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-5e4a38c0-1fd2-4281-a0fc-1e43b129b5e4 None None] MFA Rules not processed for user `26c5aca4e0564f85a4be76378846060f`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:18:42.772091 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-5e4a38c0-1fd2-4281-a0fc-1e43b129b5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:42.802844 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 950/1940] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:18:42 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:18:42.816613 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d250419a-8087-4b62-8c21-832255b8afe9 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:42.816985 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d250419a-8087-4b62-8c21-832255b8afe9 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:42.817087 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d250419a-8087-4b62-8c21-832255b8afe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:42.850734 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-d250419a-8087-4b62-8c21-832255b8afe9 None None] MFA Rules not processed for user `2b1324ce08b7464189020e582e1c6f2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:18:42.854231 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d250419a-8087-4b62-8c21-832255b8afe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:42.915104 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 991/1941] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:18:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:18:42.919971 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4a38c0-1fd2-4281-a0fc-1e43b129b5e4 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:42.969303 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 951/1942] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:18:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:18:42.985181 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:43.004836 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4a38c0-1fd2-4281-a0fc-1e43b129b5e4 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:43.010685 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5e5a74-1db4-4c11-8d2d-2f3b53a6a5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:43.011443 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e5a74-1db4-4c11-8d2d-2f3b53a6a5c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:43.012105 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e5a74-1db4-4c11-8d2d-2f3b53a6a5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:43.012453 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e5a74-1db4-4c11-8d2d-2f3b53a6a5c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:43.013225 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5e5a74-1db4-4c11-8d2d-2f3b53a6a5c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:43.015943 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5e5a74-1db4-4c11-8d2d-2f3b53a6a5c0 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:43.047073 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 992/1943] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:18:42 2022] POST /identity/v3/projects => generated 383 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:18:43.051334 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d250419a-8087-4b62-8c21-832255b8afe9 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:43.062605 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d250419a-8087-4b62-8c21-832255b8afe9 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:43.115735 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:43.129803 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2498242-623a-4423-ab58-90bc29979123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:43.131616 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5e5a74-1db4-4c11-8d2d-2f3b53a6a5c0 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:43.132220 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2498242-623a-4423-ab58-90bc29979123 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:43.132632 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2498242-623a-4423-ab58-90bc29979123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:43.132917 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2498242-623a-4423-ab58-90bc29979123 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:43.133639 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2498242-623a-4423-ab58-90bc29979123 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:43.133759 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-7c5e5a74-1db4-4c11-8d2d-2f3b53a6a5c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:43.135717 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2498242-623a-4423-ab58-90bc29979123 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:43.158614 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 952/1944] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:18:43 2022] POST /identity/v3/users => generated 298 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:18:43.162517 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2498242-623a-4423-ab58-90bc29979123 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:43.175393 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2498242-623a-4423-ab58-90bc29979123 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:43.183134 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db083c5-2898-4584-b935-6adda510d556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:43.183834 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db083c5-2898-4584-b935-6adda510d556 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:43.184150 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db083c5-2898-4584-b935-6adda510d556 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:43.184426 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db083c5-2898-4584-b935-6adda510d556 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:43.185165 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db083c5-2898-4584-b935-6adda510d556 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:43.186799 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db083c5-2898-4584-b935-6adda510d556 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:43.205804 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 953/1945] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:18:43 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:18:43.206946 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db083c5-2898-4584-b935-6adda510d556 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:43.218113 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db083c5-2898-4584-b935-6adda510d556 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:43.223743 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81041720-9e3b-4b44-bc7b-a3f1cdc151dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:43.225269 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81041720-9e3b-4b44-bc7b-a3f1cdc151dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:43.225269 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81041720-9e3b-4b44-bc7b-a3f1cdc151dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:43.225520 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81041720-9e3b-4b44-bc7b-a3f1cdc151dd admin admin] PATH_INFO: `/v3/projects/4b6375c720704770807205893747215c/users/940f2ec947c846ea9e6811ed6417cb87/roles/965049e7ce6144aaad23c15f3a5e37c3` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:43.233883 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5e5a74-1db4-4c11-8d2d-2f3b53a6a5c0 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:43.240063 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15f806a-80e4-4c1c-8a64-09ccb4053642 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3b6e252a8c434a99432bcece6493b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:43.240721 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f806a-80e4-4c1c-8a64-09ccb4053642 service nova] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:43.241001 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f806a-80e4-4c1c-8a64-09ccb4053642 service nova] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:43.241273 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f806a-80e4-4c1c-8a64-09ccb4053642 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:43.241867 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81041720-9e3b-4b44-bc7b-a3f1cdc151dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b6375c720704770807205893747215c, user_id=940f2ec947c846ea9e6811ed6417cb87, role_id=965049e7ce6144aaad23c15f3a5e37c3)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:43.243269 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-f15f806a-80e4-4c1c-8a64-09ccb4053642 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:43.245666 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81041720-9e3b-4b44-bc7b-a3f1cdc151dd admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:43.275487 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 954/1946] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:18:43 2022] PUT /identity/v3/projects/4b6375c720704770807205893747215c/users/940f2ec947c846ea9e6811ed6417cb87/roles/965049e7ce6144aaad23c15f3a5e37c3 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:18:43.278825 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81041720-9e3b-4b44-bc7b-a3f1cdc151dd admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:43.321111 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15f806a-80e4-4c1c-8a64-09ccb4053642 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:43.322564 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15f806a-80e4-4c1c-8a64-09ccb4053642 service nova] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:43.336283 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 993/1947] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:18:43 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:18:43.407470 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81041720-9e3b-4b44-bc7b-a3f1cdc151dd admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:43.432106 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3d0ed2-9f55-4b16-be98-e3cfeedd4c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:43.432818 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3d0ed2-9f55-4b16-be98-e3cfeedd4c99 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:43.433107 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3d0ed2-9f55-4b16-be98-e3cfeedd4c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:43.433387 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3d0ed2-9f55-4b16-be98-e3cfeedd4c99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:43.434515 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3d0ed2-9f55-4b16-be98-e3cfeedd4c99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:43.436208 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3d0ed2-9f55-4b16-be98-e3cfeedd4c99 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:43.449941 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 955/1948] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:18:43 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:18:43.454016 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15f806a-80e4-4c1c-8a64-09ccb4053642 service nova] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:43.467240 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15f806a-80e4-4c1c-8a64-09ccb4053642 service nova] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:43.474220 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb5ee75-b982-4359-a657-21729a9c51fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:43.475387 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5ee75-b982-4359-a657-21729a9c51fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:43.475960 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5ee75-b982-4359-a657-21729a9c51fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:43.476337 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5ee75-b982-4359-a657-21729a9c51fd admin admin] PATH_INFO: `/v3/projects/4b6375c720704770807205893747215c/users/940f2ec947c846ea9e6811ed6417cb87/roles/965049e7ce6144aaad23c15f3a5e37c3` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:43.478831 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb5ee75-b982-4359-a657-21729a9c51fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b6375c720704770807205893747215c, user_id=940f2ec947c846ea9e6811ed6417cb87, role_id=965049e7ce6144aaad23c15f3a5e37c3)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:43.482017 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb5ee75-b982-4359-a657-21729a9c51fd admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:43.496880 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 994/1949] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:18:43 2022] PUT /identity/v3/projects/4b6375c720704770807205893747215c/users/940f2ec947c846ea9e6811ed6417cb87/roles/965049e7ce6144aaad23c15f3a5e37c3 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:18:43.507991 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf253b-5fc4-4d4b-8642-9543e7f02404 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:43.509014 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf253b-5fc4-4d4b-8642-9543e7f02404 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:43.509324 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf253b-5fc4-4d4b-8642-9543e7f02404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:43.564150 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-8cdf253b-5fc4-4d4b-8642-9543e7f02404 None None] MFA Rules not processed for user `940f2ec947c846ea9e6811ed6417cb87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:18:43.569778 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-8cdf253b-5fc4-4d4b-8642-9543e7f02404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:43.699288 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 956/1950] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:18:43 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:18:43.713474 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb5ee75-b982-4359-a657-21729a9c51fd admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:43.715467 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-3bb5ee75-b982-4359-a657-21729a9c51fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:43.819642 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb5ee75-b982-4359-a657-21729a9c51fd admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:43.831030 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2562b4ca-89c8-4467-82a8-1347fdb28f1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f86373d65440da97c853fff3c1d0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:43.831945 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2562b4ca-89c8-4467-82a8-1347fdb28f1d service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:43.832391 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2562b4ca-89c8-4467-82a8-1347fdb28f1d service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:43.832675 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2562b4ca-89c8-4467-82a8-1347fdb28f1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:43.851727 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:43.862576 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2562b4ca-89c8-4467-82a8-1347fdb28f1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:43.864752 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2562b4ca-89c8-4467-82a8-1347fdb28f1d service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:43.895627 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 995/1951] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:18:43 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:18:44.088374 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdf253b-5fc4-4d4b-8642-9543e7f02404 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:44.115255 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdf253b-5fc4-4d4b-8642-9543e7f02404 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:44.126854 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3d3d84-4056-495c-acbb-e93e1f0a7ebb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f86373d65440da97c853fff3c1d0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:44.127641 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d3d84-4056-495c-acbb-e93e1f0a7ebb service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:44.127952 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d3d84-4056-495c-acbb-e93e1f0a7ebb service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:44.128324 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d3d84-4056-495c-acbb-e93e1f0a7ebb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:44.259469 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:44.334132 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3d3d84-4056-495c-acbb-e93e1f0a7ebb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:44.335793 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3d3d84-4056-495c-acbb-e93e1f0a7ebb service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:44.372093 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 957/1952] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:18:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:18:44.912309 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2562b4ca-89c8-4467-82a8-1347fdb28f1d service cinder] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:45.046351 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2562b4ca-89c8-4467-82a8-1347fdb28f1d service cinder] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:45.051807 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0334967-bc63-4849-80d8-02d15a898da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:45.053208 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0334967-bc63-4849-80d8-02d15a898da1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:45.053208 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0334967-bc63-4849-80d8-02d15a898da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:45.053406 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0334967-bc63-4849-80d8-02d15a898da1 admin admin] PATH_INFO: `/v3/users/26c5aca4e0564f85a4be76378846060f` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:45.054528 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0334967-bc63-4849-80d8-02d15a898da1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26c5aca4e0564f85a4be76378846060f)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:45.056552 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0334967-bc63-4849-80d8-02d15a898da1 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:45.130093 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a0334967-bc63-4849-80d8-02d15a898da1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26c5aca4e0564f85a4be76378846060f'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:45.150419 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a0334967-bc63-4849-80d8-02d15a898da1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26c5aca4e0564f85a4be76378846060f'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:45.158250 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a0334967-bc63-4849-80d8-02d15a898da1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26c5aca4e0564f85a4be76378846060f'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:45.159021 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a0334967-bc63-4849-80d8-02d15a898da1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26c5aca4e0564f85a4be76378846060f'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:45.189634 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a0334967-bc63-4849-80d8-02d15a898da1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26c5aca4e0564f85a4be76378846060f'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:45.212985 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 996/1953] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:18:44 2022] DELETE /identity/v3/users/26c5aca4e0564f85a4be76378846060f => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:18:45.217964 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febba8e4-9857-4fae-bb12-28a531ba4db7 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:45.218978 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febba8e4-9857-4fae-bb12-28a531ba4db7 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:45.219339 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febba8e4-9857-4fae-bb12-28a531ba4db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:45.284111 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-febba8e4-9857-4fae-bb12-28a531ba4db7 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:18:45.285813 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-febba8e4-9857-4fae-bb12-28a531ba4db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:45.377120 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 958/1954] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:18:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:18:45.389691 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0334967-bc63-4849-80d8-02d15a898da1 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:45.391419 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-a0334967-bc63-4849-80d8-02d15a898da1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:45.507706 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0334967-bc63-4849-80d8-02d15a898da1 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:45.515675 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc67b94-7d52-41f3-a388-1431f64d943a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:45.516389 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc67b94-7d52-41f3-a388-1431f64d943a service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:45.516677 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc67b94-7d52-41f3-a388-1431f64d943a service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:45.516954 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc67b94-7d52-41f3-a388-1431f64d943a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:45.538092 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc67b94-7d52-41f3-a388-1431f64d943a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:45.539841 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc67b94-7d52-41f3-a388-1431f64d943a service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:45.564625 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 997/1955] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:18:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:18:45.674945 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febba8e4-9857-4fae-bb12-28a531ba4db7 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:45.678633 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-febba8e4-9857-4fae-bb12-28a531ba4db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:45.702064 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febba8e4-9857-4fae-bb12-28a531ba4db7 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:45.726980 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcca37e-f281-4774-bea4-0f765f2828cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:45.739095 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcca37e-f281-4774-bea4-0f765f2828cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:45.739095 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcca37e-f281-4774-bea4-0f765f2828cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:45.739095 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcca37e-f281-4774-bea4-0f765f2828cc admin admin] PATH_INFO: `/v3/users/d6de0bd708764873a44d23274f5ffb95` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:45.739095 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcca37e-f281-4774-bea4-0f765f2828cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6de0bd708764873a44d23274f5ffb95)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:45.740545 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcca37e-f281-4774-bea4-0f765f2828cc admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:45.817546 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-6fcca37e-f281-4774-bea4-0f765f2828cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6de0bd708764873a44d23274f5ffb95'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:45.818338 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-6fcca37e-f281-4774-bea4-0f765f2828cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6de0bd708764873a44d23274f5ffb95'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:45.832596 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-6fcca37e-f281-4774-bea4-0f765f2828cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6de0bd708764873a44d23274f5ffb95'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:45.834628 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-6fcca37e-f281-4774-bea4-0f765f2828cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6de0bd708764873a44d23274f5ffb95'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:45.855117 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-6fcca37e-f281-4774-bea4-0f765f2828cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6de0bd708764873a44d23274f5ffb95'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:45.878186 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 959/1956] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:18:45 2022] DELETE /identity/v3/users/d6de0bd708764873a44d23274f5ffb95 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:18:45.879545 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed18dc88-68b1-48fc-8131-d06fb18578c2 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:45.879809 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed18dc88-68b1-48fc-8131-d06fb18578c2 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:45.880209 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed18dc88-68b1-48fc-8131-d06fb18578c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:45.921393 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-ed18dc88-68b1-48fc-8131-d06fb18578c2 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:18:45.924846 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-ed18dc88-68b1-48fc-8131-d06fb18578c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:45.953560 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:46.066791 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 998/1957] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:18:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:18:46.083026 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcca37e-f281-4774-bea4-0f765f2828cc admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:46.084444 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6fcca37e-f281-4774-bea4-0f765f2828cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:46.148354 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed18dc88-68b1-48fc-8131-d06fb18578c2 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:46.150021 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-ed18dc88-68b1-48fc-8131-d06fb18578c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:46.171519 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:46.185120 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed18dc88-68b1-48fc-8131-d06fb18578c2 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:46.201992 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc54de03-70b6-4c3e-8bc6-3339ff7351ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:46.203157 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc54de03-70b6-4c3e-8bc6-3339ff7351ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:46.204319 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc54de03-70b6-4c3e-8bc6-3339ff7351ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:46.211668 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc54de03-70b6-4c3e-8bc6-3339ff7351ce admin admin] PATH_INFO: `/v3/projects/c9e3d9bfc7154cb28140cfd90878e1bd` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:46.219035 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc54de03-70b6-4c3e-8bc6-3339ff7351ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9e3d9bfc7154cb28140cfd90878e1bd)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:46.220993 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc54de03-70b6-4c3e-8bc6-3339ff7351ce admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:46.225220 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcca37e-f281-4774-bea4-0f765f2828cc admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:46.236184 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eed9c6-196e-4475-9081-4da6cb5666a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:46.237016 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eed9c6-196e-4475-9081-4da6cb5666a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:46.237384 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eed9c6-196e-4475-9081-4da6cb5666a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:46.237751 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eed9c6-196e-4475-9081-4da6cb5666a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:46.251821 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eed9c6-196e-4475-9081-4da6cb5666a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:46.254139 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eed9c6-196e-4475-9081-4da6cb5666a9 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:46.267598 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 960/1958] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:18:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:18:46.297732 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-dc54de03-70b6-4c3e-8bc6-3339ff7351ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9e3d9bfc7154cb28140cfd90878e1bd', 'request_id': 'req-dc54de03-70b6-4c3e-8bc6-3339ff7351ce'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:46.318372 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-dc54de03-70b6-4c3e-8bc6-3339ff7351ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9e3d9bfc7154cb28140cfd90878e1bd', 'request_id': 'req-dc54de03-70b6-4c3e-8bc6-3339ff7351ce'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:46.326705 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-dc54de03-70b6-4c3e-8bc6-3339ff7351ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9e3d9bfc7154cb28140cfd90878e1bd', 'request_id': 'req-dc54de03-70b6-4c3e-8bc6-3339ff7351ce'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:46.341068 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-dc54de03-70b6-4c3e-8bc6-3339ff7351ce admin admin] The token cache is being invalidate because project c9e3d9bfc7154cb28140cfd90878e1bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:18:46.341068 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-dc54de03-70b6-4c3e-8bc6-3339ff7351ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:46.341847 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-dc54de03-70b6-4c3e-8bc6-3339ff7351ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:46.343699 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 999/1959] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:18:46 2022] DELETE /identity/v3/projects/c9e3d9bfc7154cb28140cfd90878e1bd => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:18:46.348027 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eed9c6-196e-4475-9081-4da6cb5666a9 service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:46.358459 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eed9c6-196e-4475-9081-4da6cb5666a9 service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:46.427745 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70e5e9e-99ac-4d64-9ac6-08e563ec913b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:46.428758 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e5e9e-99ac-4d64-9ac6-08e563ec913b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:46.429041 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e5e9e-99ac-4d64-9ac6-08e563ec913b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:46.429318 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e5e9e-99ac-4d64-9ac6-08e563ec913b admin admin] PATH_INFO: `/v3/users/940f2ec947c846ea9e6811ed6417cb87` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:46.430575 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70e5e9e-99ac-4d64-9ac6-08e563ec913b admin admin] RBAC: Authorizing `identity:delete_user(user_id=940f2ec947c846ea9e6811ed6417cb87)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:46.432624 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70e5e9e-99ac-4d64-9ac6-08e563ec913b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:46.554080 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c70e5e9e-99ac-4d64-9ac6-08e563ec913b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '940f2ec947c846ea9e6811ed6417cb87'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:46.554855 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c70e5e9e-99ac-4d64-9ac6-08e563ec913b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '940f2ec947c846ea9e6811ed6417cb87'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:46.573408 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c70e5e9e-99ac-4d64-9ac6-08e563ec913b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '940f2ec947c846ea9e6811ed6417cb87'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:46.577752 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c70e5e9e-99ac-4d64-9ac6-08e563ec913b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '940f2ec947c846ea9e6811ed6417cb87'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:46.619452 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c70e5e9e-99ac-4d64-9ac6-08e563ec913b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '940f2ec947c846ea9e6811ed6417cb87'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:46.640933 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 961/1960] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:18:46 2022] DELETE /identity/v3/users/940f2ec947c846ea9e6811ed6417cb87 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:18:47.091417 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc54de03-70b6-4c3e-8bc6-3339ff7351ce admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:47.093148 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-dc54de03-70b6-4c3e-8bc6-3339ff7351ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:47.115274 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc54de03-70b6-4c3e-8bc6-3339ff7351ce admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:47.263312 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b820a-ed46-45f3-a996-b2b80dd40547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:47.264796 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b820a-ed46-45f3-a996-b2b80dd40547 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:47.265773 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b820a-ed46-45f3-a996-b2b80dd40547 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:47.266317 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b820a-ed46-45f3-a996-b2b80dd40547 admin admin] PATH_INFO: `/v3/projects/a23c183b31dc4bfa9d1d3a02ec49797f` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:47.269049 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042b820a-ed46-45f3-a996-b2b80dd40547 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a23c183b31dc4bfa9d1d3a02ec49797f)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:47.272375 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042b820a-ed46-45f3-a996-b2b80dd40547 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:47.328688 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70e5e9e-99ac-4d64-9ac6-08e563ec913b admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:47.330345 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c70e5e9e-99ac-4d64-9ac6-08e563ec913b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:47.352606 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70e5e9e-99ac-4d64-9ac6-08e563ec913b admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:47.365739 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:47.372932 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-042b820a-ed46-45f3-a996-b2b80dd40547 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a23c183b31dc4bfa9d1d3a02ec49797f', 'request_id': 'req-042b820a-ed46-45f3-a996-b2b80dd40547'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:47.389400 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-042b820a-ed46-45f3-a996-b2b80dd40547 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a23c183b31dc4bfa9d1d3a02ec49797f', 'request_id': 'req-042b820a-ed46-45f3-a996-b2b80dd40547'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:47.405627 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-042b820a-ed46-45f3-a996-b2b80dd40547 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a23c183b31dc4bfa9d1d3a02ec49797f', 'request_id': 'req-042b820a-ed46-45f3-a996-b2b80dd40547'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:47.423456 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-042b820a-ed46-45f3-a996-b2b80dd40547 admin admin] The token cache is being invalidate because project a23c183b31dc4bfa9d1d3a02ec49797f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:18:47.425688 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-042b820a-ed46-45f3-a996-b2b80dd40547 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:47.426554 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-042b820a-ed46-45f3-a996-b2b80dd40547 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:47.429324 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1000/1961] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:18:47 2022] DELETE /identity/v3/projects/a23c183b31dc4bfa9d1d3a02ec49797f => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:18:47.433354 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b820a-ed46-45f3-a996-b2b80dd40547 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:47.435528 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-042b820a-ed46-45f3-a996-b2b80dd40547 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:47.446679 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9832cd3-f6b7-4a90-b022-ff731f15d12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:47.447808 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9832cd3-f6b7-4a90-b022-ff731f15d12a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:47.448301 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9832cd3-f6b7-4a90-b022-ff731f15d12a admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:47.448824 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9832cd3-f6b7-4a90-b022-ff731f15d12a admin admin] PATH_INFO: `/v3/projects/4b6375c720704770807205893747215c` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:47.451683 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9832cd3-f6b7-4a90-b022-ff731f15d12a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b6375c720704770807205893747215c)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:47.454838 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9832cd3-f6b7-4a90-b022-ff731f15d12a admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:47.465036 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:47.545481 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b820a-ed46-45f3-a996-b2b80dd40547 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:47.547110 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-f9832cd3-f6b7-4a90-b022-ff731f15d12a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b6375c720704770807205893747215c', 'request_id': 'req-f9832cd3-f6b7-4a90-b022-ff731f15d12a'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:47.555864 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-f9832cd3-f6b7-4a90-b022-ff731f15d12a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b6375c720704770807205893747215c', 'request_id': 'req-f9832cd3-f6b7-4a90-b022-ff731f15d12a'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:47.569442 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-f9832cd3-f6b7-4a90-b022-ff731f15d12a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b6375c720704770807205893747215c', 'request_id': 'req-f9832cd3-f6b7-4a90-b022-ff731f15d12a'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:47.583794 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-f9832cd3-f6b7-4a90-b022-ff731f15d12a admin admin] The token cache is being invalidate because project 4b6375c720704770807205893747215c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:18:47.584209 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-f9832cd3-f6b7-4a90-b022-ff731f15d12a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:47.584879 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-f9832cd3-f6b7-4a90-b022-ff731f15d12a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:47.590097 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 962/1962] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:18:47 2022] DELETE /identity/v3/projects/4b6375c720704770807205893747215c => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:18:47.592180 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee9823-871a-4ab2-87c4-06893e5b6c25 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:47.592517 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee9823-871a-4ab2-87c4-06893e5b6c25 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:47.592802 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee9823-871a-4ab2-87c4-06893e5b6c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:47.615080 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-82ee9823-871a-4ab2-87c4-06893e5b6c25 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:18:47.616429 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-82ee9823-871a-4ab2-87c4-06893e5b6c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:47.626713 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2cd008-3521-47f6-b38a-194cb285e636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:47.628264 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2cd008-3521-47f6-b38a-194cb285e636 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:47.628264 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2cd008-3521-47f6-b38a-194cb285e636 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:47.628706 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2cd008-3521-47f6-b38a-194cb285e636 admin admin] PATH_INFO: `/v3/users/57e7033338f44cb59685c24d0a2b042d` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:47.630075 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2cd008-3521-47f6-b38a-194cb285e636 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57e7033338f44cb59685c24d0a2b042d)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:47.632259 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2cd008-3521-47f6-b38a-194cb285e636 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:47.693465 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 963/1963] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:18:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:18:47.701683 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba2ae7-69a5-46ff-a26f-6bf92f340a1f None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:47.701962 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba2ae7-69a5-46ff-a26f-6bf92f340a1f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:47.702340 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba2ae7-69a5-46ff-a26f-6bf92f340a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:47.711739 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-cd2cd008-3521-47f6-b38a-194cb285e636 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57e7033338f44cb59685c24d0a2b042d'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:47.725970 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-cd2cd008-3521-47f6-b38a-194cb285e636 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57e7033338f44cb59685c24d0a2b042d'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:47.727220 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-83ba2ae7-69a5-46ff-a26f-6bf92f340a1f None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:18:47.727681 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-cd2cd008-3521-47f6-b38a-194cb285e636 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57e7033338f44cb59685c24d0a2b042d'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:47.728723 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-83ba2ae7-69a5-46ff-a26f-6bf92f340a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:47.729571 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-cd2cd008-3521-47f6-b38a-194cb285e636 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57e7033338f44cb59685c24d0a2b042d'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:47.738052 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 964/1964] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:18:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:18:47.742341 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba2ae7-69a5-46ff-a26f-6bf92f340a1f None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:47.750943 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-cd2cd008-3521-47f6-b38a-194cb285e636 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57e7033338f44cb59685c24d0a2b042d'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:47.753588 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba2ae7-69a5-46ff-a26f-6bf92f340a1f None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:47.758764 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cafecf-5c6c-41d0-a42d-0880c4466c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:47.759513 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cafecf-5c6c-41d0-a42d-0880c4466c73 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:47.759889 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cafecf-5c6c-41d0-a42d-0880c4466c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:47.760362 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cafecf-5c6c-41d0-a42d-0880c4466c73 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:47.761261 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cafecf-5c6c-41d0-a42d-0880c4466c73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:18:47.761577 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cafecf-5c6c-41d0-a42d-0880c4466c73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:47.763288 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cafecf-5c6c-41d0-a42d-0880c4466c73 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:47.765222 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:47.777815 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1001/1965] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:18:47 2022] DELETE /identity/v3/users/57e7033338f44cb59685c24d0a2b042d => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:18:47.781901 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 965/1966] 10.222.0.42 () {58 vars in 1152 bytes} [Mon Jul 4 09:18:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:18:47.789150 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2cd008-3521-47f6-b38a-194cb285e636 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:47.908162 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2cd008-3521-47f6-b38a-194cb285e636 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:47.914438 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375c5ace-8c76-4f2b-947c-ee8da076dc49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:47.915503 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c5ace-8c76-4f2b-947c-ee8da076dc49 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:47.915897 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c5ace-8c76-4f2b-947c-ee8da076dc49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:47.916259 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c5ace-8c76-4f2b-947c-ee8da076dc49 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:47.917078 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375c5ace-8c76-4f2b-947c-ee8da076dc49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:47.919940 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375c5ace-8c76-4f2b-947c-ee8da076dc49 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:47.965403 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1002/1967] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:18:47 2022] POST /identity/v3/projects => generated 377 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:18:47.966691 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cafecf-5c6c-41d0-a42d-0880c4466c73 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:47.989333 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cafecf-5c6c-41d0-a42d-0880c4466c73 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:48.125802 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93d858a-dbd1-4156-baee-f8c0f7b417b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:48.126518 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d858a-dbd1-4156-baee-f8c0f7b417b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:48.126800 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d858a-dbd1-4156-baee-f8c0f7b417b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:48.127080 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d858a-dbd1-4156-baee-f8c0f7b417b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:48.128145 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93d858a-dbd1-4156-baee-f8c0f7b417b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:48.129850 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93d858a-dbd1-4156-baee-f8c0f7b417b8 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:48.170823 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 966/1968] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:18:47 2022] POST /identity/v3/users => generated 289 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:18:48.175599 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375c5ace-8c76-4f2b-947c-ee8da076dc49 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:48.190715 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375c5ace-8c76-4f2b-947c-ee8da076dc49 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:48.195536 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c9639-b52a-4380-867f-119e1c9b7ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:48.196847 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c9639-b52a-4380-867f-119e1c9b7ff0 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:48.197133 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c9639-b52a-4380-867f-119e1c9b7ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:48.199430 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c9639-b52a-4380-867f-119e1c9b7ff0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:48.200257 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875c9639-b52a-4380-867f-119e1c9b7ff0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:48.202182 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875c9639-b52a-4380-867f-119e1c9b7ff0 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:48.220526 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93d858a-dbd1-4156-baee-f8c0f7b417b8 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:48.228448 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1003/1969] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:18:48 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:18:48.229527 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:48.244988 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93d858a-dbd1-4156-baee-f8c0f7b417b8 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:48.251967 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b98a411-fe7d-4965-940d-b3e8b11038aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:48.252896 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b98a411-fe7d-4965-940d-b3e8b11038aa admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:48.253180 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b98a411-fe7d-4965-940d-b3e8b11038aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:48.253498 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b98a411-fe7d-4965-940d-b3e8b11038aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:48.256415 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b98a411-fe7d-4965-940d-b3e8b11038aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:48.259961 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b98a411-fe7d-4965-940d-b3e8b11038aa admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:48.287901 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c9639-b52a-4380-867f-119e1c9b7ff0 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:48.296701 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 967/1970] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:18:48 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:18:48.309579 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c9639-b52a-4380-867f-119e1c9b7ff0 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:48.320559 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b12dad-3fbd-4741-add3-386bbd521663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:48.321709 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b12dad-3fbd-4741-add3-386bbd521663 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:48.321902 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b12dad-3fbd-4741-add3-386bbd521663 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:48.322153 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b12dad-3fbd-4741-add3-386bbd521663 admin admin] PATH_INFO: `/v3/projects/2791b92dfb1e4b81ae6d8a009c6f9da5/users/140b3e578b89423da615c826585d7a8b/roles/81634e7812344f84afcb29b0dba2687c` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:48.324571 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b98a411-fe7d-4965-940d-b3e8b11038aa admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:48.326606 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0b98a411-fe7d-4965-940d-b3e8b11038aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:48.349121 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b98a411-fe7d-4965-940d-b3e8b11038aa admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:48.350821 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b12dad-3fbd-4741-add3-386bbd521663 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2791b92dfb1e4b81ae6d8a009c6f9da5, user_id=140b3e578b89423da615c826585d7a8b, role_id=81634e7812344f84afcb29b0dba2687c)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:48.356174 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b12dad-3fbd-4741-add3-386bbd521663 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:48.356454 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a3fe1c-f022-4996-9f7e-8822f1a94e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:48.357395 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a3fe1c-f022-4996-9f7e-8822f1a94e78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:48.357748 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a3fe1c-f022-4996-9f7e-8822f1a94e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:48.358096 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a3fe1c-f022-4996-9f7e-8822f1a94e78 admin admin] PATH_INFO: `/v3/projects/3c7bdfabb2994315a48903248be5f159` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:48.359376 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a3fe1c-f022-4996-9f7e-8822f1a94e78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c7bdfabb2994315a48903248be5f159)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:48.361433 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a3fe1c-f022-4996-9f7e-8822f1a94e78 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:48.389144 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1004/1971] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:18:48 2022] PUT /identity/v3/projects/2791b92dfb1e4b81ae6d8a009c6f9da5/users/140b3e578b89423da615c826585d7a8b/roles/81634e7812344f84afcb29b0dba2687c => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:18:48.391002 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4779bf17-452d-4c62-9b05-bd68a2ce5454 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:48.391345 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4779bf17-452d-4c62-9b05-bd68a2ce5454 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:48.391630 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4779bf17-452d-4c62-9b05-bd68a2ce5454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:48.446076 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-4779bf17-452d-4c62-9b05-bd68a2ce5454 None None] MFA Rules not processed for user `140b3e578b89423da615c826585d7a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:18:48.448116 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-4779bf17-452d-4c62-9b05-bd68a2ce5454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:48.477309 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-72a3fe1c-f022-4996-9f7e-8822f1a94e78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c7bdfabb2994315a48903248be5f159', 'request_id': 'req-72a3fe1c-f022-4996-9f7e-8822f1a94e78'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:48.495073 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-72a3fe1c-f022-4996-9f7e-8822f1a94e78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c7bdfabb2994315a48903248be5f159', 'request_id': 'req-72a3fe1c-f022-4996-9f7e-8822f1a94e78'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:48.508832 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-72a3fe1c-f022-4996-9f7e-8822f1a94e78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c7bdfabb2994315a48903248be5f159', 'request_id': 'req-72a3fe1c-f022-4996-9f7e-8822f1a94e78'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:48.537381 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-72a3fe1c-f022-4996-9f7e-8822f1a94e78 admin admin] The token cache is being invalidate because project 3c7bdfabb2994315a48903248be5f159 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:18:48.537675 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-72a3fe1c-f022-4996-9f7e-8822f1a94e78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:48.539113 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-72a3fe1c-f022-4996-9f7e-8822f1a94e78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:48.542132 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 968/1972] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:18:48 2022] DELETE /identity/v3/projects/3c7bdfabb2994315a48903248be5f159 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:18:48.547127 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0db09-61c3-4d74-8d71-ad5e0d3adec7 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:48.547418 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0db09-61c3-4d74-8d71-ad5e0d3adec7 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:48.547701 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0db09-61c3-4d74-8d71-ad5e0d3adec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:48.561267 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1005/1973] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:18:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:18:48.570765 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4779bf17-452d-4c62-9b05-bd68a2ce5454 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:48.573727 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-4779bf17-452d-4c62-9b05-bd68a2ce5454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:48.590804 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-16a0db09-61c3-4d74-8d71-ad5e0d3adec7 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:18:48.592877 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-16a0db09-61c3-4d74-8d71-ad5e0d3adec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:48.659751 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:48.694181 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4779bf17-452d-4c62-9b05-bd68a2ce5454 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:48.706360 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3f70ba-d98f-4a63-8b93-c08d9b516c00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f86373d65440da97c853fff3c1d0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:48.707607 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f70ba-d98f-4a63-8b93-c08d9b516c00 service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:48.708091 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f70ba-d98f-4a63-8b93-c08d9b516c00 service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:48.709638 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f70ba-d98f-4a63-8b93-c08d9b516c00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:48.711305 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-0a3f70ba-d98f-4a63-8b93-c08d9b516c00 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:48.731746 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3f70ba-d98f-4a63-8b93-c08d9b516c00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:48.733253 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3f70ba-d98f-4a63-8b93-c08d9b516c00 service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:48.752918 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1006/1974] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:18:48 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:18:48.793475 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 969/1975] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:18:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:18:48.801053 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ec5be-0c67-41d2-bb33-459696f8f3d4 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:48.801654 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ec5be-0c67-41d2-bb33-459696f8f3d4 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:48.801966 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ec5be-0c67-41d2-bb33-459696f8f3d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:48.823754 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-4b7ec5be-0c67-41d2-bb33-459696f8f3d4 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:18:48.825408 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-4b7ec5be-0c67-41d2-bb33-459696f8f3d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:48.843462 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1007/1976] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:18:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:18:48.847846 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a0db09-61c3-4d74-8d71-ad5e0d3adec7 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:48.863812 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a0db09-61c3-4d74-8d71-ad5e0d3adec7 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:48.869458 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01923cdc-5519-402c-b8b4-9b1b66b8f281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:48.870319 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01923cdc-5519-402c-b8b4-9b1b66b8f281 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:48.870753 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01923cdc-5519-402c-b8b4-9b1b66b8f281 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:48.871221 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01923cdc-5519-402c-b8b4-9b1b66b8f281 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:48.872334 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01923cdc-5519-402c-b8b4-9b1b66b8f281 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:18:48.872793 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01923cdc-5519-402c-b8b4-9b1b66b8f281 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:48.874702 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01923cdc-5519-402c-b8b4-9b1b66b8f281 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:48.889528 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 970/1977] 10.222.0.42 () {58 vars in 1152 bytes} [Mon Jul 4 09:18:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:18:48.893516 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7ec5be-0c67-41d2-bb33-459696f8f3d4 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:48.903252 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7ec5be-0c67-41d2-bb33-459696f8f3d4 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:48.908409 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76c427b-6013-4e23-b0fa-1edbd71dd01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:48.909087 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c427b-6013-4e23-b0fa-1edbd71dd01f admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:48.909373 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c427b-6013-4e23-b0fa-1edbd71dd01f admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:48.909646 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c427b-6013-4e23-b0fa-1edbd71dd01f admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:48.910371 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76c427b-6013-4e23-b0fa-1edbd71dd01f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:48.912298 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76c427b-6013-4e23-b0fa-1edbd71dd01f admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:48.952884 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1008/1978] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:18:48 2022] POST /identity/v3/projects => generated 389 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:18:48.954505 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01923cdc-5519-402c-b8b4-9b1b66b8f281 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:48.966944 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01923cdc-5519-402c-b8b4-9b1b66b8f281 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:49.062336 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decf8d50-ec14-4960-9c76-cd85f0459af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:49.063021 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf8d50-ec14-4960-9c76-cd85f0459af0 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:49.063302 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf8d50-ec14-4960-9c76-cd85f0459af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:49.063590 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf8d50-ec14-4960-9c76-cd85f0459af0 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:49.064499 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decf8d50-ec14-4960-9c76-cd85f0459af0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:49.066749 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decf8d50-ec14-4960-9c76-cd85f0459af0 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:49.075098 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:49.095101 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 971/1979] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:18:48 2022] POST /identity/v3/users => generated 295 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:18:49.099668 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76c427b-6013-4e23-b0fa-1edbd71dd01f admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:49.122920 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76c427b-6013-4e23-b0fa-1edbd71dd01f admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:49.132216 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee28b00-f94a-48c9-b7ea-e4cf41f58a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:49.132949 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee28b00-f94a-48c9-b7ea-e4cf41f58a32 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:49.133390 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee28b00-f94a-48c9-b7ea-e4cf41f58a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:49.133724 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee28b00-f94a-48c9-b7ea-e4cf41f58a32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:49.134667 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee28b00-f94a-48c9-b7ea-e4cf41f58a32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:49.136267 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee28b00-f94a-48c9-b7ea-e4cf41f58a32 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:49.163675 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1009/1980] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:18:49 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:18:49.167827 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decf8d50-ec14-4960-9c76-cd85f0459af0 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:49.191310 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decf8d50-ec14-4960-9c76-cd85f0459af0 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:49.200655 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cf0d3f-ad2f-4c79-bcf9-744ebe95f02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:49.201385 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf0d3f-ad2f-4c79-bcf9-744ebe95f02e admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:49.201886 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf0d3f-ad2f-4c79-bcf9-744ebe95f02e admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:49.202234 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf0d3f-ad2f-4c79-bcf9-744ebe95f02e admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:49.203103 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cf0d3f-ad2f-4c79-bcf9-744ebe95f02e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:49.205701 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cf0d3f-ad2f-4c79-bcf9-744ebe95f02e admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:49.239234 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 972/1981] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:18:49 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:18:49.243464 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee28b00-f94a-48c9-b7ea-e4cf41f58a32 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:49.255411 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee28b00-f94a-48c9-b7ea-e4cf41f58a32 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:49.276632 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63bf47a-a494-4fa5-bb24-c2b817346ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:49.277753 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63bf47a-a494-4fa5-bb24-c2b817346ee6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:49.278106 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63bf47a-a494-4fa5-bb24-c2b817346ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:49.278453 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63bf47a-a494-4fa5-bb24-c2b817346ee6 admin admin] PATH_INFO: `/v3/projects/0e9b449d3276473b9d62f4e8b9d7a9cb/users/155e4e189da44b75a103925f5c87f227/roles/81634e7812344f84afcb29b0dba2687c` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:49.307347 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63bf47a-a494-4fa5-bb24-c2b817346ee6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e9b449d3276473b9d62f4e8b9d7a9cb, user_id=155e4e189da44b75a103925f5c87f227, role_id=81634e7812344f84afcb29b0dba2687c)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:49.310566 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63bf47a-a494-4fa5-bb24-c2b817346ee6 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:49.331545 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1010/1982] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:18:49 2022] PUT /identity/v3/projects/0e9b449d3276473b9d62f4e8b9d7a9cb/users/155e4e189da44b75a103925f5c87f227/roles/81634e7812344f84afcb29b0dba2687c => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:18:49.343602 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63612fb8-2d91-4156-b583-3dde6e1ece8c None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:49.343916 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63612fb8-2d91-4156-b583-3dde6e1ece8c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:49.344199 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63612fb8-2d91-4156-b583-3dde6e1ece8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:49.404948 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-63612fb8-2d91-4156-b583-3dde6e1ece8c None None] MFA Rules not processed for user `155e4e189da44b75a103925f5c87f227`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:18:49.407346 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-63612fb8-2d91-4156-b583-3dde6e1ece8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:49.505762 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 973/1983] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:18:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:18:49.510450 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63bf47a-a494-4fa5-bb24-c2b817346ee6 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:49.596088 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63bf47a-a494-4fa5-bb24-c2b817346ee6 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:49.601108 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac19fb3-f2b1-43a9-8ce6-afb139cb7e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:49.602215 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac19fb3-f2b1-43a9-8ce6-afb139cb7e99 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:49.602215 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac19fb3-f2b1-43a9-8ce6-afb139cb7e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:49.602417 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac19fb3-f2b1-43a9-8ce6-afb139cb7e99 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:49.602993 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac19fb3-f2b1-43a9-8ce6-afb139cb7e99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:49.604958 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac19fb3-f2b1-43a9-8ce6-afb139cb7e99 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:49.639554 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1011/1984] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:18:49 2022] POST /identity/v3/projects => generated 389 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:18:49.643346 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63612fb8-2d91-4156-b583-3dde6e1ece8c None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:49.657696 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63612fb8-2d91-4156-b583-3dde6e1ece8c None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:49.745427 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b65c2-fc5a-40b6-bb26-8c6fd7c5b732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:49.746225 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b65c2-fc5a-40b6-bb26-8c6fd7c5b732 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:49.746505 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b65c2-fc5a-40b6-bb26-8c6fd7c5b732 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:49.746780 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b65c2-fc5a-40b6-bb26-8c6fd7c5b732 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:49.747609 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62b65c2-fc5a-40b6-bb26-8c6fd7c5b732 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:49.749781 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62b65c2-fc5a-40b6-bb26-8c6fd7c5b732 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:49.772855 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 974/1985] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:18:49 2022] POST /identity/v3/users => generated 301 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:18:49.776519 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac19fb3-f2b1-43a9-8ce6-afb139cb7e99 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:49.787569 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac19fb3-f2b1-43a9-8ce6-afb139cb7e99 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:49.792306 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4237d1e9-eb2e-4453-a50c-d50d1f0209d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:49.793080 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237d1e9-eb2e-4453-a50c-d50d1f0209d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:49.793424 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237d1e9-eb2e-4453-a50c-d50d1f0209d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:49.793765 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237d1e9-eb2e-4453-a50c-d50d1f0209d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:49.794504 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4237d1e9-eb2e-4453-a50c-d50d1f0209d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:49.796139 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4237d1e9-eb2e-4453-a50c-d50d1f0209d4 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:49.807458 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1012/1986] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:18:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:18:49.811768 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b65c2-fc5a-40b6-bb26-8c6fd7c5b732 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:49.821702 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b65c2-fc5a-40b6-bb26-8c6fd7c5b732 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:49.826728 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c7b69e-4c94-49d5-ad49-c497b90738c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:49.827679 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c7b69e-4c94-49d5-ad49-c497b90738c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:49.828038 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c7b69e-4c94-49d5-ad49-c497b90738c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:49.828311 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c7b69e-4c94-49d5-ad49-c497b90738c1 admin admin] PATH_INFO: `/v3/projects/db9e7d4d2e424fbd892dcd7734718857/users/ef50e7fb69414b84bf64592fe3a4531f/roles/965049e7ce6144aaad23c15f3a5e37c3` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:49.843837 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c7b69e-4c94-49d5-ad49-c497b90738c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db9e7d4d2e424fbd892dcd7734718857, user_id=ef50e7fb69414b84bf64592fe3a4531f, role_id=965049e7ce6144aaad23c15f3a5e37c3)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:49.846555 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c7b69e-4c94-49d5-ad49-c497b90738c1 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:49.864635 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 975/1987] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:18:49 2022] PUT /identity/v3/projects/db9e7d4d2e424fbd892dcd7734718857/users/ef50e7fb69414b84bf64592fe3a4531f/roles/965049e7ce6144aaad23c15f3a5e37c3 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:18:49.869279 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4237d1e9-eb2e-4453-a50c-d50d1f0209d4 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:49.879962 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4237d1e9-eb2e-4453-a50c-d50d1f0209d4 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:49.950734 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:49.966238 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cb6531-880b-42b4-a43d-006c7dd61588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:49.967178 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb6531-880b-42b4-a43d-006c7dd61588 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:49.967676 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb6531-880b-42b4-a43d-006c7dd61588 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:49.968261 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb6531-880b-42b4-a43d-006c7dd61588 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:49.969351 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cb6531-880b-42b4-a43d-006c7dd61588 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:49.971242 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cb6531-880b-42b4-a43d-006c7dd61588 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:49.985129 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1013/1988] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:18:49 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:18:49.989479 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c7b69e-4c94-49d5-ad49-c497b90738c1 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:50.001863 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c7b69e-4c94-49d5-ad49-c497b90738c1 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:50.006655 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27800403-dab8-4e4e-a6b4-78059c5170bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:50.007554 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27800403-dab8-4e4e-a6b4-78059c5170bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:50.007841 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27800403-dab8-4e4e-a6b4-78059c5170bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:50.008355 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27800403-dab8-4e4e-a6b4-78059c5170bc admin admin] PATH_INFO: `/v3/projects/db9e7d4d2e424fbd892dcd7734718857/users/ef50e7fb69414b84bf64592fe3a4531f/roles/965049e7ce6144aaad23c15f3a5e37c3` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:50.010464 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27800403-dab8-4e4e-a6b4-78059c5170bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=db9e7d4d2e424fbd892dcd7734718857, user_id=ef50e7fb69414b84bf64592fe3a4531f, role_id=965049e7ce6144aaad23c15f3a5e37c3)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:50.013558 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27800403-dab8-4e4e-a6b4-78059c5170bc admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:50.025401 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 976/1989] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:18:49 2022] PUT /identity/v3/projects/db9e7d4d2e424fbd892dcd7734718857/users/ef50e7fb69414b84bf64592fe3a4531f/roles/965049e7ce6144aaad23c15f3a5e37c3 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:18:50.035419 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e9f3a8-a338-468b-8f38-3a5f9dc36dbc None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:50.035717 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e9f3a8-a338-468b-8f38-3a5f9dc36dbc None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:50.036141 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e9f3a8-a338-468b-8f38-3a5f9dc36dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:50.064903 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-b2e9f3a8-a338-468b-8f38-3a5f9dc36dbc None None] MFA Rules not processed for user `ef50e7fb69414b84bf64592fe3a4531f`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:18:50.066262 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-b2e9f3a8-a338-468b-8f38-3a5f9dc36dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:50.173013 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1014/1990] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:18:50 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:18:50.189108 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27800403-dab8-4e4e-a6b4-78059c5170bc admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:50.191108 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-27800403-dab8-4e4e-a6b4-78059c5170bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:50.223651 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:50.262685 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27800403-dab8-4e4e-a6b4-78059c5170bc admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:50.267801 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e809c6-d433-441e-a903-05da189e4670 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f86373d65440da97c853fff3c1d0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:50.268544 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e809c6-d433-441e-a903-05da189e4670 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:50.268815 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e809c6-d433-441e-a903-05da189e4670 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:50.269254 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e809c6-d433-441e-a903-05da189e4670 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:50.279553 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e809c6-d433-441e-a903-05da189e4670 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:50.281107 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e809c6-d433-441e-a903-05da189e4670 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:50.293993 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 977/1991] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:18:50 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:18:50.472758 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e9f3a8-a338-468b-8f38-3a5f9dc36dbc None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:50.568252 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e9f3a8-a338-468b-8f38-3a5f9dc36dbc None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:50.574289 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea8682e-45a4-4ba9-82ce-916aa7ea01d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:50.574905 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea8682e-45a4-4ba9-82ce-916aa7ea01d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:50.575288 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea8682e-45a4-4ba9-82ce-916aa7ea01d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:50.575662 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea8682e-45a4-4ba9-82ce-916aa7ea01d7 admin admin] PATH_INFO: `/v3/users/155e4e189da44b75a103925f5c87f227` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:50.577224 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea8682e-45a4-4ba9-82ce-916aa7ea01d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=155e4e189da44b75a103925f5c87f227)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:50.585441 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea8682e-45a4-4ba9-82ce-916aa7ea01d7 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:50.648622 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-eea8682e-45a4-4ba9-82ce-916aa7ea01d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '155e4e189da44b75a103925f5c87f227'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:50.657547 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-eea8682e-45a4-4ba9-82ce-916aa7ea01d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '155e4e189da44b75a103925f5c87f227'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:50.658302 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-eea8682e-45a4-4ba9-82ce-916aa7ea01d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '155e4e189da44b75a103925f5c87f227'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:50.658991 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-eea8682e-45a4-4ba9-82ce-916aa7ea01d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '155e4e189da44b75a103925f5c87f227'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:50.672566 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-eea8682e-45a4-4ba9-82ce-916aa7ea01d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '155e4e189da44b75a103925f5c87f227'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:50.674562 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:50.688735 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1015/1992] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:18:50 2022] DELETE /identity/v3/users/155e4e189da44b75a103925f5c87f227 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:18:50.694171 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add793a-d8e0-4955-8251-2f660126d99b None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:50.694658 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add793a-d8e0-4955-8251-2f660126d99b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:50.694873 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add793a-d8e0-4955-8251-2f660126d99b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:50.731378 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-8add793a-d8e0-4955-8251-2f660126d99b None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:18:50.732393 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-8add793a-d8e0-4955-8251-2f660126d99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:50.826869 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 978/1993] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:18:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:18:50.842056 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea8682e-45a4-4ba9-82ce-916aa7ea01d7 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:50.843644 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-eea8682e-45a4-4ba9-82ce-916aa7ea01d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:50.946629 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea8682e-45a4-4ba9-82ce-916aa7ea01d7 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:50.950488 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feb2cd5-f375-413d-92cc-c9f43f5f0ea0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:50.951228 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb2cd5-f375-413d-92cc-c9f43f5f0ea0 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:50.951572 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb2cd5-f375-413d-92cc-c9f43f5f0ea0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:50.951982 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb2cd5-f375-413d-92cc-c9f43f5f0ea0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:50.962164 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feb2cd5-f375-413d-92cc-c9f43f5f0ea0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:50.963612 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feb2cd5-f375-413d-92cc-c9f43f5f0ea0 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:50.974509 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1016/1994] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:18:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:18:51.480795 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8add793a-d8e0-4955-8251-2f660126d99b None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:51.482355 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-8add793a-d8e0-4955-8251-2f660126d99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:51.496298 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8add793a-d8e0-4955-8251-2f660126d99b None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:51.501163 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b90cb17-9705-4426-954c-0817777be251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:51.502362 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b90cb17-9705-4426-954c-0817777be251 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:51.502646 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b90cb17-9705-4426-954c-0817777be251 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:51.502922 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b90cb17-9705-4426-954c-0817777be251 admin admin] PATH_INFO: `/v3/projects/0e9b449d3276473b9d62f4e8b9d7a9cb` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:51.504317 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b90cb17-9705-4426-954c-0817777be251 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e9b449d3276473b9d62f4e8b9d7a9cb)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:51.507179 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b90cb17-9705-4426-954c-0817777be251 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:51.568125 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8b90cb17-9705-4426-954c-0817777be251 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e9b449d3276473b9d62f4e8b9d7a9cb', 'request_id': 'req-8b90cb17-9705-4426-954c-0817777be251'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:51.573937 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8b90cb17-9705-4426-954c-0817777be251 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e9b449d3276473b9d62f4e8b9d7a9cb', 'request_id': 'req-8b90cb17-9705-4426-954c-0817777be251'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:51.590505 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8b90cb17-9705-4426-954c-0817777be251 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e9b449d3276473b9d62f4e8b9d7a9cb', 'request_id': 'req-8b90cb17-9705-4426-954c-0817777be251'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:51.608231 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8b90cb17-9705-4426-954c-0817777be251 admin admin] The token cache is being invalidate because project 0e9b449d3276473b9d62f4e8b9d7a9cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:18:51.608524 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8b90cb17-9705-4426-954c-0817777be251 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:51.609220 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8b90cb17-9705-4426-954c-0817777be251 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:51.610846 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 979/1995] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:18:51 2022] DELETE /identity/v3/projects/0e9b449d3276473b9d62f4e8b9d7a9cb => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:18:51.616715 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feb2cd5-f375-413d-92cc-c9f43f5f0ea0 service neutron] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:51.628785 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feb2cd5-f375-413d-92cc-c9f43f5f0ea0 service neutron] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:51.727409 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545998ce-2a54-4c2c-ba1c-cce4f49c7573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:51.728363 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545998ce-2a54-4c2c-ba1c-cce4f49c7573 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:51.728647 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545998ce-2a54-4c2c-ba1c-cce4f49c7573 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:51.728922 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545998ce-2a54-4c2c-ba1c-cce4f49c7573 admin admin] PATH_INFO: `/v3/users/ef50e7fb69414b84bf64592fe3a4531f` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:51.730444 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545998ce-2a54-4c2c-ba1c-cce4f49c7573 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef50e7fb69414b84bf64592fe3a4531f)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:51.733148 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545998ce-2a54-4c2c-ba1c-cce4f49c7573 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:51.795371 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-545998ce-2a54-4c2c-ba1c-cce4f49c7573 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef50e7fb69414b84bf64592fe3a4531f'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:51.807757 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-545998ce-2a54-4c2c-ba1c-cce4f49c7573 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef50e7fb69414b84bf64592fe3a4531f'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:51.808509 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-545998ce-2a54-4c2c-ba1c-cce4f49c7573 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef50e7fb69414b84bf64592fe3a4531f'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:51.809163 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-545998ce-2a54-4c2c-ba1c-cce4f49c7573 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef50e7fb69414b84bf64592fe3a4531f'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:51.828425 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-545998ce-2a54-4c2c-ba1c-cce4f49c7573 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef50e7fb69414b84bf64592fe3a4531f'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:51.859781 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1017/1996] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:18:51 2022] DELETE /identity/v3/users/ef50e7fb69414b84bf64592fe3a4531f => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:18:52.658316 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c3721-6b9d-4694-acc9-c8104b1e7e1a None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:52.658852 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c3721-6b9d-4694-acc9-c8104b1e7e1a None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:52.658852 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c3721-6b9d-4694-acc9-c8104b1e7e1a None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:52.660340 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 980/1997] 10.222.0.42 () {54 vars in 921 bytes} [Mon Jul 4 09:18:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:18:52.674806 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f255f1-03bc-4a4c-ae2a-c983d84bee99 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:52.675290 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f255f1-03bc-4a4c-ae2a-c983d84bee99 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:52.675377 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f255f1-03bc-4a4c-ae2a-c983d84bee99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:52.711786 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-e4f255f1-03bc-4a4c-ae2a-c983d84bee99 None None] MFA Rules not processed for user `46ec1a2091f1434cabc69066eb3b6725`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:18:52.713081 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-e4f255f1-03bc-4a4c-ae2a-c983d84bee99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:52.723486 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:52.780606 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9c3721-6b9d-4694-acc9-c8104b1e7e1a None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:52.782683 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-4a9c3721-6b9d-4694-acc9-c8104b1e7e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:52.824829 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1018/1998] 10.222.0.42 () {58 vars in 1018 bytes} [Mon Jul 4 09:18:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:18:52.831971 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f255f1-03bc-4a4c-ae2a-c983d84bee99 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:52.836744 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-e4f255f1-03bc-4a4c-ae2a-c983d84bee99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:52.855048 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:52.885215 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9c3721-6b9d-4694-acc9-c8104b1e7e1a None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:52.890531 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489242f8-0174-4fde-ba15-e0a20785a276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:52.891710 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489242f8-0174-4fde-ba15-e0a20785a276 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:52.892026 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489242f8-0174-4fde-ba15-e0a20785a276 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:52.892304 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489242f8-0174-4fde-ba15-e0a20785a276 admin admin] PATH_INFO: `/v3/users/e87c029b91ce4bcf977b52cf18ffd37c` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:52.893537 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489242f8-0174-4fde-ba15-e0a20785a276 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e87c029b91ce4bcf977b52cf18ffd37c)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:52.895509 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489242f8-0174-4fde-ba15-e0a20785a276 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:52.916724 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f255f1-03bc-4a4c-ae2a-c983d84bee99 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:52.922866 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b27ed69-6041-45e6-ba0e-149cc9027b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:52.923749 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27ed69-6041-45e6-ba0e-149cc9027b98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:52.924192 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27ed69-6041-45e6-ba0e-149cc9027b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:52.924468 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27ed69-6041-45e6-ba0e-149cc9027b98 admin admin] PATH_INFO: `/v3/projects/db9e7d4d2e424fbd892dcd7734718857` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:52.925985 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b27ed69-6041-45e6-ba0e-149cc9027b98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db9e7d4d2e424fbd892dcd7734718857)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:52.928868 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b27ed69-6041-45e6-ba0e-149cc9027b98 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:52.950482 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-489242f8-0174-4fde-ba15-e0a20785a276 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e87c029b91ce4bcf977b52cf18ffd37c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:52.951205 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-489242f8-0174-4fde-ba15-e0a20785a276 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e87c029b91ce4bcf977b52cf18ffd37c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:52.959743 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-489242f8-0174-4fde-ba15-e0a20785a276 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e87c029b91ce4bcf977b52cf18ffd37c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:52.960526 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-489242f8-0174-4fde-ba15-e0a20785a276 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e87c029b91ce4bcf977b52cf18ffd37c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:52.975799 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-489242f8-0174-4fde-ba15-e0a20785a276 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e87c029b91ce4bcf977b52cf18ffd37c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:52.984396 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-8b27ed69-6041-45e6-ba0e-149cc9027b98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db9e7d4d2e424fbd892dcd7734718857', 'request_id': 'req-8b27ed69-6041-45e6-ba0e-149cc9027b98'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:52.990501 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 981/1999] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:18:52 2022] DELETE /identity/v3/users/e87c029b91ce4bcf977b52cf18ffd37c => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:18:52.991671 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489242f8-0174-4fde-ba15-e0a20785a276 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:52.993176 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-489242f8-0174-4fde-ba15-e0a20785a276 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:52.996055 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-8b27ed69-6041-45e6-ba0e-149cc9027b98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db9e7d4d2e424fbd892dcd7734718857', 'request_id': 'req-8b27ed69-6041-45e6-ba0e-149cc9027b98'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:53.005222 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-8b27ed69-6041-45e6-ba0e-149cc9027b98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db9e7d4d2e424fbd892dcd7734718857', 'request_id': 'req-8b27ed69-6041-45e6-ba0e-149cc9027b98'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:53.019166 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-8b27ed69-6041-45e6-ba0e-149cc9027b98 admin admin] The token cache is being invalidate because project db9e7d4d2e424fbd892dcd7734718857 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:18:53.019608 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-8b27ed69-6041-45e6-ba0e-149cc9027b98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:53.020339 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-8b27ed69-6041-45e6-ba0e-149cc9027b98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:53.026373 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1019/2000] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:18:52 2022] DELETE /identity/v3/projects/db9e7d4d2e424fbd892dcd7734718857 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:18:53.028791 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0a5b4-7154-4d3c-b52b-7207abc0658c None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:53.029125 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0a5b4-7154-4d3c-b52b-7207abc0658c None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:53.029412 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0a5b4-7154-4d3c-b52b-7207abc0658c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:53.051449 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-36c0a5b4-7154-4d3c-b52b-7207abc0658c None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:18:53.053662 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-36c0a5b4-7154-4d3c-b52b-7207abc0658c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:53.093490 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:53.102000 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489242f8-0174-4fde-ba15-e0a20785a276 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:53.114130 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb36e6b7-b70c-422a-a53e-292099c6078b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46ec1a2091f1434cabc69066eb3b6725', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:53.115309 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb36e6b7-b70c-422a-a53e-292099c6078b service placement] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:53.115599 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb36e6b7-b70c-422a-a53e-292099c6078b service placement] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:53.115903 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb36e6b7-b70c-422a-a53e-292099c6078b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:53.118656 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-eb36e6b7-b70c-422a-a53e-292099c6078b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:53.132245 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1020/2001] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:18:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:18:53.139175 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb36e6b7-b70c-422a-a53e-292099c6078b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:53.139175 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb36e6b7-b70c-422a-a53e-292099c6078b service placement] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:53.143985 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31899fe-8fc8-4342-b351-7a364feaed2a None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:53.144579 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31899fe-8fc8-4342-b351-7a364feaed2a None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:53.145160 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31899fe-8fc8-4342-b351-7a364feaed2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:53.163978 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 982/2002] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:18:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:18:53.167525 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-f31899fe-8fc8-4342-b351-7a364feaed2a None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:18:53.168858 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-f31899fe-8fc8-4342-b351-7a364feaed2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:53.182425 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1021/2003] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:18:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:18:53.185014 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb36e6b7-b70c-422a-a53e-292099c6078b service placement] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:53.197448 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb36e6b7-b70c-422a-a53e-292099c6078b service placement] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:53.203111 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2303658d-427e-49e4-8584-0c0efbb61a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:53.203837 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2303658d-427e-49e4-8584-0c0efbb61a0b admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:53.204156 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2303658d-427e-49e4-8584-0c0efbb61a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:53.204447 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2303658d-427e-49e4-8584-0c0efbb61a0b admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:53.205198 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2303658d-427e-49e4-8584-0c0efbb61a0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:18:53.205507 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2303658d-427e-49e4-8584-0c0efbb61a0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:53.207197 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2303658d-427e-49e4-8584-0c0efbb61a0b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:53.220154 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 983/2004] 10.222.0.42 () {58 vars in 1152 bytes} [Mon Jul 4 09:18:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:18:53.225141 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31899fe-8fc8-4342-b351-7a364feaed2a None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:53.235448 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31899fe-8fc8-4342-b351-7a364feaed2a None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:53.244805 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca59952-3066-4a90-935a-0364be70a299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:53.245970 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca59952-3066-4a90-935a-0364be70a299 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:53.246372 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca59952-3066-4a90-935a-0364be70a299 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:53.246648 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca59952-3066-4a90-935a-0364be70a299 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:53.247369 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca59952-3066-4a90-935a-0364be70a299 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:53.249547 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca59952-3066-4a90-935a-0364be70a299 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:53.253945 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2303658d-427e-49e4-8584-0c0efbb61a0b admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:53.255854 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-2303658d-427e-49e4-8584-0c0efbb61a0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:53.273407 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2303658d-427e-49e4-8584-0c0efbb61a0b admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:53.280350 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3630bde-029a-4ee3-8813-64b06360e18d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:53.281777 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3630bde-029a-4ee3-8813-64b06360e18d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:53.282077 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3630bde-029a-4ee3-8813-64b06360e18d admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:53.282358 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3630bde-029a-4ee3-8813-64b06360e18d admin admin] PATH_INFO: `/v3/projects/9670c67ac9f54bed9d37f247a911e2c2` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:53.283601 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3630bde-029a-4ee3-8813-64b06360e18d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9670c67ac9f54bed9d37f247a911e2c2)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:53.286009 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3630bde-029a-4ee3-8813-64b06360e18d admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:53.296379 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1022/2005] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:18:53 2022] POST /identity/v3/projects => generated 377 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:18:53.297774 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca59952-3066-4a90-935a-0364be70a299 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:53.348192 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:53.359361 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b3630bde-029a-4ee3-8813-64b06360e18d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9670c67ac9f54bed9d37f247a911e2c2', 'request_id': 'req-b3630bde-029a-4ee3-8813-64b06360e18d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:53.368745 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b3630bde-029a-4ee3-8813-64b06360e18d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9670c67ac9f54bed9d37f247a911e2c2', 'request_id': 'req-b3630bde-029a-4ee3-8813-64b06360e18d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:53.380550 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b3630bde-029a-4ee3-8813-64b06360e18d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9670c67ac9f54bed9d37f247a911e2c2', 'request_id': 'req-b3630bde-029a-4ee3-8813-64b06360e18d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:53.404019 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b3630bde-029a-4ee3-8813-64b06360e18d admin admin] The token cache is being invalidate because project 9670c67ac9f54bed9d37f247a911e2c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:18:53.404596 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b3630bde-029a-4ee3-8813-64b06360e18d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:53.405889 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b3630bde-029a-4ee3-8813-64b06360e18d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:53.408661 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 984/2006] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:18:53 2022] DELETE /identity/v3/projects/9670c67ac9f54bed9d37f247a911e2c2 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:18:53.411219 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca59952-3066-4a90-935a-0364be70a299 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:53.413307 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fd3afa-9191-4c4b-995b-a0a5d5ffcfa1 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:53.413654 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fd3afa-9191-4c4b-995b-a0a5d5ffcfa1 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:53.414004 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fd3afa-9191-4c4b-995b-a0a5d5ffcfa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:53.441594 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-08fd3afa-9191-4c4b-995b-a0a5d5ffcfa1 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:18:53.443005 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-08fd3afa-9191-4c4b-995b-a0a5d5ffcfa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:53.494561 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3273319f-93de-4768-a302-1553df8b99c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:53.495278 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3273319f-93de-4768-a302-1553df8b99c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:53.495562 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3273319f-93de-4768-a302-1553df8b99c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:53.495840 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3273319f-93de-4768-a302-1553df8b99c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:53.496675 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3273319f-93de-4768-a302-1553df8b99c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:53.498646 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3273319f-93de-4768-a302-1553df8b99c9 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:53.527926 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1023/2007] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:18:53 2022] POST /identity/v3/users => generated 289 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:18:53.532124 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3273319f-93de-4768-a302-1553df8b99c9 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:53.533955 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-3273319f-93de-4768-a302-1553df8b99c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:53.546223 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3273319f-93de-4768-a302-1553df8b99c9 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:53.548044 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 985/2008] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:18:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:18:53.552344 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55afc9e6-cb3b-41e1-b1ba-3796d7a4c935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:53.553159 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55afc9e6-cb3b-41e1-b1ba-3796d7a4c935 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:53.553506 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55afc9e6-cb3b-41e1-b1ba-3796d7a4c935 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:53.553846 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55afc9e6-cb3b-41e1-b1ba-3796d7a4c935 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:53.553988 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d770c-e153-4989-9aa8-e991b4d111b9 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:53.554645 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d770c-e153-4989-9aa8-e991b4d111b9 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:53.554645 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d770c-e153-4989-9aa8-e991b4d111b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:53.554849 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55afc9e6-cb3b-41e1-b1ba-3796d7a4c935 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:53.556821 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55afc9e6-cb3b-41e1-b1ba-3796d7a4c935 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:53.568223 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1024/2009] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:18:53 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:18:53.572607 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55afc9e6-cb3b-41e1-b1ba-3796d7a4c935 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:53.574370 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-bc7d770c-e153-4989-9aa8-e991b4d111b9 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:18:53.575792 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-bc7d770c-e153-4989-9aa8-e991b4d111b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:53.583702 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55afc9e6-cb3b-41e1-b1ba-3796d7a4c935 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:53.584025 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 986/2010] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:18:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:18:53.588273 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7d770c-e153-4989-9aa8-e991b4d111b9 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:53.588953 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77800828-d835-449b-a639-0798dd412350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:53.589626 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77800828-d835-449b-a639-0798dd412350 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:53.589971 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77800828-d835-449b-a639-0798dd412350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:53.590251 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77800828-d835-449b-a639-0798dd412350 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:53.590999 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77800828-d835-449b-a639-0798dd412350 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:53.592760 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77800828-d835-449b-a639-0798dd412350 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:53.597615 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7d770c-e153-4989-9aa8-e991b4d111b9 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:53.602683 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86108eab-e808-497d-a9ca-0c2b03e210cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:53.603298 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1025/2011] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:18:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:18:53.606561 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86108eab-e808-497d-a9ca-0c2b03e210cb admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:53.606561 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86108eab-e808-497d-a9ca-0c2b03e210cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:53.606561 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86108eab-e808-497d-a9ca-0c2b03e210cb admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:53.606561 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86108eab-e808-497d-a9ca-0c2b03e210cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:18:53.606561 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86108eab-e808-497d-a9ca-0c2b03e210cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:53.606952 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86108eab-e808-497d-a9ca-0c2b03e210cb admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:53.607457 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77800828-d835-449b-a639-0798dd412350 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:53.617160 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77800828-d835-449b-a639-0798dd412350 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:53.622030 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 987/2012] 10.222.0.42 () {58 vars in 1152 bytes} [Mon Jul 4 09:18:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:18:53.622384 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db780fc-ff11-43f5-b2a7-8c70abedc9f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:53.623306 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86108eab-e808-497d-a9ca-0c2b03e210cb admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:53.623427 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db780fc-ff11-43f5-b2a7-8c70abedc9f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:53.623630 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db780fc-ff11-43f5-b2a7-8c70abedc9f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:53.623928 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db780fc-ff11-43f5-b2a7-8c70abedc9f5 admin admin] PATH_INFO: `/v3/projects/0a6b88cf66be4f2594b1398fb628dfb4/users/348e3f96886e46db87a9748974763285/roles/81634e7812344f84afcb29b0dba2687c` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:53.633851 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86108eab-e808-497d-a9ca-0c2b03e210cb admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:53.639327 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa47b9c-4807-4303-9a86-3ff58ce3666d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:53.640061 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa47b9c-4807-4303-9a86-3ff58ce3666d admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:53.640339 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa47b9c-4807-4303-9a86-3ff58ce3666d admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:53.640447 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db780fc-ff11-43f5-b2a7-8c70abedc9f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a6b88cf66be4f2594b1398fb628dfb4, user_id=348e3f96886e46db87a9748974763285, role_id=81634e7812344f84afcb29b0dba2687c)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:53.640679 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa47b9c-4807-4303-9a86-3ff58ce3666d admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:53.641352 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa47b9c-4807-4303-9a86-3ff58ce3666d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:53.643202 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db780fc-ff11-43f5-b2a7-8c70abedc9f5 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:53.643390 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa47b9c-4807-4303-9a86-3ff58ce3666d admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:53.659282 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1026/2013] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:18:53 2022] PUT /identity/v3/projects/0a6b88cf66be4f2594b1398fb628dfb4/users/348e3f96886e46db87a9748974763285/roles/81634e7812344f84afcb29b0dba2687c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:18:53.670647 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc7740-41f1-4be4-87e0-693706218234 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:53.670941 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc7740-41f1-4be4-87e0-693706218234 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:53.671223 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc7740-41f1-4be4-87e0-693706218234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:53.671620 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 988/2014] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:18:53 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:18:53.676043 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa47b9c-4807-4303-9a86-3ff58ce3666d admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:53.677638 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:53.704031 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-1bbc7740-41f1-4be4-87e0-693706218234 None None] MFA Rules not processed for user `348e3f96886e46db87a9748974763285`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:18:53.705355 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-1bbc7740-41f1-4be4-87e0-693706218234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:53.741881 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa47b9c-4807-4303-9a86-3ff58ce3666d admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:53.747438 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729be8a2-d329-45c5-a640-a7fbf07dd275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:53.748150 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729be8a2-d329-45c5-a640-a7fbf07dd275 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:53.748436 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729be8a2-d329-45c5-a640-a7fbf07dd275 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:53.748717 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729be8a2-d329-45c5-a640-a7fbf07dd275 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:53.749428 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729be8a2-d329-45c5-a640-a7fbf07dd275 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:53.751397 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729be8a2-d329-45c5-a640-a7fbf07dd275 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:53.777119 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 989/2015] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:18:53 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:18:53.778409 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729be8a2-d329-45c5-a640-a7fbf07dd275 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:53.788477 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1027/2016] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:18:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:18:53.792362 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729be8a2-d329-45c5-a640-a7fbf07dd275 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:53.793736 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbc7740-41f1-4be4-87e0-693706218234 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:53.796496 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affdfe9a-e33f-482d-a37e-a5620046df05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:53.797194 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affdfe9a-e33f-482d-a37e-a5620046df05 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:53.797487 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affdfe9a-e33f-482d-a37e-a5620046df05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:53.797785 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affdfe9a-e33f-482d-a37e-a5620046df05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:53.798512 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affdfe9a-e33f-482d-a37e-a5620046df05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:53.800820 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affdfe9a-e33f-482d-a37e-a5620046df05 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:53.805004 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbc7740-41f1-4be4-87e0-693706218234 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:53.810737 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f873ee58-b3aa-4635-8e70-24a0fe469c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:53.811644 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f873ee58-b3aa-4635-8e70-24a0fe469c92 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:53.811952 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f873ee58-b3aa-4635-8e70-24a0fe469c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:53.812243 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f873ee58-b3aa-4635-8e70-24a0fe469c92 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:53.816765 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 990/2017] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:18:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:18:53.817036 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f873ee58-b3aa-4635-8e70-24a0fe469c92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:53.817036 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f873ee58-b3aa-4635-8e70-24a0fe469c92 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:53.817204 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affdfe9a-e33f-482d-a37e-a5620046df05 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:53.823740 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:53.827846 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affdfe9a-e33f-482d-a37e-a5620046df05 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:53.835401 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1908838-bd8d-407e-ba26-c0911570a22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:53.836297 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1908838-bd8d-407e-ba26-c0911570a22a admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:53.836918 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1908838-bd8d-407e-ba26-c0911570a22a admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:53.837439 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1908838-bd8d-407e-ba26-c0911570a22a admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:53.838399 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1908838-bd8d-407e-ba26-c0911570a22a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:53.840767 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1908838-bd8d-407e-ba26-c0911570a22a admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:53.844664 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1028/2018] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:18:53 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:18:53.849170 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f873ee58-b3aa-4635-8e70-24a0fe469c92 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:53.856599 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 991/2019] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:18:53 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:18:53.861002 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1908838-bd8d-407e-ba26-c0911570a22a admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:53.875246 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1908838-bd8d-407e-ba26-c0911570a22a admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:53.951372 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a466a810-1e52-4566-a039-22a7b16acafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:53.952360 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a466a810-1e52-4566-a039-22a7b16acafb admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:53.952888 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a466a810-1e52-4566-a039-22a7b16acafb admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:53.952888 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a466a810-1e52-4566-a039-22a7b16acafb admin admin] PATH_INFO: `/v3/projects/d8089401f7d54004af774ed8939a5fbe/users/6bf8d164ece941eeb11f878cd38d0518/roles/81634e7812344f84afcb29b0dba2687c` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:53.960207 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f873ee58-b3aa-4635-8e70-24a0fe469c92 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:53.966366 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4115d26-fc6a-4cdc-b9df-5b0885af76a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:53.967400 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4115d26-fc6a-4cdc-b9df-5b0885af76a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:53.967823 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4115d26-fc6a-4cdc-b9df-5b0885af76a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:53.968279 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4115d26-fc6a-4cdc-b9df-5b0885af76a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:53.969248 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4115d26-fc6a-4cdc-b9df-5b0885af76a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:53.972243 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4115d26-fc6a-4cdc-b9df-5b0885af76a8 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:53.974154 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a466a810-1e52-4566-a039-22a7b16acafb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8089401f7d54004af774ed8939a5fbe, user_id=6bf8d164ece941eeb11f878cd38d0518, role_id=81634e7812344f84afcb29b0dba2687c)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:53.977072 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a466a810-1e52-4566-a039-22a7b16acafb admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:53.999170 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 992/2020] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:18:53 2022] PUT /identity/v3/projects/d8089401f7d54004af774ed8939a5fbe/users/6bf8d164ece941eeb11f878cd38d0518/roles/81634e7812344f84afcb29b0dba2687c => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:18:54.010228 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1029/2021] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:18:53 2022] POST /identity/v3/users => generated 289 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:18:54.013050 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80e310f-f892-45ab-af0f-1d8426fcdc11 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:54.013525 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80e310f-f892-45ab-af0f-1d8426fcdc11 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:54.013985 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80e310f-f892-45ab-af0f-1d8426fcdc11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:54.015258 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4115d26-fc6a-4cdc-b9df-5b0885af76a8 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:54.032539 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4115d26-fc6a-4cdc-b9df-5b0885af76a8 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:54.059542 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-e80e310f-f892-45ab-af0f-1d8426fcdc11 None None] MFA Rules not processed for user `6bf8d164ece941eeb11f878cd38d0518`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:18:54.061184 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e80e310f-f892-45ab-af0f-1d8426fcdc11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:54.115573 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142c5607-3d40-42e0-a59e-8f8810f013b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:54.116278 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c5607-3d40-42e0-a59e-8f8810f013b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:54.116958 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c5607-3d40-42e0-a59e-8f8810f013b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:54.117377 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c5607-3d40-42e0-a59e-8f8810f013b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:54.118184 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142c5607-3d40-42e0-a59e-8f8810f013b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:54.120291 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142c5607-3d40-42e0-a59e-8f8810f013b0 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:54.121991 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:54.134919 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1030/2022] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:18:54 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:18:54.138842 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142c5607-3d40-42e0-a59e-8f8810f013b0 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:54.149575 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142c5607-3d40-42e0-a59e-8f8810f013b0 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:54.153998 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 993/2023] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:18:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:18:54.158025 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd46382-2368-49a0-bc9e-c50b216bb0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:54.158858 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd46382-2368-49a0-bc9e-c50b216bb0e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:54.159201 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd46382-2368-49a0-bc9e-c50b216bb0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:54.159484 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd46382-2368-49a0-bc9e-c50b216bb0e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:54.160256 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd46382-2368-49a0-bc9e-c50b216bb0e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:54.161517 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80e310f-f892-45ab-af0f-1d8426fcdc11 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:54.162342 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd46382-2368-49a0-bc9e-c50b216bb0e5 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:54.163197 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e80e310f-f892-45ab-af0f-1d8426fcdc11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:54.174094 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1031/2024] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:18:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:18:54.178122 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd46382-2368-49a0-bc9e-c50b216bb0e5 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:54.188335 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd46382-2368-49a0-bc9e-c50b216bb0e5 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:54.192972 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc2425a-4786-4b47-adbf-9c65eef84d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:54.193839 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc2425a-4786-4b47-adbf-9c65eef84d1a admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:54.194125 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc2425a-4786-4b47-adbf-9c65eef84d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:54.194401 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc2425a-4786-4b47-adbf-9c65eef84d1a admin admin] PATH_INFO: `/v3/projects/4cb100bbda86412793946e04096e6933/users/8834b714ada643a98c529cfcb12bb6cf/roles/81634e7812344f84afcb29b0dba2687c` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:54.209607 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc2425a-4786-4b47-adbf-9c65eef84d1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cb100bbda86412793946e04096e6933, user_id=8834b714ada643a98c529cfcb12bb6cf, role_id=81634e7812344f84afcb29b0dba2687c)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:54.212297 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc2425a-4786-4b47-adbf-9c65eef84d1a admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:54.226801 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1032/2025] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:18:54 2022] PUT /identity/v3/projects/4cb100bbda86412793946e04096e6933/users/8834b714ada643a98c529cfcb12bb6cf/roles/81634e7812344f84afcb29b0dba2687c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:18:54.235120 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:54.237443 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b3d74-a987-4158-a6ca-7f9dd0663344 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:54.237787 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b3d74-a987-4158-a6ca-7f9dd0663344 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:54.238067 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b3d74-a987-4158-a6ca-7f9dd0663344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:54.240668 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80e310f-f892-45ab-af0f-1d8426fcdc11 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:54.264068 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-517b3d74-a987-4158-a6ca-7f9dd0663344 None None] MFA Rules not processed for user `8834b714ada643a98c529cfcb12bb6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:18:54.265274 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-517b3d74-a987-4158-a6ca-7f9dd0663344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:54.308964 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2307eeee-9d63-476d-82a5-88691f420815 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3b6e252a8c434a99432bcece6493b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:54.309700 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2307eeee-9d63-476d-82a5-88691f420815 service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:54.310092 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2307eeee-9d63-476d-82a5-88691f420815 service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:54.310439 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2307eeee-9d63-476d-82a5-88691f420815 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:54.343022 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1033/2026] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:18:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:18:54.346917 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517b3d74-a987-4158-a6ca-7f9dd0663344 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:54.389503 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2307eeee-9d63-476d-82a5-88691f420815 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:54.391839 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2307eeee-9d63-476d-82a5-88691f420815 service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:54.408147 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 994/2027] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:18:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:18:54.426512 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517b3d74-a987-4158-a6ca-7f9dd0663344 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:54.431592 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077ee03c-7ad3-47c1-b396-9b871d5d0184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:54.432215 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ee03c-7ad3-47c1-b396-9b871d5d0184 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:54.432712 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ee03c-7ad3-47c1-b396-9b871d5d0184 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:54.433089 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ee03c-7ad3-47c1-b396-9b871d5d0184 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:54.433953 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077ee03c-7ad3-47c1-b396-9b871d5d0184 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:54.436469 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077ee03c-7ad3-47c1-b396-9b871d5d0184 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:54.465457 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1034/2028] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:18:54 2022] POST /identity/v3/projects => generated 379 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:18:54.470062 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2307eeee-9d63-476d-82a5-88691f420815 service nova] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:54.483433 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2307eeee-9d63-476d-82a5-88691f420815 service nova] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:54.556230 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d60da5-53cd-4918-b627-107fa143a279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:54.557053 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d60da5-53cd-4918-b627-107fa143a279 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:54.557997 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d60da5-53cd-4918-b627-107fa143a279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:54.558380 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d60da5-53cd-4918-b627-107fa143a279 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:54.559238 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d60da5-53cd-4918-b627-107fa143a279 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:54.561713 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d60da5-53cd-4918-b627-107fa143a279 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:54.596919 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 995/2029] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:18:54 2022] POST /identity/v3/users => generated 296 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:18:54.597404 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077ee03c-7ad3-47c1-b396-9b871d5d0184 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:54.609850 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077ee03c-7ad3-47c1-b396-9b871d5d0184 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:54.628753 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceebace8-44a6-4aba-bb01-aa81699c01e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:54.629564 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceebace8-44a6-4aba-bb01-aa81699c01e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:54.629782 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceebace8-44a6-4aba-bb01-aa81699c01e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:54.630767 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceebace8-44a6-4aba-bb01-aa81699c01e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:54.631089 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceebace8-44a6-4aba-bb01-aa81699c01e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:54.632820 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceebace8-44a6-4aba-bb01-aa81699c01e9 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:54.649334 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1035/2030] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:18:54 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:18:54.650441 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d60da5-53cd-4918-b627-107fa143a279 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:54.670092 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d60da5-53cd-4918-b627-107fa143a279 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:54.675244 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb94948-ec3c-4c48-8714-a5fca90d5188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:54.676175 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb94948-ec3c-4c48-8714-a5fca90d5188 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:54.676459 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb94948-ec3c-4c48-8714-a5fca90d5188 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:54.676733 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb94948-ec3c-4c48-8714-a5fca90d5188 admin admin] PATH_INFO: `/v3/projects/be12b6e0559c4f618af171bebb6655d7/users/d1d99518e65a40ad976f67a11d44629f/roles/965049e7ce6144aaad23c15f3a5e37c3` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:54.696080 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb94948-ec3c-4c48-8714-a5fca90d5188 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be12b6e0559c4f618af171bebb6655d7, user_id=d1d99518e65a40ad976f67a11d44629f, role_id=965049e7ce6144aaad23c15f3a5e37c3)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:54.699981 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb94948-ec3c-4c48-8714-a5fca90d5188 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:54.734934 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 996/2031] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:18:54 2022] PUT /identity/v3/projects/be12b6e0559c4f618af171bebb6655d7/users/d1d99518e65a40ad976f67a11d44629f/roles/965049e7ce6144aaad23c15f3a5e37c3 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:18:54.736501 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceebace8-44a6-4aba-bb01-aa81699c01e9 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:54.749845 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceebace8-44a6-4aba-bb01-aa81699c01e9 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:54.783168 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:54.835967 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2196ffc-3cfa-4c67-8d96-62fa025997d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:54.836776 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2196ffc-3cfa-4c67-8d96-62fa025997d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:54.837153 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2196ffc-3cfa-4c67-8d96-62fa025997d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:54.837563 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2196ffc-3cfa-4c67-8d96-62fa025997d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:54.838446 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2196ffc-3cfa-4c67-8d96-62fa025997d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:54.840754 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2196ffc-3cfa-4c67-8d96-62fa025997d7 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:54.853624 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1036/2032] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:18:54 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:18:54.858212 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb94948-ec3c-4c48-8714-a5fca90d5188 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:54.876537 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb94948-ec3c-4c48-8714-a5fca90d5188 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:54.881346 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38be983-7948-4c80-8121-59f22bf360a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:54.882217 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38be983-7948-4c80-8121-59f22bf360a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:54.882498 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38be983-7948-4c80-8121-59f22bf360a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:54.882772 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38be983-7948-4c80-8121-59f22bf360a2 admin admin] PATH_INFO: `/v3/projects/be12b6e0559c4f618af171bebb6655d7/users/d1d99518e65a40ad976f67a11d44629f/roles/965049e7ce6144aaad23c15f3a5e37c3` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:54.884875 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38be983-7948-4c80-8121-59f22bf360a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be12b6e0559c4f618af171bebb6655d7, user_id=d1d99518e65a40ad976f67a11d44629f, role_id=965049e7ce6144aaad23c15f3a5e37c3)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:54.887937 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38be983-7948-4c80-8121-59f22bf360a2 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:54.890935 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:54.910573 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 997/2033] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:18:54 2022] PUT /identity/v3/projects/be12b6e0559c4f618af171bebb6655d7/users/d1d99518e65a40ad976f67a11d44629f/roles/965049e7ce6144aaad23c15f3a5e37c3 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:18:54.922159 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018ddfd-37d3-44ca-b7f8-f44a393050ed None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:54.922451 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018ddfd-37d3-44ca-b7f8-f44a393050ed None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:54.922727 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018ddfd-37d3-44ca-b7f8-f44a393050ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:54.956056 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-e018ddfd-37d3-44ca-b7f8-f44a393050ed None None] MFA Rules not processed for user `d1d99518e65a40ad976f67a11d44629f`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:18:54.957322 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-e018ddfd-37d3-44ca-b7f8-f44a393050ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:55.033457 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1037/2034] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:18:54 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:18:55.045946 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38be983-7948-4c80-8121-59f22bf360a2 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:55.047670 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c38be983-7948-4c80-8121-59f22bf360a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:55.108983 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38be983-7948-4c80-8121-59f22bf360a2 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:55.113565 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f7ea18-7c91-4c1a-8f62-7316d67cb7d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f86373d65440da97c853fff3c1d0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:55.114284 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f7ea18-7c91-4c1a-8f62-7316d67cb7d6 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:55.114572 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f7ea18-7c91-4c1a-8f62-7316d67cb7d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:55.114846 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f7ea18-7c91-4c1a-8f62-7316d67cb7d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:55.124682 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f7ea18-7c91-4c1a-8f62-7316d67cb7d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:55.126246 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f7ea18-7c91-4c1a-8f62-7316d67cb7d6 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:55.136311 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 998/2035] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:18:55 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:18:55.181225 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e018ddfd-37d3-44ca-b7f8-f44a393050ed None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:55.183683 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-e018ddfd-37d3-44ca-b7f8-f44a393050ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:55.196471 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e018ddfd-37d3-44ca-b7f8-f44a393050ed None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:55.201065 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91223d3-84e7-4492-ab02-f0293fa59c67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f86373d65440da97c853fff3c1d0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:55.201692 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91223d3-84e7-4492-ab02-f0293fa59c67 service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:55.201976 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91223d3-84e7-4492-ab02-f0293fa59c67 service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:55.202247 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91223d3-84e7-4492-ab02-f0293fa59c67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:55.268286 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91223d3-84e7-4492-ab02-f0293fa59c67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:55.269773 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91223d3-84e7-4492-ab02-f0293fa59c67 service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:55.279430 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1038/2036] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:18:55 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:18:58.238301 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f7ea18-7c91-4c1a-8f62-7316d67cb7d6 service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:58.303360 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f7ea18-7c91-4c1a-8f62-7316d67cb7d6 service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:58.309355 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f5ddec-8c80-421c-8628-093e8fc762f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:58.310309 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f5ddec-8c80-421c-8628-093e8fc762f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:58.310635 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f5ddec-8c80-421c-8628-093e8fc762f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:58.310950 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f5ddec-8c80-421c-8628-093e8fc762f1 admin admin] PATH_INFO: `/v3/users/348e3f96886e46db87a9748974763285` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:58.312256 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f5ddec-8c80-421c-8628-093e8fc762f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=348e3f96886e46db87a9748974763285)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:58.314219 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f5ddec-8c80-421c-8628-093e8fc762f1 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:58.372208 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-87f5ddec-8c80-421c-8628-093e8fc762f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '348e3f96886e46db87a9748974763285'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:58.372959 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-87f5ddec-8c80-421c-8628-093e8fc762f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '348e3f96886e46db87a9748974763285'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:58.381817 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-87f5ddec-8c80-421c-8628-093e8fc762f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '348e3f96886e46db87a9748974763285'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:58.382518 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-87f5ddec-8c80-421c-8628-093e8fc762f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '348e3f96886e46db87a9748974763285'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:58.398091 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-87f5ddec-8c80-421c-8628-093e8fc762f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '348e3f96886e46db87a9748974763285'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:58.414902 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 999/2037] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:18:58 2022] DELETE /identity/v3/users/348e3f96886e46db87a9748974763285 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:18:58.420174 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb303c1-e419-435b-b848-a00d161040ca None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:58.420645 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb303c1-e419-435b-b848-a00d161040ca None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:58.420751 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb303c1-e419-435b-b848-a00d161040ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:58.450106 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-2fb303c1-e419-435b-b848-a00d161040ca None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:18:58.451710 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-2fb303c1-e419-435b-b848-a00d161040ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:58.515181 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:58.551159 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1039/2038] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:18:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:18:58.562002 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f5ddec-8c80-421c-8628-093e8fc762f1 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:58.563464 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-87f5ddec-8c80-421c-8628-093e8fc762f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:58.591406 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:58.647541 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f5ddec-8c80-421c-8628-093e8fc762f1 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:58.652739 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de458301-cb16-479b-bf2d-1385268141ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:58.653470 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de458301-cb16-479b-bf2d-1385268141ff service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:58.653804 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de458301-cb16-479b-bf2d-1385268141ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:58.654186 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de458301-cb16-479b-bf2d-1385268141ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:58.669953 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de458301-cb16-479b-bf2d-1385268141ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:58.671672 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de458301-cb16-479b-bf2d-1385268141ff service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:58.692039 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1000/2039] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:18:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:18:58.991971 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb303c1-e419-435b-b848-a00d161040ca None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:58.993566 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-2fb303c1-e419-435b-b848-a00d161040ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:59.009803 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb303c1-e419-435b-b848-a00d161040ca None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:59.016728 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f36ae9-4f64-4876-8027-b06eb50f250f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:59.017613 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f36ae9-4f64-4876-8027-b06eb50f250f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:59.017893 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f36ae9-4f64-4876-8027-b06eb50f250f admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:59.018161 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f36ae9-4f64-4876-8027-b06eb50f250f admin admin] PATH_INFO: `/v3/projects/0a6b88cf66be4f2594b1398fb628dfb4` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:59.019516 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f36ae9-4f64-4876-8027-b06eb50f250f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a6b88cf66be4f2594b1398fb628dfb4)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:59.021438 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f36ae9-4f64-4876-8027-b06eb50f250f admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:59.072128 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-20f36ae9-4f64-4876-8027-b06eb50f250f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a6b88cf66be4f2594b1398fb628dfb4', 'request_id': 'req-20f36ae9-4f64-4876-8027-b06eb50f250f'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:59.080079 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-20f36ae9-4f64-4876-8027-b06eb50f250f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a6b88cf66be4f2594b1398fb628dfb4', 'request_id': 'req-20f36ae9-4f64-4876-8027-b06eb50f250f'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:59.085802 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-20f36ae9-4f64-4876-8027-b06eb50f250f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a6b88cf66be4f2594b1398fb628dfb4', 'request_id': 'req-20f36ae9-4f64-4876-8027-b06eb50f250f'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:59.098192 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-20f36ae9-4f64-4876-8027-b06eb50f250f admin admin] The token cache is being invalidate because project 0a6b88cf66be4f2594b1398fb628dfb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:18:59.098900 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-20f36ae9-4f64-4876-8027-b06eb50f250f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:59.099536 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-20f36ae9-4f64-4876-8027-b06eb50f250f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:59.101483 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1040/2040] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:18:58 2022] DELETE /identity/v3/projects/0a6b88cf66be4f2594b1398fb628dfb4 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:18:59.105651 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de458301-cb16-479b-bf2d-1385268141ff service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:59.116497 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de458301-cb16-479b-bf2d-1385268141ff service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:59.176564 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e099cb-6feb-4481-aece-969a754a4382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:59.177472 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e099cb-6feb-4481-aece-969a754a4382 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:59.178114 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e099cb-6feb-4481-aece-969a754a4382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:59.178114 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e099cb-6feb-4481-aece-969a754a4382 admin admin] PATH_INFO: `/v3/users/8834b714ada643a98c529cfcb12bb6cf` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:59.179618 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e099cb-6feb-4481-aece-969a754a4382 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8834b714ada643a98c529cfcb12bb6cf)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:59.181761 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e099cb-6feb-4481-aece-969a754a4382 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:59.232069 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-82e099cb-6feb-4481-aece-969a754a4382 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8834b714ada643a98c529cfcb12bb6cf'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:59.232829 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-82e099cb-6feb-4481-aece-969a754a4382 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8834b714ada643a98c529cfcb12bb6cf'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:59.240866 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-82e099cb-6feb-4481-aece-969a754a4382 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8834b714ada643a98c529cfcb12bb6cf'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:59.241708 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-82e099cb-6feb-4481-aece-969a754a4382 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8834b714ada643a98c529cfcb12bb6cf'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:59.255168 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-82e099cb-6feb-4481-aece-969a754a4382 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8834b714ada643a98c529cfcb12bb6cf'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:59.269042 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1001/2041] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:18:59 2022] DELETE /identity/v3/users/8834b714ada643a98c529cfcb12bb6cf => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:18:59.553304 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f36ae9-4f64-4876-8027-b06eb50f250f admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:59.554793 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-20f36ae9-4f64-4876-8027-b06eb50f250f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:59.569941 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f36ae9-4f64-4876-8027-b06eb50f250f admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:59.642722 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f904c9a-c91a-4032-a619-8ff448525e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:59.643622 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f904c9a-c91a-4032-a619-8ff448525e02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:59.643897 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f904c9a-c91a-4032-a619-8ff448525e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:59.644193 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f904c9a-c91a-4032-a619-8ff448525e02 admin admin] PATH_INFO: `/v3/projects/4cb100bbda86412793946e04096e6933` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:59.645390 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f904c9a-c91a-4032-a619-8ff448525e02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cb100bbda86412793946e04096e6933)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:59.647356 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f904c9a-c91a-4032-a619-8ff448525e02 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:59.694011 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-9f904c9a-c91a-4032-a619-8ff448525e02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cb100bbda86412793946e04096e6933', 'request_id': 'req-9f904c9a-c91a-4032-a619-8ff448525e02'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:59.702086 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-9f904c9a-c91a-4032-a619-8ff448525e02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cb100bbda86412793946e04096e6933', 'request_id': 'req-9f904c9a-c91a-4032-a619-8ff448525e02'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:59.708312 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-9f904c9a-c91a-4032-a619-8ff448525e02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cb100bbda86412793946e04096e6933', 'request_id': 'req-9f904c9a-c91a-4032-a619-8ff448525e02'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:59.715921 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:59.721178 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-9f904c9a-c91a-4032-a619-8ff448525e02 admin admin] The token cache is being invalidate because project 4cb100bbda86412793946e04096e6933 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:18:59.721907 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-9f904c9a-c91a-4032-a619-8ff448525e02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:59.724079 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-9f904c9a-c91a-4032-a619-8ff448525e02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:59.729171 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1041/2042] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:18:59 2022] DELETE /identity/v3/projects/4cb100bbda86412793946e04096e6933 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:18:59.730163 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e099cb-6feb-4481-aece-969a754a4382 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:18:59.731797 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-82e099cb-6feb-4481-aece-969a754a4382 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:18:59.745936 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e099cb-6feb-4481-aece-969a754a4382 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:18:59.783123 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:59.811810 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf0a891-c3fa-4c0d-b70c-0dd5bfa6792b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:18:59.813368 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0a891-c3fa-4c0d-b70c-0dd5bfa6792b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:18:59.813810 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0a891-c3fa-4c0d-b70c-0dd5bfa6792b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:18:59.814085 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0a891-c3fa-4c0d-b70c-0dd5bfa6792b admin admin] PATH_INFO: `/v3/users/d1d99518e65a40ad976f67a11d44629f` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:18:59.815322 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf0a891-c3fa-4c0d-b70c-0dd5bfa6792b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1d99518e65a40ad976f67a11d44629f)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:18:59.817892 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf0a891-c3fa-4c0d-b70c-0dd5bfa6792b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:18:59.911076 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8bf0a891-c3fa-4c0d-b70c-0dd5bfa6792b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1d99518e65a40ad976f67a11d44629f'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:59.911770 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8bf0a891-c3fa-4c0d-b70c-0dd5bfa6792b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1d99518e65a40ad976f67a11d44629f'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:59.921215 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8bf0a891-c3fa-4c0d-b70c-0dd5bfa6792b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1d99518e65a40ad976f67a11d44629f'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:59.922120 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8bf0a891-c3fa-4c0d-b70c-0dd5bfa6792b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1d99518e65a40ad976f67a11d44629f'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:59.949266 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8bf0a891-c3fa-4c0d-b70c-0dd5bfa6792b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1d99518e65a40ad976f67a11d44629f'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:18:59.963706 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1002/2043] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:18:59 2022] DELETE /identity/v3/users/d1d99518e65a40ad976f67a11d44629f => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:19:00.013957 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f904c9a-c91a-4032-a619-8ff448525e02 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:00.015645 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-9f904c9a-c91a-4032-a619-8ff448525e02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:00.027764 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f904c9a-c91a-4032-a619-8ff448525e02 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:00.099301 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f262d5-c670-4f5d-8daf-e6282104e0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:00.101077 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f262d5-c670-4f5d-8daf-e6282104e0fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:00.101077 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f262d5-c670-4f5d-8daf-e6282104e0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:00.101685 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f262d5-c670-4f5d-8daf-e6282104e0fa admin admin] PATH_INFO: `/v3/users/6bf8d164ece941eeb11f878cd38d0518` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:00.103534 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f262d5-c670-4f5d-8daf-e6282104e0fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bf8d164ece941eeb11f878cd38d0518)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:00.106173 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f262d5-c670-4f5d-8daf-e6282104e0fa admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:00.163516 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-38f262d5-c670-4f5d-8daf-e6282104e0fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bf8d164ece941eeb11f878cd38d0518'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:00.173340 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-38f262d5-c670-4f5d-8daf-e6282104e0fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bf8d164ece941eeb11f878cd38d0518'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:00.179240 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-38f262d5-c670-4f5d-8daf-e6282104e0fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bf8d164ece941eeb11f878cd38d0518'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:00.179934 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-38f262d5-c670-4f5d-8daf-e6282104e0fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bf8d164ece941eeb11f878cd38d0518'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:00.194146 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-38f262d5-c670-4f5d-8daf-e6282104e0fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bf8d164ece941eeb11f878cd38d0518'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:00.209164 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1042/2044] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:19:00 2022] DELETE /identity/v3/users/6bf8d164ece941eeb11f878cd38d0518 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:19:00.214073 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bdadb9-b142-4e45-b35a-aa791f82b296 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:00.214391 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bdadb9-b142-4e45-b35a-aa791f82b296 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:00.214655 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bdadb9-b142-4e45-b35a-aa791f82b296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:00.238440 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-61bdadb9-b142-4e45-b35a-aa791f82b296 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:19:00.239644 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-61bdadb9-b142-4e45-b35a-aa791f82b296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:00.308543 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f262d5-c670-4f5d-8daf-e6282104e0fa admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:00.310355 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-38f262d5-c670-4f5d-8daf-e6282104e0fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:00.316521 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1003/2045] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:19:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:19:00.317432 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bdadb9-b142-4e45-b35a-aa791f82b296 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:00.318821 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-61bdadb9-b142-4e45-b35a-aa791f82b296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:00.337001 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f262d5-c670-4f5d-8daf-e6282104e0fa admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:00.342896 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa834e3-7edd-4e6a-a8a5-d404140f51d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:00.343800 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa834e3-7edd-4e6a-a8a5-d404140f51d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:00.344110 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa834e3-7edd-4e6a-a8a5-d404140f51d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:00.344503 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa834e3-7edd-4e6a-a8a5-d404140f51d8 admin admin] PATH_INFO: `/v3/projects/be12b6e0559c4f618af171bebb6655d7` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:00.345763 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa834e3-7edd-4e6a-a8a5-d404140f51d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be12b6e0559c4f618af171bebb6655d7)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:00.347882 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa834e3-7edd-4e6a-a8a5-d404140f51d8 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:00.393377 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bdadb9-b142-4e45-b35a-aa791f82b296 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:00.403812 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:00.406767 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-9fa834e3-7edd-4e6a-a8a5-d404140f51d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be12b6e0559c4f618af171bebb6655d7', 'request_id': 'req-9fa834e3-7edd-4e6a-a8a5-d404140f51d8'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:00.417673 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-9fa834e3-7edd-4e6a-a8a5-d404140f51d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be12b6e0559c4f618af171bebb6655d7', 'request_id': 'req-9fa834e3-7edd-4e6a-a8a5-d404140f51d8'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:00.425970 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-9fa834e3-7edd-4e6a-a8a5-d404140f51d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be12b6e0559c4f618af171bebb6655d7', 'request_id': 'req-9fa834e3-7edd-4e6a-a8a5-d404140f51d8'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:00.436674 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:00.442244 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-9fa834e3-7edd-4e6a-a8a5-d404140f51d8 admin admin] The token cache is being invalidate because project be12b6e0559c4f618af171bebb6655d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:19:00.442696 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-9fa834e3-7edd-4e6a-a8a5-d404140f51d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:00.444135 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-9fa834e3-7edd-4e6a-a8a5-d404140f51d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:00.446567 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1043/2046] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:19:00 2022] DELETE /identity/v3/projects/be12b6e0559c4f618af171bebb6655d7 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:19:00.448188 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa834e3-7edd-4e6a-a8a5-d404140f51d8 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:00.449911 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-9fa834e3-7edd-4e6a-a8a5-d404140f51d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:00.456146 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7a4890-74f2-47c3-b286-7bc79c6cf7ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f86373d65440da97c853fff3c1d0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:00.457075 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7a4890-74f2-47c3-b286-7bc79c6cf7ba service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:00.457515 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7a4890-74f2-47c3-b286-7bc79c6cf7ba service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:00.457794 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7a4890-74f2-47c3-b286-7bc79c6cf7ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:00.461921 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ce7a4890-74f2-47c3-b286-7bc79c6cf7ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:00.513693 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa834e3-7edd-4e6a-a8a5-d404140f51d8 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:00.517449 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ef59b5-5154-4f58-8b0c-db2a46d7b057 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:00.518179 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ef59b5-5154-4f58-8b0c-db2a46d7b057 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:00.518539 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ef59b5-5154-4f58-8b0c-db2a46d7b057 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:00.518882 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ef59b5-5154-4f58-8b0c-db2a46d7b057 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:00.520786 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-48ef59b5-5154-4f58-8b0c-db2a46d7b057 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:00.537714 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7a4890-74f2-47c3-b286-7bc79c6cf7ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:00.539179 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7a4890-74f2-47c3-b286-7bc79c6cf7ba service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:00.550320 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1004/2047] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:19:00 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:19:00.551622 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad1c6f4-fbac-4054-acfe-3684a53c63ec None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:00.551946 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad1c6f4-fbac-4054-acfe-3684a53c63ec None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:00.552223 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad1c6f4-fbac-4054-acfe-3684a53c63ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:00.569974 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-6ad1c6f4-fbac-4054-acfe-3684a53c63ec None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:19:00.571186 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6ad1c6f4-fbac-4054-acfe-3684a53c63ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:00.587181 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ef59b5-5154-4f58-8b0c-db2a46d7b057 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:00.588729 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ef59b5-5154-4f58-8b0c-db2a46d7b057 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:00.601874 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1044/2048] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:19:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:19:00.641316 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1005/2049] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:19:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:19:00.650500 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ff060-4e0e-43e6-a3d2-42fd9a7857be None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:00.650794 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ff060-4e0e-43e6-a3d2-42fd9a7857be None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:00.651082 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ff060-4e0e-43e6-a3d2-42fd9a7857be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:00.674694 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-db1ff060-4e0e-43e6-a3d2-42fd9a7857be None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:19:00.676055 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-db1ff060-4e0e-43e6-a3d2-42fd9a7857be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:00.684986 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1045/2050] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:19:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:19:00.689738 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad1c6f4-fbac-4054-acfe-3684a53c63ec None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:00.710106 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad1c6f4-fbac-4054-acfe-3684a53c63ec None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:00.717124 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e95f81-f521-4765-b234-d986bbddab4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:00.717814 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e95f81-f521-4765-b234-d986bbddab4c admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:00.718100 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e95f81-f521-4765-b234-d986bbddab4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:00.718381 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e95f81-f521-4765-b234-d986bbddab4c admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:00.719197 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e95f81-f521-4765-b234-d986bbddab4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:19:00.719516 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e95f81-f521-4765-b234-d986bbddab4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:00.721198 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e95f81-f521-4765-b234-d986bbddab4c admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:00.735852 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1006/2051] 10.222.0.42 () {58 vars in 1152 bytes} [Mon Jul 4 09:19:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:19:00.740478 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1ff060-4e0e-43e6-a3d2-42fd9a7857be None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:00.751160 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1ff060-4e0e-43e6-a3d2-42fd9a7857be None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:00.755957 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e52c6f4-d5f2-44f4-a1b0-3d786a17c9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:00.756671 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52c6f4-d5f2-44f4-a1b0-3d786a17c9bb admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:00.756960 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52c6f4-d5f2-44f4-a1b0-3d786a17c9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:00.757406 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52c6f4-d5f2-44f4-a1b0-3d786a17c9bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:00.758087 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e52c6f4-d5f2-44f4-a1b0-3d786a17c9bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:00.760123 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e52c6f4-d5f2-44f4-a1b0-3d786a17c9bb admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:00.794695 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1046/2052] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:19:00 2022] POST /identity/v3/projects => generated 381 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:19:00.796976 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e95f81-f521-4765-b234-d986bbddab4c admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:00.807420 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e95f81-f521-4765-b234-d986bbddab4c admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:00.856592 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:00.867342 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aa0da9-4bc2-4b6b-9fea-cd60ec9f00ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:00.868095 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa0da9-4bc2-4b6b-9fea-cd60ec9f00ff admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:00.868380 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa0da9-4bc2-4b6b-9fea-cd60ec9f00ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:00.868657 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa0da9-4bc2-4b6b-9fea-cd60ec9f00ff admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:00.869356 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aa0da9-4bc2-4b6b-9fea-cd60ec9f00ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:00.871462 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aa0da9-4bc2-4b6b-9fea-cd60ec9f00ff admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:00.901082 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1007/2053] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:19:00 2022] POST /identity/v3/users => generated 291 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:19:00.901536 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e52c6f4-d5f2-44f4-a1b0-3d786a17c9bb admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:00.916214 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aa0da9-4bc2-4b6b-9fea-cd60ec9f00ff admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:00.916997 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e52c6f4-d5f2-44f4-a1b0-3d786a17c9bb admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:00.918790 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-54aa0da9-4bc2-4b6b-9fea-cd60ec9f00ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:00.927736 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbce0b32-9aa7-4264-9bf6-500930c1f474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:00.928492 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce0b32-9aa7-4264-9bf6-500930c1f474 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:00.928728 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce0b32-9aa7-4264-9bf6-500930c1f474 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:00.929005 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce0b32-9aa7-4264-9bf6-500930c1f474 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:00.936078 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbce0b32-9aa7-4264-9bf6-500930c1f474 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:00.938775 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbce0b32-9aa7-4264-9bf6-500930c1f474 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:00.940402 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aa0da9-4bc2-4b6b-9fea-cd60ec9f00ff admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:00.947002 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4fa028-8c5f-4aee-9be5-f69481aa808c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:00.949945 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4fa028-8c5f-4aee-9be5-f69481aa808c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:00.950231 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4fa028-8c5f-4aee-9be5-f69481aa808c admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:00.950613 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4fa028-8c5f-4aee-9be5-f69481aa808c admin admin] PATH_INFO: `/v3/projects/d8089401f7d54004af774ed8939a5fbe` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:00.951856 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4fa028-8c5f-4aee-9be5-f69481aa808c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8089401f7d54004af774ed8939a5fbe)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:00.953804 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4fa028-8c5f-4aee-9be5-f69481aa808c admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:00.965166 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1047/2054] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:19:00 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:19:00.966402 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbce0b32-9aa7-4264-9bf6-500930c1f474 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:00.979215 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbce0b32-9aa7-4264-9bf6-500930c1f474 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:00.985484 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dcd4b8-f27d-49fe-a7b4-ec029b15dec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:00.986230 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dcd4b8-f27d-49fe-a7b4-ec029b15dec6 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:00.986516 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dcd4b8-f27d-49fe-a7b4-ec029b15dec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:00.986794 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dcd4b8-f27d-49fe-a7b4-ec029b15dec6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:00.987536 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dcd4b8-f27d-49fe-a7b4-ec029b15dec6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:00.989414 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dcd4b8-f27d-49fe-a7b4-ec029b15dec6 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:01.004678 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1048/2055] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:19:00 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:19:01.005556 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dcd4b8-f27d-49fe-a7b4-ec029b15dec6 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:01.017685 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dcd4b8-f27d-49fe-a7b4-ec029b15dec6 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:01.032898 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3e4fa028-8c5f-4aee-9be5-f69481aa808c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8089401f7d54004af774ed8939a5fbe', 'request_id': 'req-3e4fa028-8c5f-4aee-9be5-f69481aa808c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:01.040551 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3e4fa028-8c5f-4aee-9be5-f69481aa808c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8089401f7d54004af774ed8939a5fbe', 'request_id': 'req-3e4fa028-8c5f-4aee-9be5-f69481aa808c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:01.058559 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3e4fa028-8c5f-4aee-9be5-f69481aa808c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8089401f7d54004af774ed8939a5fbe', 'request_id': 'req-3e4fa028-8c5f-4aee-9be5-f69481aa808c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:01.079099 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3e4fa028-8c5f-4aee-9be5-f69481aa808c admin admin] The token cache is being invalidate because project d8089401f7d54004af774ed8939a5fbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:19:01.079394 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3e4fa028-8c5f-4aee-9be5-f69481aa808c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:01.080110 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3e4fa028-8c5f-4aee-9be5-f69481aa808c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:01.081715 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1008/2056] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:19:00 2022] DELETE /identity/v3/projects/d8089401f7d54004af774ed8939a5fbe => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:19:01.089316 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050aaf0-6c4e-41da-b5e0-e410d403b527 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:01.089612 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050aaf0-6c4e-41da-b5e0-e410d403b527 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:01.089894 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050aaf0-6c4e-41da-b5e0-e410d403b527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:01.108198 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e8b6fc-754b-4d8b-8161-02765bf91443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:01.109000 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e8b6fc-754b-4d8b-8161-02765bf91443 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:01.109265 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e8b6fc-754b-4d8b-8161-02765bf91443 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:01.109541 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e8b6fc-754b-4d8b-8161-02765bf91443 admin admin] PATH_INFO: `/v3/projects/395bb58077424ca2aa313499e2f5e024/users/6c42453972074141bc488a7525239c2a/roles/81634e7812344f84afcb29b0dba2687c` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:01.112576 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:01.126055 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-6050aaf0-6c4e-41da-b5e0-e410d403b527 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:19:01.127831 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6050aaf0-6c4e-41da-b5e0-e410d403b527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:01.131450 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e8b6fc-754b-4d8b-8161-02765bf91443 admin admin] RBAC: Authorizing `identity:create_grant(project_id=395bb58077424ca2aa313499e2f5e024, user_id=6c42453972074141bc488a7525239c2a, role_id=81634e7812344f84afcb29b0dba2687c)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:01.134253 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e8b6fc-754b-4d8b-8161-02765bf91443 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:01.145311 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1009/2057] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:19:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:19:01.153385 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5682d400-e53a-48aa-9a48-1816e56b45bf None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:01.153671 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5682d400-e53a-48aa-9a48-1816e56b45bf None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:01.153956 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5682d400-e53a-48aa-9a48-1816e56b45bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:01.155734 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1049/2058] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:19:01 2022] PUT /identity/v3/projects/395bb58077424ca2aa313499e2f5e024/users/6c42453972074141bc488a7525239c2a/roles/81634e7812344f84afcb29b0dba2687c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:19:01.167366 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518045f9-efc3-4ff9-8dcc-fa19a43a340d None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:01.167663 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518045f9-efc3-4ff9-8dcc-fa19a43a340d None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:01.167976 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518045f9-efc3-4ff9-8dcc-fa19a43a340d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:01.184685 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-5682d400-e53a-48aa-9a48-1816e56b45bf None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:19:01.186046 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-5682d400-e53a-48aa-9a48-1816e56b45bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:01.222821 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-518045f9-efc3-4ff9-8dcc-fa19a43a340d None None] MFA Rules not processed for user `6c42453972074141bc488a7525239c2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:19:01.224623 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-518045f9-efc3-4ff9-8dcc-fa19a43a340d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:01.265113 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1010/2059] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:19:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:19:01.266173 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5682d400-e53a-48aa-9a48-1816e56b45bf None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:01.267592 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-5682d400-e53a-48aa-9a48-1816e56b45bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:01.280208 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5682d400-e53a-48aa-9a48-1816e56b45bf None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:01.284944 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7854a131-26bb-43b7-93e1-18b59d8ef203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:01.285818 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854a131-26bb-43b7-93e1-18b59d8ef203 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:01.286099 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854a131-26bb-43b7-93e1-18b59d8ef203 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:01.286522 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854a131-26bb-43b7-93e1-18b59d8ef203 admin admin] PATH_INFO: `/v3/users/140b3e578b89423da615c826585d7a8b` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:01.287727 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7854a131-26bb-43b7-93e1-18b59d8ef203 admin admin] RBAC: Authorizing `identity:delete_user(user_id=140b3e578b89423da615c826585d7a8b)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:01.289761 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7854a131-26bb-43b7-93e1-18b59d8ef203 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:01.299254 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1050/2060] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:19:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:19:01.300811 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518045f9-efc3-4ff9-8dcc-fa19a43a340d None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:01.313077 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518045f9-efc3-4ff9-8dcc-fa19a43a340d None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:01.318226 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0e3b95-7ad3-4478-adc9-e400ede44b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:01.318906 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e3b95-7ad3-4478-adc9-e400ede44b53 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:01.319182 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e3b95-7ad3-4478-adc9-e400ede44b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:01.319459 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e3b95-7ad3-4478-adc9-e400ede44b53 admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:01.320250 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0e3b95-7ad3-4478-adc9-e400ede44b53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:19:01.320539 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0e3b95-7ad3-4478-adc9-e400ede44b53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:01.322170 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0e3b95-7ad3-4478-adc9-e400ede44b53 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:01.339844 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1051/2061] 10.222.0.42 () {58 vars in 1152 bytes} [Mon Jul 4 09:19:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:19:01.340800 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0e3b95-7ad3-4478-adc9-e400ede44b53 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:01.343525 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-2a0e3b95-7ad3-4478-adc9-e400ede44b53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:01.352805 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7854a131-26bb-43b7-93e1-18b59d8ef203 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '140b3e578b89423da615c826585d7a8b'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:01.353574 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7854a131-26bb-43b7-93e1-18b59d8ef203 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '140b3e578b89423da615c826585d7a8b'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:01.358472 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=80,keystone:INSERT=5,keystone:DELETE=15 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:01.361817 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0e3b95-7ad3-4478-adc9-e400ede44b53 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:01.363727 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7854a131-26bb-43b7-93e1-18b59d8ef203 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '140b3e578b89423da615c826585d7a8b'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:01.364939 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7854a131-26bb-43b7-93e1-18b59d8ef203 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '140b3e578b89423da615c826585d7a8b'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:01.366841 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ec059b-3def-474c-a909-dd6cfa2dcf64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:01.367626 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec059b-3def-474c-a909-dd6cfa2dcf64 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:01.367944 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec059b-3def-474c-a909-dd6cfa2dcf64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:01.368224 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec059b-3def-474c-a909-dd6cfa2dcf64 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:01.369798 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ec059b-3def-474c-a909-dd6cfa2dcf64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:01.371050 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ec059b-3def-474c-a909-dd6cfa2dcf64 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:01.381087 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7854a131-26bb-43b7-93e1-18b59d8ef203 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '140b3e578b89423da615c826585d7a8b'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:01.396818 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1011/2062] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:19:01 2022] DELETE /identity/v3/users/140b3e578b89423da615c826585d7a8b => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:19:01.397985 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7854a131-26bb-43b7-93e1-18b59d8ef203 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:01.398399 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1052/2063] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:19:01 2022] POST /identity/v3/projects => generated 379 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:19:01.399719 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-7854a131-26bb-43b7-93e1-18b59d8ef203 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:01.401455 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb489f5-2eff-4d48-a445-9d0e88461b0c None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:01.401747 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb489f5-2eff-4d48-a445-9d0e88461b0c None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:01.402046 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb489f5-2eff-4d48-a445-9d0e88461b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:01.423662 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-6eb489f5-2eff-4d48-a445-9d0e88461b0c None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:19:01.425252 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-6eb489f5-2eff-4d48-a445-9d0e88461b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:01.472148 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7854a131-26bb-43b7-93e1-18b59d8ef203 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:01.504001 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1053/2064] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:19:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:19:01.504001 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb489f5-2eff-4d48-a445-9d0e88461b0c None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:01.504001 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-6eb489f5-2eff-4d48-a445-9d0e88461b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:01.515475 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb489f5-2eff-4d48-a445-9d0e88461b0c None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:01.520637 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1dea80-a59b-4e33-a27a-fddcd58acd4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:01.521383 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1dea80-a59b-4e33-a27a-fddcd58acd4d admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:01.521722 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1dea80-a59b-4e33-a27a-fddcd58acd4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:01.522057 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1dea80-a59b-4e33-a27a-fddcd58acd4d admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:01.522809 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1dea80-a59b-4e33-a27a-fddcd58acd4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:01.525653 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1dea80-a59b-4e33-a27a-fddcd58acd4d admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:01.543481 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5681ea30-29d7-40ba-be61-f2a33e6a00cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:01.544193 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5681ea30-29d7-40ba-be61-f2a33e6a00cd admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:01.544472 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5681ea30-29d7-40ba-be61-f2a33e6a00cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:01.544750 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5681ea30-29d7-40ba-be61-f2a33e6a00cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:01.545524 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5681ea30-29d7-40ba-be61-f2a33e6a00cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:01.547443 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5681ea30-29d7-40ba-be61-f2a33e6a00cd admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:01.551393 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1054/2065] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:19:01 2022] POST /identity/v3/users => generated 296 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:19:01.551393 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1dea80-a59b-4e33-a27a-fddcd58acd4d admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:01.551393 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-7b1dea80-a59b-4e33-a27a-fddcd58acd4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:01.577987 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1012/2066] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:19:01 2022] POST /identity/v3/projects => generated 375 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:19:01.577987 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5681ea30-29d7-40ba-be61-f2a33e6a00cd admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:01.578258 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:01.612968 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1dea80-a59b-4e33-a27a-fddcd58acd4d admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:01.638848 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5681ea30-29d7-40ba-be61-f2a33e6a00cd admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:01.644112 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c7cb4f-30ee-4eef-b31e-ec2b1707baa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:01.644908 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c7cb4f-30ee-4eef-b31e-ec2b1707baa4 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:01.645202 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c7cb4f-30ee-4eef-b31e-ec2b1707baa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:01.645477 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c7cb4f-30ee-4eef-b31e-ec2b1707baa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:01.646217 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c7cb4f-30ee-4eef-b31e-ec2b1707baa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:01.647971 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c7cb4f-30ee-4eef-b31e-ec2b1707baa4 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:01.650190 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:01.659638 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1013/2067] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:19:01 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:19:01.660986 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c7cb4f-30ee-4eef-b31e-ec2b1707baa4 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:01.665907 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfc3726-eebc-4a3c-a696-c619bf9ee59c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:01.666584 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc3726-eebc-4a3c-a696-c619bf9ee59c service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:01.666871 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc3726-eebc-4a3c-a696-c619bf9ee59c service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:01.667155 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc3726-eebc-4a3c-a696-c619bf9ee59c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:01.672441 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c7cb4f-30ee-4eef-b31e-ec2b1707baa4 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:01.677406 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04e0990-d6ed-4512-862a-22c6349d1d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:01.677567 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfc3726-eebc-4a3c-a696-c619bf9ee59c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:01.678216 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e0990-d6ed-4512-862a-22c6349d1d6a admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:01.678562 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e0990-d6ed-4512-862a-22c6349d1d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:01.678838 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e0990-d6ed-4512-862a-22c6349d1d6a admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:01.678939 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfc3726-eebc-4a3c-a696-c619bf9ee59c service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:01.679602 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04e0990-d6ed-4512-862a-22c6349d1d6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:01.681820 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04e0990-d6ed-4512-862a-22c6349d1d6a admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:01.689040 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1055/2068] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:19:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:19:01.689826 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfc3726-eebc-4a3c-a696-c619bf9ee59c service neutron] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:01.702795 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfc3726-eebc-4a3c-a696-c619bf9ee59c service neutron] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:01.706674 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1014/2069] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:19:01 2022] POST /identity/v3/users => generated 288 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:19:01.707526 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b160be4-565a-4a96-a4ff-3f658fe8815c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:01.708499 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b160be4-565a-4a96-a4ff-3f658fe8815c admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:01.708791 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b160be4-565a-4a96-a4ff-3f658fe8815c admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:01.709324 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b160be4-565a-4a96-a4ff-3f658fe8815c admin admin] PATH_INFO: `/v3/projects/ce7758b8174d41f398470cda3ef501ce/users/1728351407994f1abb930ae40b36eedd/roles/965049e7ce6144aaad23c15f3a5e37c3` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:01.710897 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04e0990-d6ed-4512-862a-22c6349d1d6a admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:01.724314 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04e0990-d6ed-4512-862a-22c6349d1d6a admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:01.725957 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b160be4-565a-4a96-a4ff-3f658fe8815c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce7758b8174d41f398470cda3ef501ce, user_id=1728351407994f1abb930ae40b36eedd, role_id=965049e7ce6144aaad23c15f3a5e37c3)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:01.729483 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3190da5b-6137-47aa-8c87-41c311764a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:01.729663 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b160be4-565a-4a96-a4ff-3f658fe8815c admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:01.730338 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190da5b-6137-47aa-8c87-41c311764a8e admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:01.730687 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190da5b-6137-47aa-8c87-41c311764a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:01.731049 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190da5b-6137-47aa-8c87-41c311764a8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:01.731861 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3190da5b-6137-47aa-8c87-41c311764a8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:01.733642 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3190da5b-6137-47aa-8c87-41c311764a8e admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:01.745682 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1056/2070] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:19:01 2022] PUT /identity/v3/projects/ce7758b8174d41f398470cda3ef501ce/users/1728351407994f1abb930ae40b36eedd/roles/965049e7ce6144aaad23c15f3a5e37c3 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:19:01.748740 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1015/2071] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:19:01 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:19:01.749747 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b160be4-565a-4a96-a4ff-3f658fe8815c admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:01.751898 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3190da5b-6137-47aa-8c87-41c311764a8e admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:01.765920 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3190da5b-6137-47aa-8c87-41c311764a8e admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:01.824233 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b160be4-565a-4a96-a4ff-3f658fe8815c admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:01.829197 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c008b3-6377-47fe-a086-a0fb5d581787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:01.829886 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c008b3-6377-47fe-a086-a0fb5d581787 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:01.830190 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c008b3-6377-47fe-a086-a0fb5d581787 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:01.830472 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c008b3-6377-47fe-a086-a0fb5d581787 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:01.831224 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c008b3-6377-47fe-a086-a0fb5d581787 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:01.831968 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447d377f-93f6-4396-b90c-ed55cfeef6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:01.832724 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d377f-93f6-4396-b90c-ed55cfeef6bf admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:01.832893 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c008b3-6377-47fe-a086-a0fb5d581787 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:01.833141 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d377f-93f6-4396-b90c-ed55cfeef6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:01.833471 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d377f-93f6-4396-b90c-ed55cfeef6bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:01.834382 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447d377f-93f6-4396-b90c-ed55cfeef6bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:01.836586 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447d377f-93f6-4396-b90c-ed55cfeef6bf admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:01.853675 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1016/2072] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:19:01 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:19:01.857136 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1057/2073] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:19:01 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:19:01.860720 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447d377f-93f6-4396-b90c-ed55cfeef6bf admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:01.861282 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c008b3-6377-47fe-a086-a0fb5d581787 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:01.871466 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447d377f-93f6-4396-b90c-ed55cfeef6bf admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:01.872595 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c008b3-6377-47fe-a086-a0fb5d581787 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:01.877511 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf78d81-5c64-4d40-aadb-95d1f11b0211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:01.878466 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf78d81-5c64-4d40-aadb-95d1f11b0211 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:01.878748 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf78d81-5c64-4d40-aadb-95d1f11b0211 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:01.879022 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf78d81-5c64-4d40-aadb-95d1f11b0211 admin admin] PATH_INFO: `/v3/projects/f78bdca77bef46fc8aa68a97e78b69a8/users/87486ee1824049ab89eebad4dbef12e3/roles/81634e7812344f84afcb29b0dba2687c` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:01.880821 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9259ab-1772-485f-9458-102ffacf81d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:01.881313 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9259ab-1772-485f-9458-102ffacf81d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:01.881595 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9259ab-1772-485f-9458-102ffacf81d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:01.881889 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9259ab-1772-485f-9458-102ffacf81d1 admin admin] PATH_INFO: `/v3/projects/ce7758b8174d41f398470cda3ef501ce/users/1728351407994f1abb930ae40b36eedd/roles/965049e7ce6144aaad23c15f3a5e37c3` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:01.884850 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9259ab-1772-485f-9458-102ffacf81d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce7758b8174d41f398470cda3ef501ce, user_id=1728351407994f1abb930ae40b36eedd, role_id=965049e7ce6144aaad23c15f3a5e37c3)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:01.888832 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9259ab-1772-485f-9458-102ffacf81d1 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:01.902219 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf78d81-5c64-4d40-aadb-95d1f11b0211 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f78bdca77bef46fc8aa68a97e78b69a8, user_id=87486ee1824049ab89eebad4dbef12e3, role_id=81634e7812344f84afcb29b0dba2687c)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:01.903349 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1058/2074] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:19:01 2022] PUT /identity/v3/projects/ce7758b8174d41f398470cda3ef501ce/users/1728351407994f1abb930ae40b36eedd/roles/965049e7ce6144aaad23c15f3a5e37c3 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:19:01.905190 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf78d81-5c64-4d40-aadb-95d1f11b0211 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:01.923143 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1017/2075] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:19:01 2022] PUT /identity/v3/projects/f78bdca77bef46fc8aa68a97e78b69a8/users/87486ee1824049ab89eebad4dbef12e3/roles/81634e7812344f84afcb29b0dba2687c => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:19:01.941658 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b2228-e28c-48ed-bfd8-443f810cf50b None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:01.941953 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b2228-e28c-48ed-bfd8-443f810cf50b None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:01.942238 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b2228-e28c-48ed-bfd8-443f810cf50b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:01.977809 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-f67b2228-e28c-48ed-bfd8-443f810cf50b None None] MFA Rules not processed for user `87486ee1824049ab89eebad4dbef12e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:19:01.979256 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-f67b2228-e28c-48ed-bfd8-443f810cf50b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:01.980279 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9170035-da63-4771-8bb2-e96558a114fd None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:01.980618 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9170035-da63-4771-8bb2-e96558a114fd None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:01.981027 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9170035-da63-4771-8bb2-e96558a114fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:02.017802 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-d9170035-da63-4771-8bb2-e96558a114fd None None] MFA Rules not processed for user `1728351407994f1abb930ae40b36eedd`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:19:02.019312 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d9170035-da63-4771-8bb2-e96558a114fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:02.022757 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:02.065236 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1059/2076] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:19:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:19:02.066213 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67b2228-e28c-48ed-bfd8-443f810cf50b None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:02.067573 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-f67b2228-e28c-48ed-bfd8-443f810cf50b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:02.092527 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1018/2077] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:19:01 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:19:02.093382 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9170035-da63-4771-8bb2-e96558a114fd None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:02.094676 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d9170035-da63-4771-8bb2-e96558a114fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:02.127246 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:02.138903 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67b2228-e28c-48ed-bfd8-443f810cf50b None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:02.144015 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9450145c-56fe-4e47-b647-a9649e10e46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:02.144941 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450145c-56fe-4e47-b647-a9649e10e46a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:02.145228 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450145c-56fe-4e47-b647-a9649e10e46a admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:02.145507 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450145c-56fe-4e47-b647-a9649e10e46a admin admin] PATH_INFO: `/v3/projects/2791b92dfb1e4b81ae6d8a009c6f9da5` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:02.146929 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9450145c-56fe-4e47-b647-a9649e10e46a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2791b92dfb1e4b81ae6d8a009c6f9da5)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:02.149042 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9450145c-56fe-4e47-b647-a9649e10e46a admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:02.176310 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9170035-da63-4771-8bb2-e96558a114fd None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:02.182481 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d5d638-0cfe-46c4-9509-2f9803bf5f89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3b6e252a8c434a99432bcece6493b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:02.183136 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d5d638-0cfe-46c4-9509-2f9803bf5f89 service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:02.183421 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d5d638-0cfe-46c4-9509-2f9803bf5f89 service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:02.183794 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d5d638-0cfe-46c4-9509-2f9803bf5f89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:02.192337 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d5d638-0cfe-46c4-9509-2f9803bf5f89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:02.195921 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d5d638-0cfe-46c4-9509-2f9803bf5f89 service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:02.203718 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1019/2078] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:19:02 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:19:02.203884 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-9450145c-56fe-4e47-b647-a9649e10e46a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2791b92dfb1e4b81ae6d8a009c6f9da5', 'request_id': 'req-9450145c-56fe-4e47-b647-a9649e10e46a'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:02.204546 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d5d638-0cfe-46c4-9509-2f9803bf5f89 service nova] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:02.205891 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-67d5d638-0cfe-46c4-9509-2f9803bf5f89 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:02.214432 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-9450145c-56fe-4e47-b647-a9649e10e46a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2791b92dfb1e4b81ae6d8a009c6f9da5', 'request_id': 'req-9450145c-56fe-4e47-b647-a9649e10e46a'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:02.222449 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-9450145c-56fe-4e47-b647-a9649e10e46a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2791b92dfb1e4b81ae6d8a009c6f9da5', 'request_id': 'req-9450145c-56fe-4e47-b647-a9649e10e46a'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:02.252141 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-9450145c-56fe-4e47-b647-a9649e10e46a admin admin] The token cache is being invalidate because project 2791b92dfb1e4b81ae6d8a009c6f9da5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:19:02.252141 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-9450145c-56fe-4e47-b647-a9649e10e46a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:02.252141 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-9450145c-56fe-4e47-b647-a9649e10e46a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:02.253638 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1060/2079] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:19:02 2022] DELETE /identity/v3/projects/2791b92dfb1e4b81ae6d8a009c6f9da5 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:19:02.258630 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7761c2bc-9bce-48c2-b35c-704589187468 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:02.260460 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7761c2bc-9bce-48c2-b35c-704589187468 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:02.260460 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7761c2bc-9bce-48c2-b35c-704589187468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:02.288733 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d5d638-0cfe-46c4-9509-2f9803bf5f89 service nova] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:02.289578 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-7761c2bc-9bce-48c2-b35c-704589187468 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:19:02.291353 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-7761c2bc-9bce-48c2-b35c-704589187468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:02.367062 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72d5434-a4db-4270-8175-37a92fde45b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f86373d65440da97c853fff3c1d0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:02.368602 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d5434-a4db-4270-8175-37a92fde45b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:02.369000 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d5434-a4db-4270-8175-37a92fde45b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:02.369244 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d5434-a4db-4270-8175-37a92fde45b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:02.371027 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c72d5434-a4db-4270-8175-37a92fde45b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:02.378951 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:02.397525 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1061/2080] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:19:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:19:02.405976 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68636eb8-6849-4abf-a2af-45e09fddb7e0 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:02.406278 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68636eb8-6849-4abf-a2af-45e09fddb7e0 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:02.406560 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68636eb8-6849-4abf-a2af-45e09fddb7e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:02.427681 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-68636eb8-6849-4abf-a2af-45e09fddb7e0 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:19:02.428927 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-68636eb8-6849-4abf-a2af-45e09fddb7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:02.443910 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1062/2081] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:19:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:19:02.444531 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68636eb8-6849-4abf-a2af-45e09fddb7e0 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:02.445819 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-68636eb8-6849-4abf-a2af-45e09fddb7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:02.457876 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68636eb8-6849-4abf-a2af-45e09fddb7e0 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:02.458125 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72d5434-a4db-4270-8175-37a92fde45b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:02.459686 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72d5434-a4db-4270-8175-37a92fde45b8 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:02.462348 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7044d4b8-e7a7-4e1a-b048-5007e7ccf334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:02.463196 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7044d4b8-e7a7-4e1a-b048-5007e7ccf334 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:02.463480 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7044d4b8-e7a7-4e1a-b048-5007e7ccf334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:02.463752 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7044d4b8-e7a7-4e1a-b048-5007e7ccf334 admin admin] PATH_INFO: `/v3/users/87486ee1824049ab89eebad4dbef12e3` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:02.464956 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7044d4b8-e7a7-4e1a-b048-5007e7ccf334 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87486ee1824049ab89eebad4dbef12e3)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:02.466965 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7044d4b8-e7a7-4e1a-b048-5007e7ccf334 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:02.469550 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1020/2082] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:19:02 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:19:02.472195 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72d5434-a4db-4270-8175-37a92fde45b8 service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:02.485734 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72d5434-a4db-4270-8175-37a92fde45b8 service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:02.492049 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea2ae23-f0d4-4657-9c07-f5496f59314f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:02.493100 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea2ae23-f0d4-4657-9c07-f5496f59314f admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:02.493535 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea2ae23-f0d4-4657-9c07-f5496f59314f admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:02.494039 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea2ae23-f0d4-4657-9c07-f5496f59314f admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:02.495110 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea2ae23-f0d4-4657-9c07-f5496f59314f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:19:02.495539 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea2ae23-f0d4-4657-9c07-f5496f59314f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:02.497415 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea2ae23-f0d4-4657-9c07-f5496f59314f admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:02.511617 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1021/2083] 10.222.0.42 () {58 vars in 1152 bytes} [Mon Jul 4 09:19:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:19:02.516312 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea2ae23-f0d4-4657-9c07-f5496f59314f admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:02.524646 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:02.529477 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-7044d4b8-e7a7-4e1a-b048-5007e7ccf334 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87486ee1824049ab89eebad4dbef12e3'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:02.530658 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea2ae23-f0d4-4657-9c07-f5496f59314f admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:02.537223 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efb7fa0-579a-47c3-bd1e-e1f516a8b1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:02.545369 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-7044d4b8-e7a7-4e1a-b048-5007e7ccf334 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87486ee1824049ab89eebad4dbef12e3'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:02.546195 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-7044d4b8-e7a7-4e1a-b048-5007e7ccf334 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87486ee1824049ab89eebad4dbef12e3'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:02.547299 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-7044d4b8-e7a7-4e1a-b048-5007e7ccf334 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87486ee1824049ab89eebad4dbef12e3'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:02.548452 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efb7fa0-579a-47c3-bd1e-e1f516a8b1aa admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:02.548811 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efb7fa0-579a-47c3-bd1e-e1f516a8b1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:02.549018 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efb7fa0-579a-47c3-bd1e-e1f516a8b1aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:02.549777 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efb7fa0-579a-47c3-bd1e-e1f516a8b1aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:02.552137 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efb7fa0-579a-47c3-bd1e-e1f516a8b1aa admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:02.566268 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-7044d4b8-e7a7-4e1a-b048-5007e7ccf334 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87486ee1824049ab89eebad4dbef12e3'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:02.583678 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1063/2084] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:19:02 2022] DELETE /identity/v3/users/87486ee1824049ab89eebad4dbef12e3 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:19:02.588801 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9af04e-177b-423f-b96b-3a931bcde338 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:02.589214 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9af04e-177b-423f-b96b-3a931bcde338 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:02.589638 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9af04e-177b-423f-b96b-3a931bcde338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:02.592648 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1022/2085] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:19:02 2022] POST /identity/v3/projects => generated 375 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:19:02.593533 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efb7fa0-579a-47c3-bd1e-e1f516a8b1aa admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:02.595194 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9efb7fa0-579a-47c3-bd1e-e1f516a8b1aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:02.615072 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-0e9af04e-177b-423f-b96b-3a931bcde338 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:19:02.616997 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-0e9af04e-177b-423f-b96b-3a931bcde338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:02.692722 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efb7fa0-579a-47c3-bd1e-e1f516a8b1aa admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:02.700975 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47a4390-dde5-42ea-9c1a-b7d4b8008e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:02.701885 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a4390-dde5-42ea-9c1a-b7d4b8008e1b admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:02.702748 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a4390-dde5-42ea-9c1a-b7d4b8008e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:02.703206 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a4390-dde5-42ea-9c1a-b7d4b8008e1b admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:02.704138 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47a4390-dde5-42ea-9c1a-b7d4b8008e1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:02.706845 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47a4390-dde5-42ea-9c1a-b7d4b8008e1b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:02.707570 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1064/2086] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:19:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:19:02.726714 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9af04e-177b-423f-b96b-3a931bcde338 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:02.730526 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-0e9af04e-177b-423f-b96b-3a931bcde338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:02.745050 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1023/2087] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:19:02 2022] POST /identity/v3/users => generated 288 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:19:02.749699 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47a4390-dde5-42ea-9c1a-b7d4b8008e1b admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:02.762830 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47a4390-dde5-42ea-9c1a-b7d4b8008e1b admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:02.768843 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba7a9c-9158-44fa-8641-93c18723a411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:02.769591 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba7a9c-9158-44fa-8641-93c18723a411 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:02.769869 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba7a9c-9158-44fa-8641-93c18723a411 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:02.770140 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba7a9c-9158-44fa-8641-93c18723a411 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:02.770874 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ba7a9c-9158-44fa-8641-93c18723a411 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:02.772720 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ba7a9c-9158-44fa-8641-93c18723a411 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:02.787580 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1024/2088] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:19:02 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:19:02.791144 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba7a9c-9158-44fa-8641-93c18723a411 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:02.802436 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba7a9c-9158-44fa-8641-93c18723a411 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:02.805207 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9af04e-177b-423f-b96b-3a931bcde338 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:02.807088 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1241f416-da85-4295-9387-62e7b68621e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:02.807767 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1241f416-da85-4295-9387-62e7b68621e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:02.808074 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1241f416-da85-4295-9387-62e7b68621e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:02.808351 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1241f416-da85-4295-9387-62e7b68621e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:02.809048 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090f9b73-49a9-42d6-8133-727c927794c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:02.809183 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1241f416-da85-4295-9387-62e7b68621e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:02.809952 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f9b73-49a9-42d6-8133-727c927794c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:02.810238 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f9b73-49a9-42d6-8133-727c927794c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:02.810514 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f9b73-49a9-42d6-8133-727c927794c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:02.810741 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1241f416-da85-4295-9387-62e7b68621e3 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:02.822984 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090f9b73-49a9-42d6-8133-727c927794c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:02.827680 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1025/2089] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:19:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:19:02.828265 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090f9b73-49a9-42d6-8133-727c927794c9 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:02.829196 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1241f416-da85-4295-9387-62e7b68621e3 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:02.836306 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1065/2090] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:19:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:19:02.844578 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1241f416-da85-4295-9387-62e7b68621e3 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:02.849804 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce7f1e1-f24d-461f-9298-f314d789afc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:02.850859 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce7f1e1-f24d-461f-9298-f314d789afc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:02.851207 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce7f1e1-f24d-461f-9298-f314d789afc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:02.851548 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce7f1e1-f24d-461f-9298-f314d789afc7 admin admin] PATH_INFO: `/v3/projects/6e262745b913475f874fd3ad90b881fe/users/ad50c42d31734d5da86a92225a767c15/roles/81634e7812344f84afcb29b0dba2687c` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:02.868337 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce7f1e1-f24d-461f-9298-f314d789afc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e262745b913475f874fd3ad90b881fe, user_id=ad50c42d31734d5da86a92225a767c15, role_id=81634e7812344f84afcb29b0dba2687c)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:02.872023 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce7f1e1-f24d-461f-9298-f314d789afc7 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:02.894456 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1026/2091] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:19:02 2022] PUT /identity/v3/projects/6e262745b913475f874fd3ad90b881fe/users/ad50c42d31734d5da86a92225a767c15/roles/81634e7812344f84afcb29b0dba2687c => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:19:02.906330 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee509add-faf0-43dd-849d-75faf83b896a None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:02.906829 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee509add-faf0-43dd-849d-75faf83b896a None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:02.907401 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee509add-faf0-43dd-849d-75faf83b896a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:02.924231 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:02.938688 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce7f1e1-f24d-461f-9298-f314d789afc7 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:02.940778 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-7ce7f1e1-f24d-461f-9298-f314d789afc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:02.949372 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-ee509add-faf0-43dd-849d-75faf83b896a None None] MFA Rules not processed for user `ad50c42d31734d5da86a92225a767c15`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:19:02.950943 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-ee509add-faf0-43dd-849d-75faf83b896a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:03.022557 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce7f1e1-f24d-461f-9298-f314d789afc7 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:03.028030 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b5cc1-e161-4065-8ae2-e83fbadaa773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:03.028984 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b5cc1-e161-4065-8ae2-e83fbadaa773 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:03.029372 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b5cc1-e161-4065-8ae2-e83fbadaa773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:03.029752 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b5cc1-e161-4065-8ae2-e83fbadaa773 admin admin] PATH_INFO: `/v3/users/6c42453972074141bc488a7525239c2a` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:03.031228 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939b5cc1-e161-4065-8ae2-e83fbadaa773 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c42453972074141bc488a7525239c2a)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:03.031864 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1066/2092] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:19:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:19:03.033736 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939b5cc1-e161-4065-8ae2-e83fbadaa773 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:03.036471 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee509add-faf0-43dd-849d-75faf83b896a None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:03.047712 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee509add-faf0-43dd-849d-75faf83b896a None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:03.052672 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22657bd6-c7db-48ee-aa35-2f680fb4c305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:03.053378 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22657bd6-c7db-48ee-aa35-2f680fb4c305 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:03.053659 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22657bd6-c7db-48ee-aa35-2f680fb4c305 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:03.053929 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22657bd6-c7db-48ee-aa35-2f680fb4c305 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:03.054874 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22657bd6-c7db-48ee-aa35-2f680fb4c305 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:03.057400 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22657bd6-c7db-48ee-aa35-2f680fb4c305 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:03.070443 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:03.090962 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1067/2093] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:19:03 2022] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:19:03.093022 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-939b5cc1-e161-4065-8ae2-e83fbadaa773 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c42453972074141bc488a7525239c2a'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:03.095158 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22657bd6-c7db-48ee-aa35-2f680fb4c305 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:03.095918 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-939b5cc1-e161-4065-8ae2-e83fbadaa773 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c42453972074141bc488a7525239c2a'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:03.097329 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-22657bd6-c7db-48ee-aa35-2f680fb4c305 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:03.107048 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-939b5cc1-e161-4065-8ae2-e83fbadaa773 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c42453972074141bc488a7525239c2a'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:03.108156 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-939b5cc1-e161-4065-8ae2-e83fbadaa773 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c42453972074141bc488a7525239c2a'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:03.123456 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-939b5cc1-e161-4065-8ae2-e83fbadaa773 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c42453972074141bc488a7525239c2a'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:03.138946 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1027/2094] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:19:02 2022] DELETE /identity/v3/users/6c42453972074141bc488a7525239c2a => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:19:03.145674 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3316c-f238-4d26-a447-b38edf01f010 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:03.145975 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3316c-f238-4d26-a447-b38edf01f010 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:03.146273 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3316c-f238-4d26-a447-b38edf01f010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:03.172485 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-1dd3316c-f238-4d26-a447-b38edf01f010 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:19:03.174097 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-1dd3316c-f238-4d26-a447-b38edf01f010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:03.202269 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22657bd6-c7db-48ee-aa35-2f680fb4c305 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:03.241742 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1028/2095] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:19:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:19:03.242894 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd3316c-f238-4d26-a447-b38edf01f010 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:03.244403 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-1dd3316c-f238-4d26-a447-b38edf01f010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:03.257083 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd3316c-f238-4d26-a447-b38edf01f010 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:03.261956 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933a9c09-d79d-433d-b553-aba16c336f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:03.262960 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a9c09-d79d-433d-b553-aba16c336f0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:03.263318 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a9c09-d79d-433d-b553-aba16c336f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:03.263623 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a9c09-d79d-433d-b553-aba16c336f0f admin admin] PATH_INFO: `/v3/projects/f78bdca77bef46fc8aa68a97e78b69a8` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:03.264937 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933a9c09-d79d-433d-b553-aba16c336f0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f78bdca77bef46fc8aa68a97e78b69a8)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:03.266893 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933a9c09-d79d-433d-b553-aba16c336f0f admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:03.282558 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aee9590-e73c-4736-b1b2-749205c237fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:03.283251 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee9590-e73c-4736-b1b2-749205c237fd admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:03.283549 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee9590-e73c-4736-b1b2-749205c237fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:03.283828 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee9590-e73c-4736-b1b2-749205c237fd admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:03.284557 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aee9590-e73c-4736-b1b2-749205c237fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:03.286498 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aee9590-e73c-4736-b1b2-749205c237fd admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:03.311235 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1068/2096] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:19:03 2022] POST /identity/v3/users => generated 288 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:19:03.311235 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aee9590-e73c-4736-b1b2-749205c237fd admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:03.311235 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-4aee9590-e73c-4736-b1b2-749205c237fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:03.324533 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-933a9c09-d79d-433d-b553-aba16c336f0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f78bdca77bef46fc8aa68a97e78b69a8', 'request_id': 'req-933a9c09-d79d-433d-b553-aba16c336f0f'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:03.326056 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:03.331151 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-933a9c09-d79d-433d-b553-aba16c336f0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f78bdca77bef46fc8aa68a97e78b69a8', 'request_id': 'req-933a9c09-d79d-433d-b553-aba16c336f0f'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:03.341992 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-933a9c09-d79d-433d-b553-aba16c336f0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f78bdca77bef46fc8aa68a97e78b69a8', 'request_id': 'req-933a9c09-d79d-433d-b553-aba16c336f0f'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:03.360460 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-933a9c09-d79d-433d-b553-aba16c336f0f admin admin] The token cache is being invalidate because project f78bdca77bef46fc8aa68a97e78b69a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:19:03.360755 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-933a9c09-d79d-433d-b553-aba16c336f0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:03.361989 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-933a9c09-d79d-433d-b553-aba16c336f0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:03.367570 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1029/2097] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:19:03 2022] DELETE /identity/v3/projects/f78bdca77bef46fc8aa68a97e78b69a8 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:19:03.368609 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933a9c09-d79d-433d-b553-aba16c336f0f admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:03.371150 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-933a9c09-d79d-433d-b553-aba16c336f0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:03.388605 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aee9590-e73c-4736-b1b2-749205c237fd admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:03.413215 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:03.452645 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58425706-3019-420e-8913-9ed4774b6712 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:03.453331 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58425706-3019-420e-8913-9ed4774b6712 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:03.453608 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58425706-3019-420e-8913-9ed4774b6712 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:03.453880 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58425706-3019-420e-8913-9ed4774b6712 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:03.454543 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933a9c09-d79d-433d-b553-aba16c336f0f admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:03.456692 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-58425706-3019-420e-8913-9ed4774b6712 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:03.460678 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c87df3-657e-44e1-92de-868e52b1f5eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:03.461356 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c87df3-657e-44e1-92de-868e52b1f5eb admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:03.461640 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c87df3-657e-44e1-92de-868e52b1f5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:03.461916 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c87df3-657e-44e1-92de-868e52b1f5eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:03.463190 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c87df3-657e-44e1-92de-868e52b1f5eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:03.464417 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c87df3-657e-44e1-92de-868e52b1f5eb admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:03.472879 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58425706-3019-420e-8913-9ed4774b6712 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:03.475013 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58425706-3019-420e-8913-9ed4774b6712 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:03.476197 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1030/2098] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:19:03 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:19:03.477635 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c7f30-6dd9-4f2c-83b1-5f446590307f None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:03.477907 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c7f30-6dd9-4f2c-83b1-5f446590307f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:03.478183 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c7f30-6dd9-4f2c-83b1-5f446590307f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:03.488718 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1069/2099] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:19:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:19:03.489743 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58425706-3019-420e-8913-9ed4774b6712 service neutron] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:03.498206 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-966c7f30-6dd9-4f2c-83b1-5f446590307f None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:19:03.499541 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-966c7f30-6dd9-4f2c-83b1-5f446590307f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:03.501842 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58425706-3019-420e-8913-9ed4774b6712 service neutron] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:03.506870 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954d8802-105e-4455-b49c-e75771350c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:03.507807 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954d8802-105e-4455-b49c-e75771350c0d admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:03.508126 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954d8802-105e-4455-b49c-e75771350c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:03.508402 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954d8802-105e-4455-b49c-e75771350c0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:03.509136 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954d8802-105e-4455-b49c-e75771350c0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:03.510029 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1031/2100] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:19:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:19:03.511079 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954d8802-105e-4455-b49c-e75771350c0d admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:03.517583 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489fb263-ebfa-4e6c-ba23-9ea39f0dffcd None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:03.518176 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489fb263-ebfa-4e6c-ba23-9ea39f0dffcd None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:03.518538 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489fb263-ebfa-4e6c-ba23-9ea39f0dffcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:03.535837 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1070/2101] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:19:03 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:19:03.536321 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954d8802-105e-4455-b49c-e75771350c0d admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:03.548648 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954d8802-105e-4455-b49c-e75771350c0d admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:03.549519 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-489fb263-ebfa-4e6c-ba23-9ea39f0dffcd None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:19:03.551103 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-489fb263-ebfa-4e6c-ba23-9ea39f0dffcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:03.554192 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380d341c-a2b5-4269-9bdf-016f771d4233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:03.555419 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380d341c-a2b5-4269-9bdf-016f771d4233 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:03.555533 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380d341c-a2b5-4269-9bdf-016f771d4233 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:03.555759 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380d341c-a2b5-4269-9bdf-016f771d4233 admin admin] PATH_INFO: `/v3/projects/f96e6f65049f4c7eb75fd15b9578ef59/users/21e32b7bc73d449e9912752034301632/roles/81634e7812344f84afcb29b0dba2687c` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:03.569911 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1032/2102] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:19:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:19:03.574480 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489fb263-ebfa-4e6c-ba23-9ea39f0dffcd None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:03.580819 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380d341c-a2b5-4269-9bdf-016f771d4233 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f96e6f65049f4c7eb75fd15b9578ef59, user_id=21e32b7bc73d449e9912752034301632, role_id=81634e7812344f84afcb29b0dba2687c)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:03.584844 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380d341c-a2b5-4269-9bdf-016f771d4233 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:03.587030 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489fb263-ebfa-4e6c-ba23-9ea39f0dffcd None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:03.607023 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92663a-2265-4987-99ac-ec3a8b817d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:03.608161 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92663a-2265-4987-99ac-ec3a8b817d6a admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:03.608715 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92663a-2265-4987-99ac-ec3a8b817d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:03.609051 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92663a-2265-4987-99ac-ec3a8b817d6a admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:03.610218 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb92663a-2265-4987-99ac-ec3a8b817d6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:19:03.610334 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb92663a-2265-4987-99ac-ec3a8b817d6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:03.612323 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb92663a-2265-4987-99ac-ec3a8b817d6a admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:03.624066 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1071/2103] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:19:03 2022] PUT /identity/v3/projects/f96e6f65049f4c7eb75fd15b9578ef59/users/21e32b7bc73d449e9912752034301632/roles/81634e7812344f84afcb29b0dba2687c => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:19:03.633420 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac981a-1527-4c86-af0f-200a5900e5ce None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:03.633981 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac981a-1527-4c86-af0f-200a5900e5ce None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:03.634704 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac981a-1527-4c86-af0f-200a5900e5ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:03.642678 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1033/2104] 10.222.0.42 () {58 vars in 1152 bytes} [Mon Jul 4 09:19:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:19:03.644480 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92663a-2265-4987-99ac-ec3a8b817d6a admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:03.655748 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92663a-2265-4987-99ac-ec3a8b817d6a admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:03.678042 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-0cac981a-1527-4c86-af0f-200a5900e5ce None None] MFA Rules not processed for user `21e32b7bc73d449e9912752034301632`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:19:03.680172 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-0cac981a-1527-4c86-af0f-200a5900e5ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:03.725930 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3415f487-7d59-4972-8537-6ca5cc9d4d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:03.726621 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3415f487-7d59-4972-8537-6ca5cc9d4d39 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:03.726881 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3415f487-7d59-4972-8537-6ca5cc9d4d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:03.727154 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3415f487-7d59-4972-8537-6ca5cc9d4d39 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:03.727858 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3415f487-7d59-4972-8537-6ca5cc9d4d39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:03.729875 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3415f487-7d59-4972-8537-6ca5cc9d4d39 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:03.763273 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1034/2105] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:19:03 2022] POST /identity/v3/projects => generated 385 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:19:03.767418 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3415f487-7d59-4972-8537-6ca5cc9d4d39 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:03.777087 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1072/2106] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:19:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:19:03.782945 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac981a-1527-4c86-af0f-200a5900e5ce None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:03.815350 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac981a-1527-4c86-af0f-200a5900e5ce None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:03.858931 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:03.873831 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3415f487-7d59-4972-8537-6ca5cc9d4d39 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:03.886130 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b9cf04-b4b5-4176-8444-2443f6b118d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:03.886826 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9cf04-b4b5-4176-8444-2443f6b118d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:03.887276 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9cf04-b4b5-4176-8444-2443f6b118d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:03.887559 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9cf04-b4b5-4176-8444-2443f6b118d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:03.890946 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b9cf04-b4b5-4176-8444-2443f6b118d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:03.890946 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b9cf04-b4b5-4176-8444-2443f6b118d4 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:03.909222 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7f9d39-c08d-4f91-9f88-15b893805a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:03.912060 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f9d39-c08d-4f91-9f88-15b893805a03 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:03.912827 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f9d39-c08d-4f91-9f88-15b893805a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:03.913082 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f9d39-c08d-4f91-9f88-15b893805a03 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:03.915763 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7f9d39-c08d-4f91-9f88-15b893805a03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:03.921319 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7f9d39-c08d-4f91-9f88-15b893805a03 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:03.926956 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1035/2107] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:19:03 2022] POST /identity/v3/users => generated 293 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:19:03.945826 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b9cf04-b4b5-4176-8444-2443f6b118d4 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:03.971797 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b9cf04-b4b5-4176-8444-2443f6b118d4 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:03.984397 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86435a5d-267e-41f0-98f6-4deea1996264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:03.984704 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1073/2108] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:19:03 2022] POST /identity/v3/projects => generated 377 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:19:03.984804 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86435a5d-267e-41f0-98f6-4deea1996264 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:03.984804 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86435a5d-267e-41f0-98f6-4deea1996264 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:03.984804 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86435a5d-267e-41f0-98f6-4deea1996264 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:03.984804 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86435a5d-267e-41f0-98f6-4deea1996264 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:03.985401 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86435a5d-267e-41f0-98f6-4deea1996264 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:03.985544 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7f9d39-c08d-4f91-9f88-15b893805a03 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:03.999180 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1036/2109] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:19:03 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:19:04.000267 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86435a5d-267e-41f0-98f6-4deea1996264 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:04.009638 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:04.015986 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86435a5d-267e-41f0-98f6-4deea1996264 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:04.083961 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7f9d39-c08d-4f91-9f88-15b893805a03 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:04.091190 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb741c7-3b81-4332-8c3a-7364979ee398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:04.092298 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb741c7-3b81-4332-8c3a-7364979ee398 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:04.092661 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb741c7-3b81-4332-8c3a-7364979ee398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:04.093060 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb741c7-3b81-4332-8c3a-7364979ee398 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:04.094055 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb741c7-3b81-4332-8c3a-7364979ee398 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:04.097853 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb741c7-3b81-4332-8c3a-7364979ee398 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:04.099616 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c602a0-756b-4e56-9046-e8354e779489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:04.100443 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c602a0-756b-4e56-9046-e8354e779489 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:04.100731 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c602a0-756b-4e56-9046-e8354e779489 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:04.101060 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c602a0-756b-4e56-9046-e8354e779489 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:04.101796 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c602a0-756b-4e56-9046-e8354e779489 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:04.103462 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c602a0-756b-4e56-9046-e8354e779489 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:04.117854 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1037/2110] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:19:03 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:19:04.117854 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c602a0-756b-4e56-9046-e8354e779489 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:04.117854 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d7c602a0-756b-4e56-9046-e8354e779489 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:04.127524 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1074/2111] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:19:03 2022] POST /identity/v3/users => generated 295 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:19:04.127524 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb741c7-3b81-4332-8c3a-7364979ee398 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:04.130523 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c602a0-756b-4e56-9046-e8354e779489 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:04.135631 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb741c7-3b81-4332-8c3a-7364979ee398 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:04.135772 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c8fcb0-0390-412a-9750-da12df545c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:04.136558 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c8fcb0-0390-412a-9750-da12df545c8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:04.136845 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c8fcb0-0390-412a-9750-da12df545c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:04.137128 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c8fcb0-0390-412a-9750-da12df545c8e admin admin] PATH_INFO: `/v3/projects/395bb58077424ca2aa313499e2f5e024` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:04.138345 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c8fcb0-0390-412a-9750-da12df545c8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=395bb58077424ca2aa313499e2f5e024)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:04.140299 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73104464-d800-4b60-8229-f6adabeaf2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:04.140432 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c8fcb0-0390-412a-9750-da12df545c8e admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:04.141218 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73104464-d800-4b60-8229-f6adabeaf2cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:04.141506 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73104464-d800-4b60-8229-f6adabeaf2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:04.141786 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73104464-d800-4b60-8229-f6adabeaf2cf admin admin] PATH_INFO: `/v3/projects/7ed53c40e30048618502415bca77d8b9/users/4e52be8b09fc4ea6a4ea8cf914936400/roles/81634e7812344f84afcb29b0dba2687c` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:04.158336 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73104464-d800-4b60-8229-f6adabeaf2cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ed53c40e30048618502415bca77d8b9, user_id=4e52be8b09fc4ea6a4ea8cf914936400, role_id=81634e7812344f84afcb29b0dba2687c)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:04.161222 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73104464-d800-4b60-8229-f6adabeaf2cf admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:04.184283 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1075/2112] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:19:04 2022] PUT /identity/v3/projects/7ed53c40e30048618502415bca77d8b9/users/4e52be8b09fc4ea6a4ea8cf914936400/roles/81634e7812344f84afcb29b0dba2687c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:19:04.184283 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73104464-d800-4b60-8229-f6adabeaf2cf admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:04.188348 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-15c8fcb0-0390-412a-9750-da12df545c8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '395bb58077424ca2aa313499e2f5e024', 'request_id': 'req-15c8fcb0-0390-412a-9750-da12df545c8e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:04.193951 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-15c8fcb0-0390-412a-9750-da12df545c8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '395bb58077424ca2aa313499e2f5e024', 'request_id': 'req-15c8fcb0-0390-412a-9750-da12df545c8e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:04.202189 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-15c8fcb0-0390-412a-9750-da12df545c8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '395bb58077424ca2aa313499e2f5e024', 'request_id': 'req-15c8fcb0-0390-412a-9750-da12df545c8e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:04.214484 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-15c8fcb0-0390-412a-9750-da12df545c8e admin admin] The token cache is being invalidate because project 395bb58077424ca2aa313499e2f5e024 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:19:04.214770 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-15c8fcb0-0390-412a-9750-da12df545c8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:04.215423 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-15c8fcb0-0390-412a-9750-da12df545c8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:04.217108 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1038/2113] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:19:04 2022] DELETE /identity/v3/projects/395bb58077424ca2aa313499e2f5e024 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:19:04.218472 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fabc54-8d11-4274-af45-57b6701ac915 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:04.218803 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fabc54-8d11-4274-af45-57b6701ac915 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:04.219082 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fabc54-8d11-4274-af45-57b6701ac915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:04.245808 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-08fabc54-8d11-4274-af45-57b6701ac915 None None] MFA Rules not processed for user `4e52be8b09fc4ea6a4ea8cf914936400`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:19:04.246041 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73104464-d800-4b60-8229-f6adabeaf2cf admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:04.247056 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-08fabc54-8d11-4274-af45-57b6701ac915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:04.264821 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:04.303442 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d038045-b4c0-444e-b1f3-23547500cc40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:04.304144 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d038045-b4c0-444e-b1f3-23547500cc40 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:04.304434 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d038045-b4c0-444e-b1f3-23547500cc40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:04.304707 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d038045-b4c0-444e-b1f3-23547500cc40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:04.305428 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d038045-b4c0-444e-b1f3-23547500cc40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:04.307057 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d038045-b4c0-444e-b1f3-23547500cc40 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:04.312458 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1039/2114] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:19:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:19:04.313317 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fabc54-8d11-4274-af45-57b6701ac915 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:04.314618 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-08fabc54-8d11-4274-af45-57b6701ac915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:04.320254 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1076/2115] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:19:04 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:19:04.320254 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d038045-b4c0-444e-b1f3-23547500cc40 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:04.320254 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-4d038045-b4c0-444e-b1f3-23547500cc40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:04.329861 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fabc54-8d11-4274-af45-57b6701ac915 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:04.331695 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d038045-b4c0-444e-b1f3-23547500cc40 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:04.334659 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fffd8a-634e-481f-b375-f59f6e2d4f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:04.335540 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fffd8a-634e-481f-b375-f59f6e2d4f0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:04.335821 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fffd8a-634e-481f-b375-f59f6e2d4f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:04.336127 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fffd8a-634e-481f-b375-f59f6e2d4f0d admin admin] PATH_INFO: `/v3/users/1728351407994f1abb930ae40b36eedd` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:04.336371 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd26fd01-707a-49a9-a64e-e4413993db65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:04.337004 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd26fd01-707a-49a9-a64e-e4413993db65 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:04.337285 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd26fd01-707a-49a9-a64e-e4413993db65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:04.337394 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fffd8a-634e-481f-b375-f59f6e2d4f0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1728351407994f1abb930ae40b36eedd)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:04.337562 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd26fd01-707a-49a9-a64e-e4413993db65 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:04.338244 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd26fd01-707a-49a9-a64e-e4413993db65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:04.339273 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fffd8a-634e-481f-b375-f59f6e2d4f0d admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:04.340164 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd26fd01-707a-49a9-a64e-e4413993db65 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:04.344055 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:04.374134 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1077/2116] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:19:04 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:19:04.376764 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd26fd01-707a-49a9-a64e-e4413993db65 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:04.379021 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-bd26fd01-707a-49a9-a64e-e4413993db65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:04.395230 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-32fffd8a-634e-481f-b375-f59f6e2d4f0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1728351407994f1abb930ae40b36eedd'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:04.396263 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-32fffd8a-634e-481f-b375-f59f6e2d4f0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1728351407994f1abb930ae40b36eedd'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:04.405379 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-32fffd8a-634e-481f-b375-f59f6e2d4f0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1728351407994f1abb930ae40b36eedd'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:04.406068 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-32fffd8a-634e-481f-b375-f59f6e2d4f0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1728351407994f1abb930ae40b36eedd'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:04.418688 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-32fffd8a-634e-481f-b375-f59f6e2d4f0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1728351407994f1abb930ae40b36eedd'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:04.433511 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1040/2117] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:19:04 2022] DELETE /identity/v3/users/1728351407994f1abb930ae40b36eedd => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:19:04.435126 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fffd8a-634e-481f-b375-f59f6e2d4f0d admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:04.436714 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-32fffd8a-634e-481f-b375-f59f6e2d4f0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:04.454056 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd26fd01-707a-49a9-a64e-e4413993db65 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:04.526832 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a15fb7b-255c-4deb-a05b-238cb5201f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:04.527249 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fffd8a-634e-481f-b375-f59f6e2d4f0d admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:04.529280 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15fb7b-255c-4deb-a05b-238cb5201f60 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:04.529822 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15fb7b-255c-4deb-a05b-238cb5201f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:04.530308 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15fb7b-255c-4deb-a05b-238cb5201f60 admin admin] PATH_INFO: `/v3/projects/01f7fd5958454535b891d758ff4cc3a4/users/6412f6b2126d4354bca8d0fb7c63ee22/roles/965049e7ce6144aaad23c15f3a5e37c3` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:04.533525 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e38c316-415d-4fea-9be0-e1f5fb1853cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:04.535466 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38c316-415d-4fea-9be0-e1f5fb1853cd admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:04.535896 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38c316-415d-4fea-9be0-e1f5fb1853cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:04.536184 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38c316-415d-4fea-9be0-e1f5fb1853cd admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:04.536889 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e38c316-415d-4fea-9be0-e1f5fb1853cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:04.540193 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e38c316-415d-4fea-9be0-e1f5fb1853cd admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:04.549624 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a15fb7b-255c-4deb-a05b-238cb5201f60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01f7fd5958454535b891d758ff4cc3a4, user_id=6412f6b2126d4354bca8d0fb7c63ee22, role_id=965049e7ce6144aaad23c15f3a5e37c3)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:04.553932 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a15fb7b-255c-4deb-a05b-238cb5201f60 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:04.573096 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1041/2118] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:19:04 2022] POST /identity/v3/users => generated 299 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:19:04.574696 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e38c316-415d-4fea-9be0-e1f5fb1853cd admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:04.580789 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1078/2119] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:19:04 2022] PUT /identity/v3/projects/01f7fd5958454535b891d758ff4cc3a4/users/6412f6b2126d4354bca8d0fb7c63ee22/roles/965049e7ce6144aaad23c15f3a5e37c3 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:19:04.585752 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a15fb7b-255c-4deb-a05b-238cb5201f60 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:04.588958 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-7a15fb7b-255c-4deb-a05b-238cb5201f60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:04.589662 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e38c316-415d-4fea-9be0-e1f5fb1853cd admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:04.647642 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:04.696294 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a15fb7b-255c-4deb-a05b-238cb5201f60 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:04.703842 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e4e9a4-bb1f-4a9b-a7c5-413144b4c04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:04.704784 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4e9a4-bb1f-4a9b-a7c5-413144b4c04d admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:04.705134 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4e9a4-bb1f-4a9b-a7c5-413144b4c04d admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:04.705496 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4e9a4-bb1f-4a9b-a7c5-413144b4c04d admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:04.706330 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e4e9a4-bb1f-4a9b-a7c5-413144b4c04d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:04.708079 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e4e9a4-bb1f-4a9b-a7c5-413144b4c04d admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:04.709022 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9e9e66-0bd3-4c3f-85e3-abf87a88aa2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:04.710208 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e9e66-0bd3-4c3f-85e3-abf87a88aa2e admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:04.710568 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e9e66-0bd3-4c3f-85e3-abf87a88aa2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:04.711336 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e9e66-0bd3-4c3f-85e3-abf87a88aa2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:04.712523 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9e9e66-0bd3-4c3f-85e3-abf87a88aa2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:04.715112 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9e9e66-0bd3-4c3f-85e3-abf87a88aa2e admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:04.723288 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1079/2120] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:19:04 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:19:04.724849 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e4e9a4-bb1f-4a9b-a7c5-413144b4c04d admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:04.732643 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1042/2121] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:19:04 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:19:04.733627 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9e9e66-0bd3-4c3f-85e3-abf87a88aa2e admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:04.739671 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e4e9a4-bb1f-4a9b-a7c5-413144b4c04d admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:04.744121 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9e9e66-0bd3-4c3f-85e3-abf87a88aa2e admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:04.744892 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb48e800-218b-4805-88e3-624a6099d4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:04.746059 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48e800-218b-4805-88e3-624a6099d4e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:04.746644 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48e800-218b-4805-88e3-624a6099d4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:04.747125 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48e800-218b-4805-88e3-624a6099d4e1 admin admin] PATH_INFO: `/v3/projects/01f7fd5958454535b891d758ff4cc3a4/users/6412f6b2126d4354bca8d0fb7c63ee22/roles/965049e7ce6144aaad23c15f3a5e37c3` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:04.748920 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f36eb2-3146-4238-9517-4014c26ade21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:04.749705 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f36eb2-3146-4238-9517-4014c26ade21 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:04.749990 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f36eb2-3146-4238-9517-4014c26ade21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:04.750268 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f36eb2-3146-4238-9517-4014c26ade21 admin admin] PATH_INFO: `/v3/projects/2ee4fcd75432400e910dd8b316ba99f2/users/0ffdf61e87f84a57aa96fc00a04c36f2/roles/965049e7ce6144aaad23c15f3a5e37c3` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:04.751146 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb48e800-218b-4805-88e3-624a6099d4e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01f7fd5958454535b891d758ff4cc3a4, user_id=6412f6b2126d4354bca8d0fb7c63ee22, role_id=965049e7ce6144aaad23c15f3a5e37c3)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:04.753927 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb48e800-218b-4805-88e3-624a6099d4e1 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:04.755533 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:04.768956 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1080/2122] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:19:04 2022] PUT /identity/v3/projects/01f7fd5958454535b891d758ff4cc3a4/users/6412f6b2126d4354bca8d0fb7c63ee22/roles/965049e7ce6144aaad23c15f3a5e37c3 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:19:04.771156 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f36eb2-3146-4238-9517-4014c26ade21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ee4fcd75432400e910dd8b316ba99f2, user_id=0ffdf61e87f84a57aa96fc00a04c36f2, role_id=965049e7ce6144aaad23c15f3a5e37c3)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:04.774316 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f36eb2-3146-4238-9517-4014c26ade21 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:04.779486 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b197a-753a-40d9-a577-ab8e1ed0bb21 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:04.779784 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b197a-753a-40d9-a577-ab8e1ed0bb21 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:04.780092 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b197a-753a-40d9-a577-ab8e1ed0bb21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:04.792965 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1043/2123] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:19:04 2022] PUT /identity/v3/projects/2ee4fcd75432400e910dd8b316ba99f2/users/0ffdf61e87f84a57aa96fc00a04c36f2/roles/965049e7ce6144aaad23c15f3a5e37c3 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:19:04.796938 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f36eb2-3146-4238-9517-4014c26ade21 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:04.811149 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-857b197a-753a-40d9-a577-ab8e1ed0bb21 None None] MFA Rules not processed for user `6412f6b2126d4354bca8d0fb7c63ee22`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:19:04.812442 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-857b197a-753a-40d9-a577-ab8e1ed0bb21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:04.886072 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f36eb2-3146-4238-9517-4014c26ade21 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:04.889729 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc7ea55-27fa-402f-8a8d-1e07a405377b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:04.890414 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc7ea55-27fa-402f-8a8d-1e07a405377b admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:04.890723 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc7ea55-27fa-402f-8a8d-1e07a405377b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:04.890995 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc7ea55-27fa-402f-8a8d-1e07a405377b admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:04.891737 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc7ea55-27fa-402f-8a8d-1e07a405377b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:04.893430 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc7ea55-27fa-402f-8a8d-1e07a405377b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:04.908574 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1044/2124] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:19:04 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:19:04.908574 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc7ea55-27fa-402f-8a8d-1e07a405377b admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:04.908574 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-fdc7ea55-27fa-402f-8a8d-1e07a405377b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:04.919087 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1081/2125] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:19:04 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:19:04.920584 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857b197a-753a-40d9-a577-ab8e1ed0bb21 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:04.925094 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc7ea55-27fa-402f-8a8d-1e07a405377b admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:04.930818 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d8b51d-4cc4-454a-82be-604ae213ac5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:04.932347 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d8b51d-4cc4-454a-82be-604ae213ac5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:04.932699 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d8b51d-4cc4-454a-82be-604ae213ac5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:04.933045 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d8b51d-4cc4-454a-82be-604ae213ac5c admin admin] PATH_INFO: `/v3/projects/ce7758b8174d41f398470cda3ef501ce` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:04.934462 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d8b51d-4cc4-454a-82be-604ae213ac5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce7758b8174d41f398470cda3ef501ce)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:04.935079 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857b197a-753a-40d9-a577-ab8e1ed0bb21 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:04.936834 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d8b51d-4cc4-454a-82be-604ae213ac5c admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:04.940708 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570c2e8d-c605-49f2-8be9-420564bd12d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:04.941677 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570c2e8d-c605-49f2-8be9-420564bd12d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:04.942024 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570c2e8d-c605-49f2-8be9-420564bd12d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:04.942363 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570c2e8d-c605-49f2-8be9-420564bd12d5 admin admin] PATH_INFO: `/v3/projects/2ee4fcd75432400e910dd8b316ba99f2/users/0ffdf61e87f84a57aa96fc00a04c36f2/roles/965049e7ce6144aaad23c15f3a5e37c3` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:04.944908 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570c2e8d-c605-49f2-8be9-420564bd12d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ee4fcd75432400e910dd8b316ba99f2, user_id=0ffdf61e87f84a57aa96fc00a04c36f2, role_id=965049e7ce6144aaad23c15f3a5e37c3)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:04.948344 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570c2e8d-c605-49f2-8be9-420564bd12d5 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:04.964000 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1082/2126] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:19:04 2022] PUT /identity/v3/projects/2ee4fcd75432400e910dd8b316ba99f2/users/0ffdf61e87f84a57aa96fc00a04c36f2/roles/965049e7ce6144aaad23c15f3a5e37c3 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:19:04.964000 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570c2e8d-c605-49f2-8be9-420564bd12d5 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:04.973342 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-570c2e8d-c605-49f2-8be9-420564bd12d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:05.003778 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-38d8b51d-4cc4-454a-82be-604ae213ac5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce7758b8174d41f398470cda3ef501ce', 'request_id': 'req-38d8b51d-4cc4-454a-82be-604ae213ac5c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:05.010310 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-38d8b51d-4cc4-454a-82be-604ae213ac5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce7758b8174d41f398470cda3ef501ce', 'request_id': 'req-38d8b51d-4cc4-454a-82be-604ae213ac5c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:05.020796 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-38d8b51d-4cc4-454a-82be-604ae213ac5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce7758b8174d41f398470cda3ef501ce', 'request_id': 'req-38d8b51d-4cc4-454a-82be-604ae213ac5c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:05.035098 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-38d8b51d-4cc4-454a-82be-604ae213ac5c admin admin] The token cache is being invalidate because project ce7758b8174d41f398470cda3ef501ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:19:05.035384 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-38d8b51d-4cc4-454a-82be-604ae213ac5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:05.036086 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-38d8b51d-4cc4-454a-82be-604ae213ac5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:05.037871 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1045/2127] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:19:04 2022] DELETE /identity/v3/projects/ce7758b8174d41f398470cda3ef501ce => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:19:05.041542 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570c2e8d-c605-49f2-8be9-420564bd12d5 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:05.043012 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300e6917-b965-429e-92db-2df73dd613c8 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:05.043684 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300e6917-b965-429e-92db-2df73dd613c8 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:05.044041 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300e6917-b965-429e-92db-2df73dd613c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:05.074368 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-300e6917-b965-429e-92db-2df73dd613c8 None None] MFA Rules not processed for user `0ffdf61e87f84a57aa96fc00a04c36f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:19:05.075796 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-300e6917-b965-429e-92db-2df73dd613c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:05.079190 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:05.097197 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fde5a6-940e-45d6-b735-9ca5abc0099f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f86373d65440da97c853fff3c1d0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:05.097660 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fde5a6-940e-45d6-b735-9ca5abc0099f service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:05.097945 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fde5a6-940e-45d6-b735-9ca5abc0099f service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:05.098224 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fde5a6-940e-45d6-b735-9ca5abc0099f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:05.100397 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-a8fde5a6-940e-45d6-b735-9ca5abc0099f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:05.133008 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:05.156287 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1046/2128] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:19:05 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:19:05.157645 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d874c7-864f-4fb4-9820-944221ea7466 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:05.157930 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d874c7-864f-4fb4-9820-944221ea7466 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:05.158204 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d874c7-864f-4fb4-9820-944221ea7466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:05.170524 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fde5a6-940e-45d6-b735-9ca5abc0099f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:05.172305 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fde5a6-940e-45d6-b735-9ca5abc0099f service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:05.181708 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-71d874c7-864f-4fb4-9820-944221ea7466 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:19:05.183053 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1083/2129] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:19:04 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:19:05.183839 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-71d874c7-864f-4fb4-9820-944221ea7466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:05.226403 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fde5a6-940e-45d6-b735-9ca5abc0099f service cinder] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:05.228299 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-a8fde5a6-940e-45d6-b735-9ca5abc0099f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:05.242535 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fde5a6-940e-45d6-b735-9ca5abc0099f service cinder] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:05.249442 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723479c1-bef1-4745-b76b-a5341c32ebef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f86373d65440da97c853fff3c1d0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:05.250130 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723479c1-bef1-4745-b76b-a5341c32ebef service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:05.250444 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723479c1-bef1-4745-b76b-a5341c32ebef service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:05.250724 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723479c1-bef1-4745-b76b-a5341c32ebef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:05.258997 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1047/2130] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:19:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:19:05.263998 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723479c1-bef1-4745-b76b-a5341c32ebef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:05.266195 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723479c1-bef1-4745-b76b-a5341c32ebef service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:05.266330 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83bb503-9024-41e3-862d-24e338a12e62 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:05.268058 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83bb503-9024-41e3-862d-24e338a12e62 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:05.268599 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83bb503-9024-41e3-862d-24e338a12e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:05.279015 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1084/2131] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:19:05 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:19:05.298905 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-c83bb503-9024-41e3-862d-24e338a12e62 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:19:05.300896 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c83bb503-9024-41e3-862d-24e338a12e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:05.313702 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1048/2132] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:19:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:19:05.315324 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723479c1-bef1-4745-b76b-a5341c32ebef service cinder] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:05.328087 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723479c1-bef1-4745-b76b-a5341c32ebef service cinder] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:05.334495 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7518166d-07a7-4e95-a868-5efce1fb6ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:05.335351 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518166d-07a7-4e95-a868-5efce1fb6ef9 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:05.335707 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518166d-07a7-4e95-a868-5efce1fb6ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:05.336112 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518166d-07a7-4e95-a868-5efce1fb6ef9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:05.337004 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7518166d-07a7-4e95-a868-5efce1fb6ef9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:19:05.337381 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7518166d-07a7-4e95-a868-5efce1fb6ef9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:05.339489 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7518166d-07a7-4e95-a868-5efce1fb6ef9 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:05.355899 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1085/2133] 10.222.0.42 () {58 vars in 1152 bytes} [Mon Jul 4 09:19:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:19:05.360742 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83bb503-9024-41e3-862d-24e338a12e62 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:05.382991 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83bb503-9024-41e3-862d-24e338a12e62 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:05.391286 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef43d24-654b-4a2f-871b-0a1f7037e9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:05.392616 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef43d24-654b-4a2f-871b-0a1f7037e9d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:05.392969 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef43d24-654b-4a2f-871b-0a1f7037e9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:05.393248 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef43d24-654b-4a2f-871b-0a1f7037e9d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:05.393978 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef43d24-654b-4a2f-871b-0a1f7037e9d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:05.396073 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef43d24-654b-4a2f-871b-0a1f7037e9d0 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:05.426168 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1049/2134] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:19:05 2022] POST /identity/v3/projects => generated 371 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:19:05.431408 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7518166d-07a7-4e95-a868-5efce1fb6ef9 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:05.443334 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7518166d-07a7-4e95-a868-5efce1fb6ef9 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:05.548565 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f4c5f7-5c9a-4cb3-b0e9-1c94f97d9df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:05.549255 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f4c5f7-5c9a-4cb3-b0e9-1c94f97d9df0 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:05.549545 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f4c5f7-5c9a-4cb3-b0e9-1c94f97d9df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:05.549831 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f4c5f7-5c9a-4cb3-b0e9-1c94f97d9df0 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:05.550530 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f4c5f7-5c9a-4cb3-b0e9-1c94f97d9df0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:05.552568 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f4c5f7-5c9a-4cb3-b0e9-1c94f97d9df0 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:05.580133 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1086/2135] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:19:05 2022] POST /identity/v3/users => generated 286 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:19:05.584424 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef43d24-654b-4a2f-871b-0a1f7037e9d0 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:05.595964 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef43d24-654b-4a2f-871b-0a1f7037e9d0 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:05.601097 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9a24cc-6cc1-4fdf-8255-fa17927f435d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:05.601769 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a24cc-6cc1-4fdf-8255-fa17927f435d admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:05.602162 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a24cc-6cc1-4fdf-8255-fa17927f435d admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:05.602348 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a24cc-6cc1-4fdf-8255-fa17927f435d admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:05.603197 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9a24cc-6cc1-4fdf-8255-fa17927f435d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:05.604806 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9a24cc-6cc1-4fdf-8255-fa17927f435d admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:05.622364 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1050/2136] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:19:05 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:19:05.623670 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f4c5f7-5c9a-4cb3-b0e9-1c94f97d9df0 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:05.634863 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f4c5f7-5c9a-4cb3-b0e9-1c94f97d9df0 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:05.643191 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3e2687-6604-482f-845f-739ceada4016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:05.643899 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e2687-6604-482f-845f-739ceada4016 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:05.644206 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e2687-6604-482f-845f-739ceada4016 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:05.644477 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e2687-6604-482f-845f-739ceada4016 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:05.645241 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3e2687-6604-482f-845f-739ceada4016 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:05.646874 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3e2687-6604-482f-845f-739ceada4016 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:05.657975 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1087/2137] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:19:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:19:05.662521 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9a24cc-6cc1-4fdf-8255-fa17927f435d admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:05.673555 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9a24cc-6cc1-4fdf-8255-fa17927f435d admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:05.678271 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2584b913-1827-4871-8114-904d71691226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:05.679193 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2584b913-1827-4871-8114-904d71691226 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:05.679479 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2584b913-1827-4871-8114-904d71691226 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:05.679756 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2584b913-1827-4871-8114-904d71691226 admin admin] PATH_INFO: `/v3/projects/539fcc7b6ffe4604b2ead99f1f6e4858/users/5342abdb35f44ec286e04e74490ad5ae/roles/81634e7812344f84afcb29b0dba2687c` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:05.699918 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2584b913-1827-4871-8114-904d71691226 admin admin] RBAC: Authorizing `identity:create_grant(project_id=539fcc7b6ffe4604b2ead99f1f6e4858, user_id=5342abdb35f44ec286e04e74490ad5ae, role_id=81634e7812344f84afcb29b0dba2687c)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:05.702861 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2584b913-1827-4871-8114-904d71691226 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:05.718992 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1051/2138] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:19:05 2022] PUT /identity/v3/projects/539fcc7b6ffe4604b2ead99f1f6e4858/users/5342abdb35f44ec286e04e74490ad5ae/roles/81634e7812344f84afcb29b0dba2687c => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:19:05.731762 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb6e3d-9cc4-4202-ae6d-f1230912dde5 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:05.732145 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb6e3d-9cc4-4202-ae6d-f1230912dde5 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:05.732433 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb6e3d-9cc4-4202-ae6d-f1230912dde5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:05.779463 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-3ebb6e3d-9cc4-4202-ae6d-f1230912dde5 None None] MFA Rules not processed for user `5342abdb35f44ec286e04e74490ad5ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:19:05.780748 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-3ebb6e3d-9cc4-4202-ae6d-f1230912dde5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:05.820921 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:05.861298 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1088/2139] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:19:05 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:19:05.869601 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2584b913-1827-4871-8114-904d71691226 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:05.945796 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2584b913-1827-4871-8114-904d71691226 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:05.949674 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4af6579-8564-4277-a34e-73abb7e4e277 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f86373d65440da97c853fff3c1d0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:05.950362 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4af6579-8564-4277-a34e-73abb7e4e277 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:05.950646 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4af6579-8564-4277-a34e-73abb7e4e277 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:05.950919 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4af6579-8564-4277-a34e-73abb7e4e277 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:05.969090 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4af6579-8564-4277-a34e-73abb7e4e277 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:05.971562 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4af6579-8564-4277-a34e-73abb7e4e277 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:05.987422 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1052/2140] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:19:05 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:19:06.008417 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebb6e3d-9cc4-4202-ae6d-f1230912dde5 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:06.082069 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebb6e3d-9cc4-4202-ae6d-f1230912dde5 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:06.087252 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7df75a-1d57-4df9-9d83-c5dae478c2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:06.088157 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7df75a-1d57-4df9-9d83-c5dae478c2d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:06.088433 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7df75a-1d57-4df9-9d83-c5dae478c2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:06.088700 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7df75a-1d57-4df9-9d83-c5dae478c2d7 admin admin] PATH_INFO: `/v3/users/5342abdb35f44ec286e04e74490ad5ae` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:06.090113 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7df75a-1d57-4df9-9d83-c5dae478c2d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5342abdb35f44ec286e04e74490ad5ae)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:06.092648 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7df75a-1d57-4df9-9d83-c5dae478c2d7 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:06.126910 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4af6579-8564-4277-a34e-73abb7e4e277 service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:06.128579 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d4af6579-8564-4277-a34e-73abb7e4e277 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:06.144473 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4af6579-8564-4277-a34e-73abb7e4e277 service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:06.149271 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76556125-15a6-49e3-a913-1c78bdf04a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:06.150219 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76556125-15a6-49e3-a913-1c78bdf04a58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:06.150505 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76556125-15a6-49e3-a913-1c78bdf04a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:06.150771 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76556125-15a6-49e3-a913-1c78bdf04a58 admin admin] PATH_INFO: `/v3/users/4e52be8b09fc4ea6a4ea8cf914936400` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:06.151055 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-dc7df75a-1d57-4df9-9d83-c5dae478c2d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5342abdb35f44ec286e04e74490ad5ae'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:06.152014 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76556125-15a6-49e3-a913-1c78bdf04a58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e52be8b09fc4ea6a4ea8cf914936400)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:06.154104 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76556125-15a6-49e3-a913-1c78bdf04a58 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:06.159645 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-dc7df75a-1d57-4df9-9d83-c5dae478c2d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5342abdb35f44ec286e04e74490ad5ae'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:06.160431 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-dc7df75a-1d57-4df9-9d83-c5dae478c2d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5342abdb35f44ec286e04e74490ad5ae'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:06.161860 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-dc7df75a-1d57-4df9-9d83-c5dae478c2d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5342abdb35f44ec286e04e74490ad5ae'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:06.174572 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-dc7df75a-1d57-4df9-9d83-c5dae478c2d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5342abdb35f44ec286e04e74490ad5ae'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:06.178801 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:06.187718 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1089/2141] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:19:06 2022] DELETE /identity/v3/users/5342abdb35f44ec286e04e74490ad5ae => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:19:06.192148 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312be464-e599-4cbf-bebd-d95874378107 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:06.192436 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312be464-e599-4cbf-bebd-d95874378107 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:06.192713 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312be464-e599-4cbf-bebd-d95874378107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:06.204855 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-76556125-15a6-49e3-a913-1c78bdf04a58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e52be8b09fc4ea6a4ea8cf914936400'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:06.205506 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-76556125-15a6-49e3-a913-1c78bdf04a58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e52be8b09fc4ea6a4ea8cf914936400'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:06.209602 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-312be464-e599-4cbf-bebd-d95874378107 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:19:06.210767 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-312be464-e599-4cbf-bebd-d95874378107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:06.213649 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-76556125-15a6-49e3-a913-1c78bdf04a58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e52be8b09fc4ea6a4ea8cf914936400'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:06.214433 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-76556125-15a6-49e3-a913-1c78bdf04a58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e52be8b09fc4ea6a4ea8cf914936400'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:06.227799 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-76556125-15a6-49e3-a913-1c78bdf04a58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e52be8b09fc4ea6a4ea8cf914936400'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:06.240879 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1053/2142] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:19:06 2022] DELETE /identity/v3/users/4e52be8b09fc4ea6a4ea8cf914936400 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:19:06.245137 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31e289-70b8-4aea-acff-7d98e305a283 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:06.245486 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31e289-70b8-4aea-acff-7d98e305a283 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:06.245762 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31e289-70b8-4aea-acff-7d98e305a283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:06.261129 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:06.263743 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-8c31e289-70b8-4aea-acff-7d98e305a283 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:19:06.264976 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-8c31e289-70b8-4aea-acff-7d98e305a283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:06.278736 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1090/2143] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:19:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:19:06.285383 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312be464-e599-4cbf-bebd-d95874378107 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:06.287127 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-312be464-e599-4cbf-bebd-d95874378107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:06.323941 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1054/2144] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:19:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:19:06.333904 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c31e289-70b8-4aea-acff-7d98e305a283 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:06.335336 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-8c31e289-70b8-4aea-acff-7d98e305a283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:06.345573 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312be464-e599-4cbf-bebd-d95874378107 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:06.394816 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c31e289-70b8-4aea-acff-7d98e305a283 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:06.398991 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cda757-bc52-459e-927b-209302d2b47b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:06.399610 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd8d2bc-95d6-435f-9e82-8574891e13df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:06.399723 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cda757-bc52-459e-927b-209302d2b47b service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:06.400012 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cda757-bc52-459e-927b-209302d2b47b service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:06.400196 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd8d2bc-95d6-435f-9e82-8574891e13df service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:06.400298 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cda757-bc52-459e-927b-209302d2b47b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:06.400466 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd8d2bc-95d6-435f-9e82-8574891e13df service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:06.400721 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd8d2bc-95d6-435f-9e82-8574891e13df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:06.410332 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd8d2bc-95d6-435f-9e82-8574891e13df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:06.411573 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cda757-bc52-459e-927b-209302d2b47b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:06.411784 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd8d2bc-95d6-435f-9e82-8574891e13df service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:06.413835 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cda757-bc52-459e-927b-209302d2b47b service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:06.421848 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1091/2145] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:19:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 09:19:06.432719 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1055/2146] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:19:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 09:19:06.793561 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd8d2bc-95d6-435f-9e82-8574891e13df service neutron] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:06.796582 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-6dd8d2bc-95d6-435f-9e82-8574891e13df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:06.865393 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd8d2bc-95d6-435f-9e82-8574891e13df service neutron] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:06.869162 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b181ec7f-9ec9-4439-a499-5a06612269eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f86373d65440da97c853fff3c1d0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:06.869814 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181ec7f-9ec9-4439-a499-5a06612269eb service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:06.870101 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181ec7f-9ec9-4439-a499-5a06612269eb service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:06.870377 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181ec7f-9ec9-4439-a499-5a06612269eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:06.872565 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-b181ec7f-9ec9-4439-a499-5a06612269eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:06.929320 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cda757-bc52-459e-927b-209302d2b47b service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:06.931113 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-57cda757-bc52-459e-927b-209302d2b47b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:06.947480 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cda757-bc52-459e-927b-209302d2b47b service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:06.958089 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc0e6d-9129-42f6-9666-a1fbb908ec45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:06.958991 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc0e6d-9129-42f6-9666-a1fbb908ec45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:06.959267 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc0e6d-9129-42f6-9666-a1fbb908ec45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:06.959535 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc0e6d-9129-42f6-9666-a1fbb908ec45 admin admin] PATH_INFO: `/v3/projects/539fcc7b6ffe4604b2ead99f1f6e4858` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:06.961550 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dc0e6d-9129-42f6-9666-a1fbb908ec45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=539fcc7b6ffe4604b2ead99f1f6e4858)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:06.964606 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dc0e6d-9129-42f6-9666-a1fbb908ec45 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:06.967887 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b181ec7f-9ec9-4439-a499-5a06612269eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:06.969497 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b181ec7f-9ec9-4439-a499-5a06612269eb service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:06.980819 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1092/2147] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:19:06 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 09:19:06.981552 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b181ec7f-9ec9-4439-a499-5a06612269eb service cinder] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:06.982965 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-b181ec7f-9ec9-4439-a499-5a06612269eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:06.997589 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b181ec7f-9ec9-4439-a499-5a06612269eb service cinder] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:07.004572 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086ac8cd-c76f-4d5c-bc59-6dca92c66459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:07.005446 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ac8cd-c76f-4d5c-bc59-6dca92c66459 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:07.005733 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ac8cd-c76f-4d5c-bc59-6dca92c66459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:07.006013 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ac8cd-c76f-4d5c-bc59-6dca92c66459 admin admin] PATH_INFO: `/v3/projects/7ed53c40e30048618502415bca77d8b9` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:07.007274 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086ac8cd-c76f-4d5c-bc59-6dca92c66459 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ed53c40e30048618502415bca77d8b9)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:07.009197 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086ac8cd-c76f-4d5c-bc59-6dca92c66459 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:07.011369 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:07.026347 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:07.037678 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c0dc0e6d-9129-42f6-9666-a1fbb908ec45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '539fcc7b6ffe4604b2ead99f1f6e4858', 'request_id': 'req-c0dc0e6d-9129-42f6-9666-a1fbb908ec45'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:07.045388 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c0dc0e6d-9129-42f6-9666-a1fbb908ec45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '539fcc7b6ffe4604b2ead99f1f6e4858', 'request_id': 'req-c0dc0e6d-9129-42f6-9666-a1fbb908ec45'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:07.054626 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c0dc0e6d-9129-42f6-9666-a1fbb908ec45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '539fcc7b6ffe4604b2ead99f1f6e4858', 'request_id': 'req-c0dc0e6d-9129-42f6-9666-a1fbb908ec45'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:07.061224 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-086ac8cd-c76f-4d5c-bc59-6dca92c66459 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ed53c40e30048618502415bca77d8b9', 'request_id': 'req-086ac8cd-c76f-4d5c-bc59-6dca92c66459'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:07.069725 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c0dc0e6d-9129-42f6-9666-a1fbb908ec45 admin admin] The token cache is being invalidate because project 539fcc7b6ffe4604b2ead99f1f6e4858 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:19:07.070271 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c0dc0e6d-9129-42f6-9666-a1fbb908ec45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:07.071049 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c0dc0e6d-9129-42f6-9666-a1fbb908ec45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:07.073395 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1056/2148] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:19:06 2022] DELETE /identity/v3/projects/539fcc7b6ffe4604b2ead99f1f6e4858 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:19:07.077664 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16412f9d-263b-4bc1-af35-9439df933f0e None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:07.077941 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16412f9d-263b-4bc1-af35-9439df933f0e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:07.078232 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16412f9d-263b-4bc1-af35-9439df933f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:07.080801 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-086ac8cd-c76f-4d5c-bc59-6dca92c66459 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ed53c40e30048618502415bca77d8b9', 'request_id': 'req-086ac8cd-c76f-4d5c-bc59-6dca92c66459'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:07.095742 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-086ac8cd-c76f-4d5c-bc59-6dca92c66459 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ed53c40e30048618502415bca77d8b9', 'request_id': 'req-086ac8cd-c76f-4d5c-bc59-6dca92c66459'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:07.117058 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-086ac8cd-c76f-4d5c-bc59-6dca92c66459 admin admin] The token cache is being invalidate because project 7ed53c40e30048618502415bca77d8b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:19:07.117357 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-086ac8cd-c76f-4d5c-bc59-6dca92c66459 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:07.118355 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-086ac8cd-c76f-4d5c-bc59-6dca92c66459 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:07.121033 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1093/2149] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:19:06 2022] DELETE /identity/v3/projects/7ed53c40e30048618502415bca77d8b9 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:19:07.122563 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-16412f9d-263b-4bc1-af35-9439df933f0e None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:19:07.124392 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-16412f9d-263b-4bc1-af35-9439df933f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:07.125373 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086ac8cd-c76f-4d5c-bc59-6dca92c66459 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:07.127337 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-086ac8cd-c76f-4d5c-bc59-6dca92c66459 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:07.205348 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1057/2150] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:19:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:19:07.206092 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086ac8cd-c76f-4d5c-bc59-6dca92c66459 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:07.212430 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa83a2-da6e-4d1a-88b7-fec6efde5538 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:07.212743 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa83a2-da6e-4d1a-88b7-fec6efde5538 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:07.213000 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa83a2-da6e-4d1a-88b7-fec6efde5538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:07.217480 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40f8549-688a-4c77-82e6-00be0532aa65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:07.218699 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f8549-688a-4c77-82e6-00be0532aa65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:07.218992 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f8549-688a-4c77-82e6-00be0532aa65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:07.219697 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f8549-688a-4c77-82e6-00be0532aa65 admin admin] PATH_INFO: `/v3/users/0ffdf61e87f84a57aa96fc00a04c36f2` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:07.221715 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40f8549-688a-4c77-82e6-00be0532aa65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ffdf61e87f84a57aa96fc00a04c36f2)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:07.223786 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40f8549-688a-4c77-82e6-00be0532aa65 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:07.242554 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-b1aa83a2-da6e-4d1a-88b7-fec6efde5538 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:19:07.244833 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b1aa83a2-da6e-4d1a-88b7-fec6efde5538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:07.256924 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1058/2151] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:19:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:19:07.261065 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aa83a2-da6e-4d1a-88b7-fec6efde5538 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:07.271930 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aa83a2-da6e-4d1a-88b7-fec6efde5538 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:07.277449 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68acaf6-1706-4566-a8ff-756623550006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:07.278116 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68acaf6-1706-4566-a8ff-756623550006 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:07.278424 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68acaf6-1706-4566-a8ff-756623550006 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:07.278680 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68acaf6-1706-4566-a8ff-756623550006 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:07.279478 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68acaf6-1706-4566-a8ff-756623550006 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:19:07.279787 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68acaf6-1706-4566-a8ff-756623550006 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:07.281486 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68acaf6-1706-4566-a8ff-756623550006 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:07.282848 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-b40f8549-688a-4c77-82e6-00be0532aa65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ffdf61e87f84a57aa96fc00a04c36f2'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:07.293794 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1059/2152] 10.222.0.42 () {58 vars in 1152 bytes} [Mon Jul 4 09:19:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:19:07.297532 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-b40f8549-688a-4c77-82e6-00be0532aa65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ffdf61e87f84a57aa96fc00a04c36f2'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:07.298193 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-b40f8549-688a-4c77-82e6-00be0532aa65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ffdf61e87f84a57aa96fc00a04c36f2'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:07.298326 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68acaf6-1706-4566-a8ff-756623550006 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:07.298866 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-b40f8549-688a-4c77-82e6-00be0532aa65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ffdf61e87f84a57aa96fc00a04c36f2'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:07.300301 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f68acaf6-1706-4566-a8ff-756623550006 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:07.314133 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-b40f8549-688a-4c77-82e6-00be0532aa65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ffdf61e87f84a57aa96fc00a04c36f2'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:07.316836 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68acaf6-1706-4566-a8ff-756623550006 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:07.323695 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81e4c05-fc7f-4ee8-8f44-3195de689917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:07.324525 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e4c05-fc7f-4ee8-8f44-3195de689917 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:07.325071 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e4c05-fc7f-4ee8-8f44-3195de689917 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:07.325358 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e4c05-fc7f-4ee8-8f44-3195de689917 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:07.326492 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81e4c05-fc7f-4ee8-8f44-3195de689917 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:07.328574 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81e4c05-fc7f-4ee8-8f44-3195de689917 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:07.332509 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1094/2153] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:19:07 2022] DELETE /identity/v3/users/0ffdf61e87f84a57aa96fc00a04c36f2 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:19:07.358083 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1060/2154] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:19:07 2022] POST /identity/v3/projects => generated 371 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:19:07.362125 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40f8549-688a-4c77-82e6-00be0532aa65 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:07.373269 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:07.445375 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40f8549-688a-4c77-82e6-00be0532aa65 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:07.521480 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e85522-904c-4c8c-b95c-43a37f6975d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:07.522163 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e85522-904c-4c8c-b95c-43a37f6975d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:07.522448 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e85522-904c-4c8c-b95c-43a37f6975d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:07.522727 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e85522-904c-4c8c-b95c-43a37f6975d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:07.523434 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e85522-904c-4c8c-b95c-43a37f6975d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:07.525398 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e85522-904c-4c8c-b95c-43a37f6975d7 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:07.550211 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1095/2155] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:19:07 2022] POST /identity/v3/users => generated 286 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:19:07.554234 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81e4c05-fc7f-4ee8-8f44-3195de689917 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:07.566336 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81e4c05-fc7f-4ee8-8f44-3195de689917 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:07.571894 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2118a716-7d04-4f34-bb44-27e0dd85824a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:07.572632 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2118a716-7d04-4f34-bb44-27e0dd85824a admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:07.572991 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2118a716-7d04-4f34-bb44-27e0dd85824a admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:07.573277 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2118a716-7d04-4f34-bb44-27e0dd85824a admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:07.574013 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2118a716-7d04-4f34-bb44-27e0dd85824a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:07.575706 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2118a716-7d04-4f34-bb44-27e0dd85824a admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:07.587977 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1061/2156] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:19:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:19:07.592011 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e85522-904c-4c8c-b95c-43a37f6975d7 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:07.604415 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e85522-904c-4c8c-b95c-43a37f6975d7 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:07.609322 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ec057c-6476-468d-be4d-13c1d6966d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:07.609991 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ec057c-6476-468d-be4d-13c1d6966d00 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:07.610274 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ec057c-6476-468d-be4d-13c1d6966d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:07.610583 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ec057c-6476-468d-be4d-13c1d6966d00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:07.611317 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ec057c-6476-468d-be4d-13c1d6966d00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:07.612998 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ec057c-6476-468d-be4d-13c1d6966d00 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:07.625887 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1096/2157] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:19:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:19:07.630109 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2118a716-7d04-4f34-bb44-27e0dd85824a admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:07.638597 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ec057c-6476-468d-be4d-13c1d6966d00 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:07.640510 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-25ec057c-6476-468d-be4d-13c1d6966d00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:07.653252 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2118a716-7d04-4f34-bb44-27e0dd85824a admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:07.654806 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ec057c-6476-468d-be4d-13c1d6966d00 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:07.659558 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6ce520-e1be-4698-aebf-4f76b13f095b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:07.659753 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331b5292-764e-47cb-8360-eaac0f06208b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:07.660593 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ce520-e1be-4698-aebf-4f76b13f095b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:07.660766 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b5292-764e-47cb-8360-eaac0f06208b admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:07.661024 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ce520-e1be-4698-aebf-4f76b13f095b admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:07.661133 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b5292-764e-47cb-8360-eaac0f06208b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:07.661369 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ce520-e1be-4698-aebf-4f76b13f095b admin admin] PATH_INFO: `/v3/projects/2ee4fcd75432400e910dd8b316ba99f2` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:07.661503 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b5292-764e-47cb-8360-eaac0f06208b admin admin] PATH_INFO: `/v3/projects/b1930be8ccd841deaa4d41ed54368a39/users/0375760c788b4bd0992302f291a2dd35/roles/81634e7812344f84afcb29b0dba2687c` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:07.662712 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6ce520-e1be-4698-aebf-4f76b13f095b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ee4fcd75432400e910dd8b316ba99f2)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:07.665125 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6ce520-e1be-4698-aebf-4f76b13f095b admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:07.682334 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331b5292-764e-47cb-8360-eaac0f06208b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1930be8ccd841deaa4d41ed54368a39, user_id=0375760c788b4bd0992302f291a2dd35, role_id=81634e7812344f84afcb29b0dba2687c)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:07.685415 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331b5292-764e-47cb-8360-eaac0f06208b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:07.702833 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1062/2158] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:19:07 2022] PUT /identity/v3/projects/b1930be8ccd841deaa4d41ed54368a39/users/0375760c788b4bd0992302f291a2dd35/roles/81634e7812344f84afcb29b0dba2687c => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:19:07.703807 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331b5292-764e-47cb-8360-eaac0f06208b admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:07.705498 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-331b5292-764e-47cb-8360-eaac0f06208b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:07.727234 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-4b6ce520-e1be-4698-aebf-4f76b13f095b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ee4fcd75432400e910dd8b316ba99f2', 'request_id': 'req-4b6ce520-e1be-4698-aebf-4f76b13f095b'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:07.737447 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-4b6ce520-e1be-4698-aebf-4f76b13f095b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ee4fcd75432400e910dd8b316ba99f2', 'request_id': 'req-4b6ce520-e1be-4698-aebf-4f76b13f095b'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:07.744611 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-4b6ce520-e1be-4698-aebf-4f76b13f095b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ee4fcd75432400e910dd8b316ba99f2', 'request_id': 'req-4b6ce520-e1be-4698-aebf-4f76b13f095b'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:07.758241 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-4b6ce520-e1be-4698-aebf-4f76b13f095b admin admin] The token cache is being invalidate because project 2ee4fcd75432400e910dd8b316ba99f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:19:07.758536 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-4b6ce520-e1be-4698-aebf-4f76b13f095b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:07.759203 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-4b6ce520-e1be-4698-aebf-4f76b13f095b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:07.761190 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1097/2159] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:19:07 2022] DELETE /identity/v3/projects/2ee4fcd75432400e910dd8b316ba99f2 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:19:07.762643 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca765e28-9c7d-46ab-8977-5e10b4c08517 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:07.762952 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca765e28-9c7d-46ab-8977-5e10b4c08517 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:07.763399 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca765e28-9c7d-46ab-8977-5e10b4c08517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:07.782660 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-ca765e28-9c7d-46ab-8977-5e10b4c08517 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:19:07.784250 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-ca765e28-9c7d-46ab-8977-5e10b4c08517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:07.788117 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331b5292-764e-47cb-8360-eaac0f06208b admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:07.792391 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:07.799767 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:07.845951 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686aa522-fdc8-4b95-acc8-bf9c1b8c1dce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f86373d65440da97c853fff3c1d0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:07.846956 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686aa522-fdc8-4b95-acc8-bf9c1b8c1dce service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:07.847296 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686aa522-fdc8-4b95-acc8-bf9c1b8c1dce service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:07.847508 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686aa522-fdc8-4b95-acc8-bf9c1b8c1dce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:07.849795 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-686aa522-fdc8-4b95-acc8-bf9c1b8c1dce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:07.858581 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1098/2160] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:19:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:19:07.858581 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2873e85b-0822-42a6-9885-ae340fe0cda8 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:07.858581 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2873e85b-0822-42a6-9885-ae340fe0cda8 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:07.858581 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2873e85b-0822-42a6-9885-ae340fe0cda8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:07.884472 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-2873e85b-0822-42a6-9885-ae340fe0cda8 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:19:07.884472 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-2873e85b-0822-42a6-9885-ae340fe0cda8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:07.891947 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1099/2161] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:19:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:19:07.898397 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2873e85b-0822-42a6-9885-ae340fe0cda8 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:07.898397 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-2873e85b-0822-42a6-9885-ae340fe0cda8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:07.953218 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686aa522-fdc8-4b95-acc8-bf9c1b8c1dce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:07.953218 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686aa522-fdc8-4b95-acc8-bf9c1b8c1dce service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:07.960428 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1063/2162] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:19:07 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:19:07.961747 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8888298-53b0-4c1e-8c05-3008c95e37e7 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:07.962043 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8888298-53b0-4c1e-8c05-3008c95e37e7 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:07.962311 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8888298-53b0-4c1e-8c05-3008c95e37e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:07.982414 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2873e85b-0822-42a6-9885-ae340fe0cda8 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:07.983741 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-f8888298-53b0-4c1e-8c05-3008c95e37e7 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:19:07.985216 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f8888298-53b0-4c1e-8c05-3008c95e37e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:07.985577 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c11a1ad-889d-4eb8-9737-d5313ebc2f40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:07.986492 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11a1ad-889d-4eb8-9737-d5313ebc2f40 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:07.986785 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11a1ad-889d-4eb8-9737-d5313ebc2f40 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:07.987149 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11a1ad-889d-4eb8-9737-d5313ebc2f40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:07.994198 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1064/2163] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:19:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:19:07.998483 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8888298-53b0-4c1e-8c05-3008c95e37e7 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:08.008376 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c11a1ad-889d-4eb8-9737-d5313ebc2f40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:08.009960 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c11a1ad-889d-4eb8-9737-d5313ebc2f40 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:08.012087 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8888298-53b0-4c1e-8c05-3008c95e37e7 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:08.019255 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f1955-997b-4f17-a278-5c7c85fad9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:08.020157 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f1955-997b-4f17-a278-5c7c85fad9ee admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:08.020382 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f1955-997b-4f17-a278-5c7c85fad9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:08.020661 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f1955-997b-4f17-a278-5c7c85fad9ee admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:08.021485 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279f1955-997b-4f17-a278-5c7c85fad9ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:19:08.021864 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279f1955-997b-4f17-a278-5c7c85fad9ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:08.023931 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279f1955-997b-4f17-a278-5c7c85fad9ee admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:08.024494 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1100/2164] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:19:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:19:08.052020 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1065/2165] 10.222.0.42 () {58 vars in 1152 bytes} [Mon Jul 4 09:19:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:19:08.057244 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c11a1ad-889d-4eb8-9737-d5313ebc2f40 service neutron] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:08.069767 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c11a1ad-889d-4eb8-9737-d5313ebc2f40 service neutron] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:08.075461 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b451b53c-04f5-42d7-9401-78fbf93a3b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:08.076578 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b451b53c-04f5-42d7-9401-78fbf93a3b9d admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:08.076669 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b451b53c-04f5-42d7-9401-78fbf93a3b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:08.077369 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b451b53c-04f5-42d7-9401-78fbf93a3b9d admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:08.078165 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b451b53c-04f5-42d7-9401-78fbf93a3b9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:08.080602 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b451b53c-04f5-42d7-9401-78fbf93a3b9d admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:08.127914 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1101/2166] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:19:08 2022] POST /identity/v3/projects => generated 385 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:19:08.130332 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f1955-997b-4f17-a278-5c7c85fad9ee admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:08.144749 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f1955-997b-4f17-a278-5c7c85fad9ee admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:08.222574 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae11074-5c76-4302-ae37-718de7face6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:08.223268 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae11074-5c76-4302-ae37-718de7face6c admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:08.223947 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae11074-5c76-4302-ae37-718de7face6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:08.224509 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae11074-5c76-4302-ae37-718de7face6c admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:08.225000 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae11074-5c76-4302-ae37-718de7face6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:08.227241 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae11074-5c76-4302-ae37-718de7face6c admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:08.251929 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1066/2167] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:19:08 2022] POST /identity/v3/users => generated 293 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:19:08.254280 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b451b53c-04f5-42d7-9401-78fbf93a3b9d admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:08.267434 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b451b53c-04f5-42d7-9401-78fbf93a3b9d admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:08.272856 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5c802e-984e-48bb-9cc1-8f0dfde55f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:08.273852 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c802e-984e-48bb-9cc1-8f0dfde55f66 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:08.274138 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c802e-984e-48bb-9cc1-8f0dfde55f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:08.274406 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c802e-984e-48bb-9cc1-8f0dfde55f66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:08.275213 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5c802e-984e-48bb-9cc1-8f0dfde55f66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:08.277742 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5c802e-984e-48bb-9cc1-8f0dfde55f66 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:08.290173 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1102/2168] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:19:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:19:08.294028 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae11074-5c76-4302-ae37-718de7face6c admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:08.307588 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae11074-5c76-4302-ae37-718de7face6c admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:08.314295 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904f44de-bd1c-4f54-85d0-a9590bed93a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:08.315248 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f44de-bd1c-4f54-85d0-a9590bed93a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:08.315248 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f44de-bd1c-4f54-85d0-a9590bed93a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:08.315619 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f44de-bd1c-4f54-85d0-a9590bed93a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:08.317006 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904f44de-bd1c-4f54-85d0-a9590bed93a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:08.319281 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904f44de-bd1c-4f54-85d0-a9590bed93a6 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:08.343829 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1067/2169] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:19:08 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:19:08.345844 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5c802e-984e-48bb-9cc1-8f0dfde55f66 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:08.358991 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5c802e-984e-48bb-9cc1-8f0dfde55f66 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:08.364693 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9979d6-4f97-45fd-b6f0-e66e7f67789a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:08.365879 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9979d6-4f97-45fd-b6f0-e66e7f67789a admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:08.366224 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9979d6-4f97-45fd-b6f0-e66e7f67789a admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:08.366892 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9979d6-4f97-45fd-b6f0-e66e7f67789a admin admin] PATH_INFO: `/v3/projects/2cb6108f1ec04129a6c46dd0999b2224/users/e0b6215cec7642fca77a4605d0b3b9cf/roles/81634e7812344f84afcb29b0dba2687c` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:08.387899 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9979d6-4f97-45fd-b6f0-e66e7f67789a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cb6108f1ec04129a6c46dd0999b2224, user_id=e0b6215cec7642fca77a4605d0b3b9cf, role_id=81634e7812344f84afcb29b0dba2687c)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:08.390845 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9979d6-4f97-45fd-b6f0-e66e7f67789a admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:08.411945 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1103/2170] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:19:08 2022] PUT /identity/v3/projects/2cb6108f1ec04129a6c46dd0999b2224/users/e0b6215cec7642fca77a4605d0b3b9cf/roles/81634e7812344f84afcb29b0dba2687c => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:19:08.417723 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb1ee5-956b-4ac1-a085-08359ec71eb2 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:08.418062 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb1ee5-956b-4ac1-a085-08359ec71eb2 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:08.418341 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb1ee5-956b-4ac1-a085-08359ec71eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:08.469773 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-5dbb1ee5-956b-4ac1-a085-08359ec71eb2 None None] MFA Rules not processed for user `e0b6215cec7642fca77a4605d0b3b9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:19:08.471573 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-5dbb1ee5-956b-4ac1-a085-08359ec71eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:08.483940 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:08.562717 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1068/2171] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:19:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:19:08.567006 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9979d6-4f97-45fd-b6f0-e66e7f67789a admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:08.627581 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:08.632167 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9979d6-4f97-45fd-b6f0-e66e7f67789a admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:08.639184 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d38725-873c-45a7-8716-c42740a54669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:08.639960 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d38725-873c-45a7-8716-c42740a54669 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:08.640306 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d38725-873c-45a7-8716-c42740a54669 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:08.640668 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d38725-873c-45a7-8716-c42740a54669 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:08.641390 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d38725-873c-45a7-8716-c42740a54669 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:08.643343 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d38725-873c-45a7-8716-c42740a54669 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:08.671909 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1104/2172] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:19:08 2022] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:19:08.674971 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbb1ee5-956b-4ac1-a085-08359ec71eb2 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:08.686530 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbb1ee5-956b-4ac1-a085-08359ec71eb2 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:08.739164 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace87789-cbbe-4e44-b003-b911d7c30f4a None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:08.739466 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace87789-cbbe-4e44-b003-b911d7c30f4a None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:08.739745 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace87789-cbbe-4e44-b003-b911d7c30f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:08.758653 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669ae446-09e2-4c4f-ae00-edb86c25affc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:08.759338 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ae446-09e2-4c4f-ae00-edb86c25affc admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:08.759729 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ae446-09e2-4c4f-ae00-edb86c25affc admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:08.760051 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ae446-09e2-4c4f-ae00-edb86c25affc admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:08.761208 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669ae446-09e2-4c4f-ae00-edb86c25affc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:08.762722 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669ae446-09e2-4c4f-ae00-edb86c25affc admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:08.769044 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-ace87789-cbbe-4e44-b003-b911d7c30f4a None None] MFA Rules not processed for user `0375760c788b4bd0992302f291a2dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:19:08.770400 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-ace87789-cbbe-4e44-b003-b911d7c30f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:08.784495 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1069/2173] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:19:08 2022] POST /identity/v3/users => generated 292 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:19:08.789096 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669ae446-09e2-4c4f-ae00-edb86c25affc admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:08.801819 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669ae446-09e2-4c4f-ae00-edb86c25affc admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:08.806258 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341e3e8e-2867-4826-a2c5-833f70196a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:08.806935 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341e3e8e-2867-4826-a2c5-833f70196a4c admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:08.807220 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341e3e8e-2867-4826-a2c5-833f70196a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:08.807497 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341e3e8e-2867-4826-a2c5-833f70196a4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:08.809032 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341e3e8e-2867-4826-a2c5-833f70196a4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:08.809973 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341e3e8e-2867-4826-a2c5-833f70196a4c admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:08.823999 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1070/2174] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:19:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:19:08.825585 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341e3e8e-2867-4826-a2c5-833f70196a4c admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:08.837099 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341e3e8e-2867-4826-a2c5-833f70196a4c admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:08.843168 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd804f7-cada-41b7-992f-ab2d4d5aa315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:08.843967 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd804f7-cada-41b7-992f-ab2d4d5aa315 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:08.844256 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd804f7-cada-41b7-992f-ab2d4d5aa315 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:08.844609 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd804f7-cada-41b7-992f-ab2d4d5aa315 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:08.845548 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd804f7-cada-41b7-992f-ab2d4d5aa315 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:08.847373 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd804f7-cada-41b7-992f-ab2d4d5aa315 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:08.848210 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1105/2175] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:19:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:19:08.858912 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace87789-cbbe-4e44-b003-b911d7c30f4a None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:08.863194 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1071/2176] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:19:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:19:08.863321 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-ace87789-cbbe-4e44-b003-b911d7c30f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:08.864498 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd804f7-cada-41b7-992f-ab2d4d5aa315 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:08.875186 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd804f7-cada-41b7-992f-ab2d4d5aa315 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:08.883596 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bd8c57-c354-4910-8ab3-c61b5bfc42b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:08.883596 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd8c57-c354-4910-8ab3-c61b5bfc42b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:08.883596 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd8c57-c354-4910-8ab3-c61b5bfc42b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:08.883596 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd8c57-c354-4910-8ab3-c61b5bfc42b0 admin admin] PATH_INFO: `/v3/projects/2d5ccbea7a9242fc89d85d9828d07afe/users/6a47a6dd300843af9d955d99d8d81b3a/roles/81634e7812344f84afcb29b0dba2687c` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:08.900216 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bd8c57-c354-4910-8ab3-c61b5bfc42b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d5ccbea7a9242fc89d85d9828d07afe, user_id=6a47a6dd300843af9d955d99d8d81b3a, role_id=81634e7812344f84afcb29b0dba2687c)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:08.903504 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bd8c57-c354-4910-8ab3-c61b5bfc42b0 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:08.919909 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1072/2177] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:19:08 2022] PUT /identity/v3/projects/2d5ccbea7a9242fc89d85d9828d07afe/users/6a47a6dd300843af9d955d99d8d81b3a/roles/81634e7812344f84afcb29b0dba2687c => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:19:08.929962 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1929255-7c30-4e79-b150-8f83c1778906 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:08.930269 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1929255-7c30-4e79-b150-8f83c1778906 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:08.930539 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1929255-7c30-4e79-b150-8f83c1778906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:08.933460 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace87789-cbbe-4e44-b003-b911d7c30f4a None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:08.960165 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-f1929255-7c30-4e79-b150-8f83c1778906 None None] MFA Rules not processed for user `6a47a6dd300843af9d955d99d8d81b3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:19:08.961438 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f1929255-7c30-4e79-b150-8f83c1778906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:08.983894 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49abade0-9b9b-43c6-9b8d-0e1c0c52e126 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f86373d65440da97c853fff3c1d0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:08.984559 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49abade0-9b9b-43c6-9b8d-0e1c0c52e126 service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:08.984841 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49abade0-9b9b-43c6-9b8d-0e1c0c52e126 service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:08.985117 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49abade0-9b9b-43c6-9b8d-0e1c0c52e126 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:08.999754 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:09.027405 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:09.029089 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1073/2178] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:19:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:19:09.033339 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1929255-7c30-4e79-b150-8f83c1778906 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:09.043278 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49abade0-9b9b-43c6-9b8d-0e1c0c52e126 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:09.044874 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49abade0-9b9b-43c6-9b8d-0e1c0c52e126 service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:09.054205 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1106/2179] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:19:08 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:19:09.100032 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1929255-7c30-4e79-b150-8f83c1778906 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:09.104838 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1547f7-6bca-4233-8efe-d907265083dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:09.105410 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1547f7-6bca-4233-8efe-d907265083dd admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:09.105694 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1547f7-6bca-4233-8efe-d907265083dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:09.105970 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1547f7-6bca-4233-8efe-d907265083dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:09.108593 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1547f7-6bca-4233-8efe-d907265083dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:09.110403 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1547f7-6bca-4233-8efe-d907265083dd admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:09.140372 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1074/2180] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:19:09 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:19:09.144849 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49abade0-9b9b-43c6-9b8d-0e1c0c52e126 service cinder] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:09.156257 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49abade0-9b9b-43c6-9b8d-0e1c0c52e126 service cinder] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:09.236560 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4782e29-cf03-4e10-b76e-a8f707723e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:09.237490 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4782e29-cf03-4e10-b76e-a8f707723e1c admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:09.237992 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4782e29-cf03-4e10-b76e-a8f707723e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:09.238367 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4782e29-cf03-4e10-b76e-a8f707723e1c admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:09.239278 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4782e29-cf03-4e10-b76e-a8f707723e1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:09.242063 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4782e29-cf03-4e10-b76e-a8f707723e1c admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:09.274982 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1107/2181] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:19:09 2022] POST /identity/v3/users => generated 299 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:19:09.278311 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1547f7-6bca-4233-8efe-d907265083dd admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:09.290689 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1547f7-6bca-4233-8efe-d907265083dd admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:09.296012 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a462d2-da2a-4bfe-9984-41b4c3b429cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:09.296676 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a462d2-da2a-4bfe-9984-41b4c3b429cd admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:09.296960 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a462d2-da2a-4bfe-9984-41b4c3b429cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:09.297234 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a462d2-da2a-4bfe-9984-41b4c3b429cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:09.297966 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a462d2-da2a-4bfe-9984-41b4c3b429cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:09.299599 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a462d2-da2a-4bfe-9984-41b4c3b429cd admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:09.311234 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1075/2182] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:19:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:19:09.315557 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4782e29-cf03-4e10-b76e-a8f707723e1c admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:09.326540 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4782e29-cf03-4e10-b76e-a8f707723e1c admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:09.332804 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2db8ad0-eb7f-4393-bc12-e4e4704fe002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:09.333034 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db8ad0-eb7f-4393-bc12-e4e4704fe002 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:09.333319 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db8ad0-eb7f-4393-bc12-e4e4704fe002 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:09.333600 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db8ad0-eb7f-4393-bc12-e4e4704fe002 admin admin] PATH_INFO: `/v3/projects/329f03a9b69347149885a321b499dafa/users/2667a555415a4489acdfb3f382478a9f/roles/965049e7ce6144aaad23c15f3a5e37c3` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:09.351062 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2db8ad0-eb7f-4393-bc12-e4e4704fe002 admin admin] RBAC: Authorizing `identity:create_grant(project_id=329f03a9b69347149885a321b499dafa, user_id=2667a555415a4489acdfb3f382478a9f, role_id=965049e7ce6144aaad23c15f3a5e37c3)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:09.353435 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2db8ad0-eb7f-4393-bc12-e4e4704fe002 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:09.382605 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1108/2183] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:19:09 2022] PUT /identity/v3/projects/329f03a9b69347149885a321b499dafa/users/2667a555415a4489acdfb3f382478a9f/roles/965049e7ce6144aaad23c15f3a5e37c3 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:19:09.387783 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a462d2-da2a-4bfe-9984-41b4c3b429cd admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:09.406151 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a462d2-da2a-4bfe-9984-41b4c3b429cd admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:09.499455 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a330814-4333-45c9-b748-36feeb7457d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:09.501127 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a330814-4333-45c9-b748-36feeb7457d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:09.501573 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a330814-4333-45c9-b748-36feeb7457d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:09.502185 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a330814-4333-45c9-b748-36feeb7457d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:09.503548 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a330814-4333-45c9-b748-36feeb7457d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:09.505468 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a330814-4333-45c9-b748-36feeb7457d1 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:09.525277 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1076/2184] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:19:09 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:19:09.529621 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2db8ad0-eb7f-4393-bc12-e4e4704fe002 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:09.543707 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2db8ad0-eb7f-4393-bc12-e4e4704fe002 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:09.549215 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91ac11c-c0b1-4d8e-9572-9bc4fde7d2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:09.550618 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ac11c-c0b1-4d8e-9572-9bc4fde7d2c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:09.551189 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ac11c-c0b1-4d8e-9572-9bc4fde7d2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:09.552319 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ac11c-c0b1-4d8e-9572-9bc4fde7d2c0 admin admin] PATH_INFO: `/v3/projects/329f03a9b69347149885a321b499dafa/users/2667a555415a4489acdfb3f382478a9f/roles/965049e7ce6144aaad23c15f3a5e37c3` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:09.555443 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91ac11c-c0b1-4d8e-9572-9bc4fde7d2c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=329f03a9b69347149885a321b499dafa, user_id=2667a555415a4489acdfb3f382478a9f, role_id=965049e7ce6144aaad23c15f3a5e37c3)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:09.558362 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91ac11c-c0b1-4d8e-9572-9bc4fde7d2c0 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:09.598812 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1109/2185] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:19:09 2022] PUT /identity/v3/projects/329f03a9b69347149885a321b499dafa/users/2667a555415a4489acdfb3f382478a9f/roles/965049e7ce6144aaad23c15f3a5e37c3 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:19:09.609809 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b6210-b6ae-4a90-ba2e-3a4cc44e7440 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:09.610339 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b6210-b6ae-4a90-ba2e-3a4cc44e7440 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:09.610419 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b6210-b6ae-4a90-ba2e-3a4cc44e7440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:09.640998 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-ee6b6210-b6ae-4a90-ba2e-3a4cc44e7440 None None] MFA Rules not processed for user `2667a555415a4489acdfb3f382478a9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:19:09.642273 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ee6b6210-b6ae-4a90-ba2e-3a4cc44e7440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:09.683458 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:09.718711 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1077/2186] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:19:09 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:19:09.730309 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91ac11c-c0b1-4d8e-9572-9bc4fde7d2c0 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:09.789316 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91ac11c-c0b1-4d8e-9572-9bc4fde7d2c0 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:09.793812 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed24100-ce27-4fc2-adad-7cf8a8140af2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f86373d65440da97c853fff3c1d0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:09.794503 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed24100-ce27-4fc2-adad-7cf8a8140af2 service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:09.794852 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed24100-ce27-4fc2-adad-7cf8a8140af2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:09.795131 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed24100-ce27-4fc2-adad-7cf8a8140af2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:09.846035 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:09.859498 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed24100-ce27-4fc2-adad-7cf8a8140af2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:09.861077 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed24100-ce27-4fc2-adad-7cf8a8140af2 service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:09.871283 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1110/2187] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:19:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:19:10.551392 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04349346-98af-4145-840b-af28231159c7 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:10.551686 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04349346-98af-4145-840b-af28231159c7 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:10.552012 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04349346-98af-4145-840b-af28231159c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:10.572962 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-04349346-98af-4145-840b-af28231159c7 None None] MFA Rules not processed for user `0375760c788b4bd0992302f291a2dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:19:10.574174 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-04349346-98af-4145-840b-af28231159c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:10.638437 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1078/2188] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:19:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:19:11.454785 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed24100-ce27-4fc2-adad-7cf8a8140af2 service cinder] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:11.456303 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-1ed24100-ce27-4fc2-adad-7cf8a8140af2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:11.472146 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed24100-ce27-4fc2-adad-7cf8a8140af2 service cinder] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:11.477448 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433d7930-8352-4325-8b62-1c790454f1c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f86373d65440da97c853fff3c1d0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:11.478302 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d7930-8352-4325-8b62-1c790454f1c1 service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:11.478640 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d7930-8352-4325-8b62-1c790454f1c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:11.479011 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d7930-8352-4325-8b62-1c790454f1c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:11.553522 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433d7930-8352-4325-8b62-1c790454f1c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:11.555097 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433d7930-8352-4325-8b62-1c790454f1c1 service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:11.565140 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1111/2189] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:19:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:19:12.124385 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04349346-98af-4145-840b-af28231159c7 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:12.134044 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04349346-98af-4145-840b-af28231159c7 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:12.137632 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387c6278-d320-4016-a1e0-c60491afac33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f86373d65440da97c853fff3c1d0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:12.138389 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c6278-d320-4016-a1e0-c60491afac33 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:12.138706 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c6278-d320-4016-a1e0-c60491afac33 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:12.138982 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c6278-d320-4016-a1e0-c60491afac33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:12.148955 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387c6278-d320-4016-a1e0-c60491afac33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:12.150531 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387c6278-d320-4016-a1e0-c60491afac33 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:12.161008 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1079/2190] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:19:12 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:19:12.239821 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433d7930-8352-4325-8b62-1c790454f1c1 service cinder] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:12.241563 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-433d7930-8352-4325-8b62-1c790454f1c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:12.319964 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433d7930-8352-4325-8b62-1c790454f1c1 service cinder] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:12.325457 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8023bb-b7ee-40ac-8459-33876a0bde26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:12.326425 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8023bb-b7ee-40ac-8459-33876a0bde26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:12.326800 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8023bb-b7ee-40ac-8459-33876a0bde26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:12.327078 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8023bb-b7ee-40ac-8459-33876a0bde26 admin admin] PATH_INFO: `/v3/users/ad50c42d31734d5da86a92225a767c15` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:12.328338 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8023bb-b7ee-40ac-8459-33876a0bde26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad50c42d31734d5da86a92225a767c15)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:12.330334 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8023bb-b7ee-40ac-8459-33876a0bde26 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:12.392538 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-6b8023bb-b7ee-40ac-8459-33876a0bde26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad50c42d31734d5da86a92225a767c15'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:12.402879 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-6b8023bb-b7ee-40ac-8459-33876a0bde26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad50c42d31734d5da86a92225a767c15'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:12.403844 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-6b8023bb-b7ee-40ac-8459-33876a0bde26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad50c42d31734d5da86a92225a767c15'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:12.404542 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-6b8023bb-b7ee-40ac-8459-33876a0bde26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad50c42d31734d5da86a92225a767c15'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:12.424960 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-6b8023bb-b7ee-40ac-8459-33876a0bde26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad50c42d31734d5da86a92225a767c15'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:12.442570 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1112/2191] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:19:12 2022] DELETE /identity/v3/users/ad50c42d31734d5da86a92225a767c15 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:19:12.447652 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ee229-aa0d-43e1-81a2-034f8a1d3028 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:12.448076 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ee229-aa0d-43e1-81a2-034f8a1d3028 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:12.448566 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ee229-aa0d-43e1-81a2-034f8a1d3028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:12.470988 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-609ee229-aa0d-43e1-81a2-034f8a1d3028 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:19:12.472763 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-609ee229-aa0d-43e1-81a2-034f8a1d3028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:12.572706 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1080/2192] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:19:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:19:12.580380 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8023bb-b7ee-40ac-8459-33876a0bde26 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:12.582325 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-6b8023bb-b7ee-40ac-8459-33876a0bde26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:12.592801 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:12.653136 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8023bb-b7ee-40ac-8459-33876a0bde26 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:12.657155 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca34bfa6-411e-4822-b66e-f918ea1b45c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:12.658210 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca34bfa6-411e-4822-b66e-f918ea1b45c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:12.658716 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca34bfa6-411e-4822-b66e-f918ea1b45c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:12.659491 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca34bfa6-411e-4822-b66e-f918ea1b45c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:12.671861 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca34bfa6-411e-4822-b66e-f918ea1b45c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:12.673434 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca34bfa6-411e-4822-b66e-f918ea1b45c3 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:12.684808 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1113/2193] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:19:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:19:13.163540 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609ee229-aa0d-43e1-81a2-034f8a1d3028 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:13.165186 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-609ee229-aa0d-43e1-81a2-034f8a1d3028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:13.177397 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609ee229-aa0d-43e1-81a2-034f8a1d3028 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:13.186370 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02469a70-68f0-4363-9e01-72aecf92cf1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:13.187385 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02469a70-68f0-4363-9e01-72aecf92cf1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:13.187656 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02469a70-68f0-4363-9e01-72aecf92cf1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:13.187964 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02469a70-68f0-4363-9e01-72aecf92cf1a admin admin] PATH_INFO: `/v3/projects/6e262745b913475f874fd3ad90b881fe` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:13.190132 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02469a70-68f0-4363-9e01-72aecf92cf1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e262745b913475f874fd3ad90b881fe)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:13.192296 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02469a70-68f0-4363-9e01-72aecf92cf1a admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:13.273757 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-02469a70-68f0-4363-9e01-72aecf92cf1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e262745b913475f874fd3ad90b881fe', 'request_id': 'req-02469a70-68f0-4363-9e01-72aecf92cf1a'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:13.301256 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-02469a70-68f0-4363-9e01-72aecf92cf1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e262745b913475f874fd3ad90b881fe', 'request_id': 'req-02469a70-68f0-4363-9e01-72aecf92cf1a'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:13.306678 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:13.314594 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-02469a70-68f0-4363-9e01-72aecf92cf1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e262745b913475f874fd3ad90b881fe', 'request_id': 'req-02469a70-68f0-4363-9e01-72aecf92cf1a'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:13.339901 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-02469a70-68f0-4363-9e01-72aecf92cf1a admin admin] The token cache is being invalidate because project 6e262745b913475f874fd3ad90b881fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:19:13.340283 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-02469a70-68f0-4363-9e01-72aecf92cf1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:13.341665 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-02469a70-68f0-4363-9e01-72aecf92cf1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:13.345147 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1081/2194] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:19:13 2022] DELETE /identity/v3/projects/6e262745b913475f874fd3ad90b881fe => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:19:13.349826 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca34bfa6-411e-4822-b66e-f918ea1b45c3 service neutron] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:13.366542 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca34bfa6-411e-4822-b66e-f918ea1b45c3 service neutron] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:13.458379 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a12b97d-0b53-4d54-b57d-0ed8e0b189aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:13.460755 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a12b97d-0b53-4d54-b57d-0ed8e0b189aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:13.461065 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a12b97d-0b53-4d54-b57d-0ed8e0b189aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:13.461352 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a12b97d-0b53-4d54-b57d-0ed8e0b189aa admin admin] PATH_INFO: `/v3/users/21e32b7bc73d449e9912752034301632` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:13.464008 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a12b97d-0b53-4d54-b57d-0ed8e0b189aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=21e32b7bc73d449e9912752034301632)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:13.467465 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a12b97d-0b53-4d54-b57d-0ed8e0b189aa admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:13.601678 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-7a12b97d-0b53-4d54-b57d-0ed8e0b189aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21e32b7bc73d449e9912752034301632'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:13.614676 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-7a12b97d-0b53-4d54-b57d-0ed8e0b189aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21e32b7bc73d449e9912752034301632'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:13.616760 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-7a12b97d-0b53-4d54-b57d-0ed8e0b189aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21e32b7bc73d449e9912752034301632'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:13.617911 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-7a12b97d-0b53-4d54-b57d-0ed8e0b189aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21e32b7bc73d449e9912752034301632'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:13.653757 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-7a12b97d-0b53-4d54-b57d-0ed8e0b189aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21e32b7bc73d449e9912752034301632'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:13.701874 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1114/2195] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:19:13 2022] DELETE /identity/v3/users/21e32b7bc73d449e9912752034301632 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:19:14.029780 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02469a70-68f0-4363-9e01-72aecf92cf1a admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:14.031533 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-02469a70-68f0-4363-9e01-72aecf92cf1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:14.066194 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02469a70-68f0-4363-9e01-72aecf92cf1a admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:14.128876 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e40b99-f925-4680-8eec-610a7c15e2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:14.129823 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e40b99-f925-4680-8eec-610a7c15e2d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:14.130105 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e40b99-f925-4680-8eec-610a7c15e2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:14.130374 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e40b99-f925-4680-8eec-610a7c15e2d3 admin admin] PATH_INFO: `/v3/projects/f96e6f65049f4c7eb75fd15b9578ef59` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:14.131607 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e40b99-f925-4680-8eec-610a7c15e2d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f96e6f65049f4c7eb75fd15b9578ef59)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:14.133797 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e40b99-f925-4680-8eec-610a7c15e2d3 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:14.186089 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-98e40b99-f925-4680-8eec-610a7c15e2d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f96e6f65049f4c7eb75fd15b9578ef59', 'request_id': 'req-98e40b99-f925-4680-8eec-610a7c15e2d3'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:14.195152 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-98e40b99-f925-4680-8eec-610a7c15e2d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f96e6f65049f4c7eb75fd15b9578ef59', 'request_id': 'req-98e40b99-f925-4680-8eec-610a7c15e2d3'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:14.207779 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-98e40b99-f925-4680-8eec-610a7c15e2d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f96e6f65049f4c7eb75fd15b9578ef59', 'request_id': 'req-98e40b99-f925-4680-8eec-610a7c15e2d3'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:14.224313 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-98e40b99-f925-4680-8eec-610a7c15e2d3 admin admin] The token cache is being invalidate because project f96e6f65049f4c7eb75fd15b9578ef59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:19:14.224817 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-98e40b99-f925-4680-8eec-610a7c15e2d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:14.225513 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-98e40b99-f925-4680-8eec-610a7c15e2d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:14.230499 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1082/2196] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:19:14 2022] DELETE /identity/v3/projects/f96e6f65049f4c7eb75fd15b9578ef59 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:19:14.235601 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a12b97d-0b53-4d54-b57d-0ed8e0b189aa admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:14.241093 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-7a12b97d-0b53-4d54-b57d-0ed8e0b189aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:14.259834 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a12b97d-0b53-4d54-b57d-0ed8e0b189aa admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:14.292148 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:14.338853 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96afa182-ccc4-4bdc-a47a-948efdc358ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:14.339772 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96afa182-ccc4-4bdc-a47a-948efdc358ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:14.340155 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96afa182-ccc4-4bdc-a47a-948efdc358ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:14.340526 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96afa182-ccc4-4bdc-a47a-948efdc358ce admin admin] PATH_INFO: `/v3/users/6412f6b2126d4354bca8d0fb7c63ee22` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:14.342053 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96afa182-ccc4-4bdc-a47a-948efdc358ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=6412f6b2126d4354bca8d0fb7c63ee22)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:14.344312 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96afa182-ccc4-4bdc-a47a-948efdc358ce admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:14.400744 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-96afa182-ccc4-4bdc-a47a-948efdc358ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6412f6b2126d4354bca8d0fb7c63ee22'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:14.409344 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-96afa182-ccc4-4bdc-a47a-948efdc358ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6412f6b2126d4354bca8d0fb7c63ee22'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:14.409975 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-96afa182-ccc4-4bdc-a47a-948efdc358ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6412f6b2126d4354bca8d0fb7c63ee22'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:14.410575 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-96afa182-ccc4-4bdc-a47a-948efdc358ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6412f6b2126d4354bca8d0fb7c63ee22'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:14.423248 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-96afa182-ccc4-4bdc-a47a-948efdc358ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6412f6b2126d4354bca8d0fb7c63ee22'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:14.440493 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1115/2197] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:19:14 2022] DELETE /identity/v3/users/6412f6b2126d4354bca8d0fb7c63ee22 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:19:14.748162 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e40b99-f925-4680-8eec-610a7c15e2d3 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:14.750050 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-98e40b99-f925-4680-8eec-610a7c15e2d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:14.767821 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e40b99-f925-4680-8eec-610a7c15e2d3 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:14.856198 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1c9e03-ef61-473e-97ac-29f9e6218c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:14.857370 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1c9e03-ef61-473e-97ac-29f9e6218c27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:14.857801 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1c9e03-ef61-473e-97ac-29f9e6218c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:14.858551 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1c9e03-ef61-473e-97ac-29f9e6218c27 admin admin] PATH_INFO: `/v3/projects/01f7fd5958454535b891d758ff4cc3a4` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:14.859970 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1c9e03-ef61-473e-97ac-29f9e6218c27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01f7fd5958454535b891d758ff4cc3a4)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:14.861934 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1c9e03-ef61-473e-97ac-29f9e6218c27 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:14.896294 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:14.931688 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5c1c9e03-ef61-473e-97ac-29f9e6218c27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01f7fd5958454535b891d758ff4cc3a4', 'request_id': 'req-5c1c9e03-ef61-473e-97ac-29f9e6218c27'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:14.938745 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5c1c9e03-ef61-473e-97ac-29f9e6218c27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01f7fd5958454535b891d758ff4cc3a4', 'request_id': 'req-5c1c9e03-ef61-473e-97ac-29f9e6218c27'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:14.954713 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5c1c9e03-ef61-473e-97ac-29f9e6218c27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01f7fd5958454535b891d758ff4cc3a4', 'request_id': 'req-5c1c9e03-ef61-473e-97ac-29f9e6218c27'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:14.963480 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5c1c9e03-ef61-473e-97ac-29f9e6218c27 admin admin] The token cache is being invalidate because project 01f7fd5958454535b891d758ff4cc3a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:19:14.963838 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5c1c9e03-ef61-473e-97ac-29f9e6218c27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:14.964711 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5c1c9e03-ef61-473e-97ac-29f9e6218c27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:14.966662 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1083/2198] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:19:14 2022] DELETE /identity/v3/projects/01f7fd5958454535b891d758ff4cc3a4 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:19:16.309599 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96afa182-ccc4-4bdc-a47a-948efdc358ce admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:16.314797 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-96afa182-ccc4-4bdc-a47a-948efdc358ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:16.335622 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96afa182-ccc4-4bdc-a47a-948efdc358ce admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:16.430296 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee81221d-d021-4e78-9524-1fd3bee5d98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:16.430296 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81221d-d021-4e78-9524-1fd3bee5d98c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:16.430296 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81221d-d021-4e78-9524-1fd3bee5d98c admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:16.430296 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81221d-d021-4e78-9524-1fd3bee5d98c admin admin] PATH_INFO: `/v3/users/e0b6215cec7642fca77a4605d0b3b9cf` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:16.432160 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee81221d-d021-4e78-9524-1fd3bee5d98c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0b6215cec7642fca77a4605d0b3b9cf)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:16.434847 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee81221d-d021-4e78-9524-1fd3bee5d98c admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:16.511356 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-ee81221d-d021-4e78-9524-1fd3bee5d98c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0b6215cec7642fca77a4605d0b3b9cf'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:16.514449 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:16.521478 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-ee81221d-d021-4e78-9524-1fd3bee5d98c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0b6215cec7642fca77a4605d0b3b9cf'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:16.522476 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-ee81221d-d021-4e78-9524-1fd3bee5d98c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0b6215cec7642fca77a4605d0b3b9cf'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:16.523350 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-ee81221d-d021-4e78-9524-1fd3bee5d98c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0b6215cec7642fca77a4605d0b3b9cf'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:16.536283 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-ee81221d-d021-4e78-9524-1fd3bee5d98c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0b6215cec7642fca77a4605d0b3b9cf'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:16.548913 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1116/2199] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:19:16 2022] DELETE /identity/v3/users/e0b6215cec7642fca77a4605d0b3b9cf => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:19:16.553660 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82767b43-8eb5-49c2-bd30-beb28c14b62f None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:16.554139 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82767b43-8eb5-49c2-bd30-beb28c14b62f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:16.554232 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82767b43-8eb5-49c2-bd30-beb28c14b62f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:16.574070 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-82767b43-8eb5-49c2-bd30-beb28c14b62f None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:19:16.575540 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-82767b43-8eb5-49c2-bd30-beb28c14b62f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:16.644935 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1084/2200] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:19:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:19:16.655351 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee81221d-d021-4e78-9524-1fd3bee5d98c admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:16.656856 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-ee81221d-d021-4e78-9524-1fd3bee5d98c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:16.716261 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee81221d-d021-4e78-9524-1fd3bee5d98c admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:16.720289 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db2ec4a-d47e-4bd4-9b0f-37a21f856290 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:16.720959 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db2ec4a-d47e-4bd4-9b0f-37a21f856290 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:16.721235 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db2ec4a-d47e-4bd4-9b0f-37a21f856290 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:16.721508 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db2ec4a-d47e-4bd4-9b0f-37a21f856290 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:16.731213 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db2ec4a-d47e-4bd4-9b0f-37a21f856290 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:16.732727 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db2ec4a-d47e-4bd4-9b0f-37a21f856290 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:16.742329 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1117/2201] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:19:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:19:17.020536 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82767b43-8eb5-49c2-bd30-beb28c14b62f None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:17.022153 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-82767b43-8eb5-49c2-bd30-beb28c14b62f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:17.036317 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82767b43-8eb5-49c2-bd30-beb28c14b62f None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:17.041247 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927e9e26-774a-45e6-968e-35f7ae47e010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:17.042113 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e9e26-774a-45e6-968e-35f7ae47e010 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:17.042396 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e9e26-774a-45e6-968e-35f7ae47e010 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:17.042740 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e9e26-774a-45e6-968e-35f7ae47e010 admin admin] PATH_INFO: `/v3/projects/2cb6108f1ec04129a6c46dd0999b2224` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:17.043904 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927e9e26-774a-45e6-968e-35f7ae47e010 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cb6108f1ec04129a6c46dd0999b2224)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:17.046597 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927e9e26-774a-45e6-968e-35f7ae47e010 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:17.096118 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-927e9e26-774a-45e6-968e-35f7ae47e010 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cb6108f1ec04129a6c46dd0999b2224', 'request_id': 'req-927e9e26-774a-45e6-968e-35f7ae47e010'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:17.105786 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-927e9e26-774a-45e6-968e-35f7ae47e010 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cb6108f1ec04129a6c46dd0999b2224', 'request_id': 'req-927e9e26-774a-45e6-968e-35f7ae47e010'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:17.113854 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-927e9e26-774a-45e6-968e-35f7ae47e010 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cb6108f1ec04129a6c46dd0999b2224', 'request_id': 'req-927e9e26-774a-45e6-968e-35f7ae47e010'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:17.125330 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-927e9e26-774a-45e6-968e-35f7ae47e010 admin admin] The token cache is being invalidate because project 2cb6108f1ec04129a6c46dd0999b2224 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:19:17.125616 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-927e9e26-774a-45e6-968e-35f7ae47e010 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:17.126318 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-927e9e26-774a-45e6-968e-35f7ae47e010 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:17.127982 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1085/2202] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:19:17 2022] DELETE /identity/v3/projects/2cb6108f1ec04129a6c46dd0999b2224 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:19:17.132210 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db2ec4a-d47e-4bd4-9b0f-37a21f856290 service neutron] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:17.142208 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db2ec4a-d47e-4bd4-9b0f-37a21f856290 service neutron] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:17.200604 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e79e71-c8a4-4a1d-9f2b-f30d25bba49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:17.201651 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e79e71-c8a4-4a1d-9f2b-f30d25bba49e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:17.201935 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e79e71-c8a4-4a1d-9f2b-f30d25bba49e admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:17.202205 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e79e71-c8a4-4a1d-9f2b-f30d25bba49e admin admin] PATH_INFO: `/v3/users/6a47a6dd300843af9d955d99d8d81b3a` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:17.203467 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e79e71-c8a4-4a1d-9f2b-f30d25bba49e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a47a6dd300843af9d955d99d8d81b3a)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:17.205426 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e79e71-c8a4-4a1d-9f2b-f30d25bba49e admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:17.261856 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a8e79e71-c8a4-4a1d-9f2b-f30d25bba49e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a47a6dd300843af9d955d99d8d81b3a'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:17.271101 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a8e79e71-c8a4-4a1d-9f2b-f30d25bba49e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a47a6dd300843af9d955d99d8d81b3a'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:17.271734 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a8e79e71-c8a4-4a1d-9f2b-f30d25bba49e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a47a6dd300843af9d955d99d8d81b3a'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:17.272401 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a8e79e71-c8a4-4a1d-9f2b-f30d25bba49e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a47a6dd300843af9d955d99d8d81b3a'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:17.284234 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a8e79e71-c8a4-4a1d-9f2b-f30d25bba49e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a47a6dd300843af9d955d99d8d81b3a'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:17.285434 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:17.298722 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1118/2203] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:19:17 2022] DELETE /identity/v3/users/6a47a6dd300843af9d955d99d8d81b3a => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:19:17.624229 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927e9e26-774a-45e6-968e-35f7ae47e010 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:17.627048 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-927e9e26-774a-45e6-968e-35f7ae47e010 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:17.644401 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927e9e26-774a-45e6-968e-35f7ae47e010 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:17.703195 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:17.742268 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c703ae3-32f6-403c-b753-cbe3fd405081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:17.743495 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c703ae3-32f6-403c-b753-cbe3fd405081 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:17.743787 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c703ae3-32f6-403c-b753-cbe3fd405081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:17.744181 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c703ae3-32f6-403c-b753-cbe3fd405081 admin admin] PATH_INFO: `/v3/projects/2d5ccbea7a9242fc89d85d9828d07afe` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:17.746915 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c703ae3-32f6-403c-b753-cbe3fd405081 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d5ccbea7a9242fc89d85d9828d07afe)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:17.749093 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c703ae3-32f6-403c-b753-cbe3fd405081 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:17.812315 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3c703ae3-32f6-403c-b753-cbe3fd405081 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d5ccbea7a9242fc89d85d9828d07afe', 'request_id': 'req-3c703ae3-32f6-403c-b753-cbe3fd405081'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:17.818784 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3c703ae3-32f6-403c-b753-cbe3fd405081 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d5ccbea7a9242fc89d85d9828d07afe', 'request_id': 'req-3c703ae3-32f6-403c-b753-cbe3fd405081'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:17.828057 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3c703ae3-32f6-403c-b753-cbe3fd405081 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d5ccbea7a9242fc89d85d9828d07afe', 'request_id': 'req-3c703ae3-32f6-403c-b753-cbe3fd405081'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:17.842219 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3c703ae3-32f6-403c-b753-cbe3fd405081 admin admin] The token cache is being invalidate because project 2d5ccbea7a9242fc89d85d9828d07afe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:19:17.842517 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3c703ae3-32f6-403c-b753-cbe3fd405081 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:17.843173 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3c703ae3-32f6-403c-b753-cbe3fd405081 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:17.849289 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1086/2204] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:19:17 2022] DELETE /identity/v3/projects/2d5ccbea7a9242fc89d85d9828d07afe => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:19:17.850340 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e79e71-c8a4-4a1d-9f2b-f30d25bba49e admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:17.851998 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-a8e79e71-c8a4-4a1d-9f2b-f30d25bba49e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:17.865932 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e79e71-c8a4-4a1d-9f2b-f30d25bba49e admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:17.940766 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe78f703-143f-4765-9bf9-1cef332f6056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:17.941805 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe78f703-143f-4765-9bf9-1cef332f6056 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:17.942203 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe78f703-143f-4765-9bf9-1cef332f6056 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:17.942350 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe78f703-143f-4765-9bf9-1cef332f6056 admin admin] PATH_INFO: `/v3/users/2667a555415a4489acdfb3f382478a9f` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:17.943552 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe78f703-143f-4765-9bf9-1cef332f6056 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2667a555415a4489acdfb3f382478a9f)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:17.946654 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe78f703-143f-4765-9bf9-1cef332f6056 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:18.007598 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-fe78f703-143f-4765-9bf9-1cef332f6056 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2667a555415a4489acdfb3f382478a9f'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:18.016894 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-fe78f703-143f-4765-9bf9-1cef332f6056 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2667a555415a4489acdfb3f382478a9f'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:18.017566 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-fe78f703-143f-4765-9bf9-1cef332f6056 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2667a555415a4489acdfb3f382478a9f'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:18.018270 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-fe78f703-143f-4765-9bf9-1cef332f6056 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2667a555415a4489acdfb3f382478a9f'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:18.032422 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-fe78f703-143f-4765-9bf9-1cef332f6056 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2667a555415a4489acdfb3f382478a9f'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:18.045364 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1119/2205] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:19:17 2022] DELETE /identity/v3/users/2667a555415a4489acdfb3f382478a9f => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:19:18.325685 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c703ae3-32f6-403c-b753-cbe3fd405081 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:18.327378 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3c703ae3-32f6-403c-b753-cbe3fd405081 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:18.340898 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c703ae3-32f6-403c-b753-cbe3fd405081 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:18.402405 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd88121-db0b-4e4f-9654-4bb8cd8964e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:18.403287 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd88121-db0b-4e4f-9654-4bb8cd8964e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:18.403565 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd88121-db0b-4e4f-9654-4bb8cd8964e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:18.403967 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd88121-db0b-4e4f-9654-4bb8cd8964e0 admin admin] PATH_INFO: `/v3/projects/329f03a9b69347149885a321b499dafa` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:18.405399 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd88121-db0b-4e4f-9654-4bb8cd8964e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=329f03a9b69347149885a321b499dafa)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:18.407379 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd88121-db0b-4e4f-9654-4bb8cd8964e0 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:18.466307 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0dd88121-db0b-4e4f-9654-4bb8cd8964e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '329f03a9b69347149885a321b499dafa', 'request_id': 'req-0dd88121-db0b-4e4f-9654-4bb8cd8964e0'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:18.472729 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0dd88121-db0b-4e4f-9654-4bb8cd8964e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '329f03a9b69347149885a321b499dafa', 'request_id': 'req-0dd88121-db0b-4e4f-9654-4bb8cd8964e0'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:18.481827 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0dd88121-db0b-4e4f-9654-4bb8cd8964e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '329f03a9b69347149885a321b499dafa', 'request_id': 'req-0dd88121-db0b-4e4f-9654-4bb8cd8964e0'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:18.483083 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:18.496539 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0dd88121-db0b-4e4f-9654-4bb8cd8964e0 admin admin] The token cache is being invalidate because project 329f03a9b69347149885a321b499dafa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:19:18.496825 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0dd88121-db0b-4e4f-9654-4bb8cd8964e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:18.497445 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0dd88121-db0b-4e4f-9654-4bb8cd8964e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:18.499039 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1087/2206] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:19:18 2022] DELETE /identity/v3/projects/329f03a9b69347149885a321b499dafa => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:19:18.505029 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74518c1b-0157-43b5-bd9d-4861c32a99a0 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:18.505323 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74518c1b-0157-43b5-bd9d-4861c32a99a0 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:18.505605 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74518c1b-0157-43b5-bd9d-4861c32a99a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:18.524976 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-74518c1b-0157-43b5-bd9d-4861c32a99a0 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:19:18.526194 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-74518c1b-0157-43b5-bd9d-4861c32a99a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:18.603496 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1120/2207] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:19:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:19:18.613238 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c91434b-42f5-4918-b789-be8456e93abd None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:18.613562 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c91434b-42f5-4918-b789-be8456e93abd None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:18.613835 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c91434b-42f5-4918-b789-be8456e93abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:18.633162 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-8c91434b-42f5-4918-b789-be8456e93abd None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:19:18.634427 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-8c91434b-42f5-4918-b789-be8456e93abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:18.643285 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1088/2208] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:19:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:19:18.647630 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74518c1b-0157-43b5-bd9d-4861c32a99a0 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:18.657941 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74518c1b-0157-43b5-bd9d-4861c32a99a0 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:18.663005 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fba83fb-e57d-4b5e-aa70-b52bf2732ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:18.663658 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fba83fb-e57d-4b5e-aa70-b52bf2732ff7 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:18.663967 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fba83fb-e57d-4b5e-aa70-b52bf2732ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:18.664243 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fba83fb-e57d-4b5e-aa70-b52bf2732ff7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:18.665003 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fba83fb-e57d-4b5e-aa70-b52bf2732ff7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:19:18.665308 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fba83fb-e57d-4b5e-aa70-b52bf2732ff7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:18.666927 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fba83fb-e57d-4b5e-aa70-b52bf2732ff7 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:18.669363 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:18.680187 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1121/2209] 10.222.0.42 () {58 vars in 1152 bytes} [Mon Jul 4 09:19:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:19:18.684440 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c91434b-42f5-4918-b789-be8456e93abd None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:18.694394 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c91434b-42f5-4918-b789-be8456e93abd None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:18.701813 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f32b2-d269-42f0-ae1f-03b182f3c68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:18.702712 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f32b2-d269-42f0-ae1f-03b182f3c68a admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:18.702800 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f32b2-d269-42f0-ae1f-03b182f3c68a admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:18.702998 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f32b2-d269-42f0-ae1f-03b182f3c68a admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:18.703705 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442f32b2-d269-42f0-ae1f-03b182f3c68a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:18.705905 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442f32b2-d269-42f0-ae1f-03b182f3c68a admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:18.736670 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1089/2210] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:19:18 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:19:18.741971 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fba83fb-e57d-4b5e-aa70-b52bf2732ff7 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:18.755339 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fba83fb-e57d-4b5e-aa70-b52bf2732ff7 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:18.811222 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896ac42c-b73b-4576-9bf8-8bbfb444eed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:18.811936 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ac42c-b73b-4576-9bf8-8bbfb444eed2 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:18.812217 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ac42c-b73b-4576-9bf8-8bbfb444eed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:18.812494 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ac42c-b73b-4576-9bf8-8bbfb444eed2 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:18.813183 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896ac42c-b73b-4576-9bf8-8bbfb444eed2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:18.815148 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896ac42c-b73b-4576-9bf8-8bbfb444eed2 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:18.838541 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1122/2211] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:19:18 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:19:18.842811 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f32b2-d269-42f0-ae1f-03b182f3c68a admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:18.853697 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f32b2-d269-42f0-ae1f-03b182f3c68a admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:18.858689 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21de2ca3-5553-4d59-8c2c-aa8ca5e65db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:18.859356 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de2ca3-5553-4d59-8c2c-aa8ca5e65db9 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:18.860914 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de2ca3-5553-4d59-8c2c-aa8ca5e65db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:18.860914 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de2ca3-5553-4d59-8c2c-aa8ca5e65db9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:18.860914 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21de2ca3-5553-4d59-8c2c-aa8ca5e65db9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:18.862366 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21de2ca3-5553-4d59-8c2c-aa8ca5e65db9 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:18.876157 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1090/2212] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:19:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:19:18.877491 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896ac42c-b73b-4576-9bf8-8bbfb444eed2 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:18.888910 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896ac42c-b73b-4576-9bf8-8bbfb444eed2 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:18.893918 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2aa046-4d91-44f3-8e6a-3e44d511ee98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:18.894739 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2aa046-4d91-44f3-8e6a-3e44d511ee98 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:18.895380 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2aa046-4d91-44f3-8e6a-3e44d511ee98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:18.895380 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2aa046-4d91-44f3-8e6a-3e44d511ee98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:18.896102 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2aa046-4d91-44f3-8e6a-3e44d511ee98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:18.897720 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2aa046-4d91-44f3-8e6a-3e44d511ee98 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:18.908538 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1123/2213] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:19:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:19:18.912830 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21de2ca3-5553-4d59-8c2c-aa8ca5e65db9 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:18.923129 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21de2ca3-5553-4d59-8c2c-aa8ca5e65db9 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:18.927893 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617906bd-a7d3-4a40-a0f0-9c2c94ed9149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:18.928832 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617906bd-a7d3-4a40-a0f0-9c2c94ed9149 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:18.929116 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617906bd-a7d3-4a40-a0f0-9c2c94ed9149 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:18.929391 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617906bd-a7d3-4a40-a0f0-9c2c94ed9149 admin admin] PATH_INFO: `/v3/projects/b956a992838141b98e2f438d6a659b00/users/c5ac5fd1cb4c4e21bc8bc2f96906532f/roles/81634e7812344f84afcb29b0dba2687c` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:18.943984 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617906bd-a7d3-4a40-a0f0-9c2c94ed9149 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b956a992838141b98e2f438d6a659b00, user_id=c5ac5fd1cb4c4e21bc8bc2f96906532f, role_id=81634e7812344f84afcb29b0dba2687c)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:18.946731 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617906bd-a7d3-4a40-a0f0-9c2c94ed9149 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:18.960228 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1091/2214] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:19:18 2022] PUT /identity/v3/projects/b956a992838141b98e2f438d6a659b00/users/c5ac5fd1cb4c4e21bc8bc2f96906532f/roles/81634e7812344f84afcb29b0dba2687c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:19:18.970896 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ff4750-4202-4d0b-be0d-95b581f35900 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:18.971206 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ff4750-4202-4d0b-be0d-95b581f35900 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:18.971482 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ff4750-4202-4d0b-be0d-95b581f35900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:19.001388 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-78ff4750-4202-4d0b-be0d-95b581f35900 None None] MFA Rules not processed for user `c5ac5fd1cb4c4e21bc8bc2f96906532f`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:19:19.003474 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-78ff4750-4202-4d0b-be0d-95b581f35900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:19.077021 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1124/2215] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:19:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:19:19.087771 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617906bd-a7d3-4a40-a0f0-9c2c94ed9149 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:19.089665 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-617906bd-a7d3-4a40-a0f0-9c2c94ed9149 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:19.151884 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617906bd-a7d3-4a40-a0f0-9c2c94ed9149 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:19.155791 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1077f4b-650e-4727-880e-19937427bbd9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f86373d65440da97c853fff3c1d0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:19.156496 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1077f4b-650e-4727-880e-19937427bbd9 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:19.156774 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1077f4b-650e-4727-880e-19937427bbd9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:19.157043 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1077f4b-650e-4727-880e-19937427bbd9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:19.166094 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1077f4b-650e-4727-880e-19937427bbd9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:19.167547 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1077f4b-650e-4727-880e-19937427bbd9 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:19.176679 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1092/2216] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:19:19 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:19:21.447977 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ff4750-4202-4d0b-be0d-95b581f35900 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:21.449940 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-78ff4750-4202-4d0b-be0d-95b581f35900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:21.527260 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ff4750-4202-4d0b-be0d-95b581f35900 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:21.532083 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8eb62c-4179-4a04-81fb-bc472d89bd5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:21.533009 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8eb62c-4179-4a04-81fb-bc472d89bd5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:21.533290 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8eb62c-4179-4a04-81fb-bc472d89bd5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:21.533563 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8eb62c-4179-4a04-81fb-bc472d89bd5c admin admin] PATH_INFO: `/v3/users/2b1324ce08b7464189020e582e1c6f2c` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:21.534769 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8eb62c-4179-4a04-81fb-bc472d89bd5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b1324ce08b7464189020e582e1c6f2c)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:21.536801 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8eb62c-4179-4a04-81fb-bc472d89bd5c admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:21.541888 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:21.588074 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-6f8eb62c-4179-4a04-81fb-bc472d89bd5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b1324ce08b7464189020e582e1c6f2c'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:21.596214 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-6f8eb62c-4179-4a04-81fb-bc472d89bd5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b1324ce08b7464189020e582e1c6f2c'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:21.596890 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-6f8eb62c-4179-4a04-81fb-bc472d89bd5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b1324ce08b7464189020e582e1c6f2c'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:21.597641 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-6f8eb62c-4179-4a04-81fb-bc472d89bd5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b1324ce08b7464189020e582e1c6f2c'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:21.613333 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-6f8eb62c-4179-4a04-81fb-bc472d89bd5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b1324ce08b7464189020e582e1c6f2c'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:21.626887 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1125/2217] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:19:21 2022] DELETE /identity/v3/users/2b1324ce08b7464189020e582e1c6f2c => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:19:21.835900 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1077f4b-650e-4727-880e-19937427bbd9 service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:21.848068 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1077f4b-650e-4727-880e-19937427bbd9 service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:21.909733 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f35141c-9797-4568-ad0b-51ccfa3ad33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:21.910611 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f35141c-9797-4568-ad0b-51ccfa3ad33e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:21.910892 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f35141c-9797-4568-ad0b-51ccfa3ad33e admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:21.911168 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f35141c-9797-4568-ad0b-51ccfa3ad33e admin admin] PATH_INFO: `/v3/projects/bd6bbb1975e540d8959e79d42d5242e9` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:21.912372 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f35141c-9797-4568-ad0b-51ccfa3ad33e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd6bbb1975e540d8959e79d42d5242e9)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:21.914318 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f35141c-9797-4568-ad0b-51ccfa3ad33e admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:21.953625 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:21.965550 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7f35141c-9797-4568-ad0b-51ccfa3ad33e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd6bbb1975e540d8959e79d42d5242e9', 'request_id': 'req-7f35141c-9797-4568-ad0b-51ccfa3ad33e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:21.971211 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7f35141c-9797-4568-ad0b-51ccfa3ad33e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd6bbb1975e540d8959e79d42d5242e9', 'request_id': 'req-7f35141c-9797-4568-ad0b-51ccfa3ad33e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:21.980744 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7f35141c-9797-4568-ad0b-51ccfa3ad33e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd6bbb1975e540d8959e79d42d5242e9', 'request_id': 'req-7f35141c-9797-4568-ad0b-51ccfa3ad33e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:22.000839 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7f35141c-9797-4568-ad0b-51ccfa3ad33e admin admin] The token cache is being invalidate because project bd6bbb1975e540d8959e79d42d5242e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:19:22.000839 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7f35141c-9797-4568-ad0b-51ccfa3ad33e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:22.000839 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7f35141c-9797-4568-ad0b-51ccfa3ad33e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:22.000839 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1093/2218] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:19:21 2022] DELETE /identity/v3/projects/bd6bbb1975e540d8959e79d42d5242e9 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:19:22.001291 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8eb62c-4179-4a04-81fb-bc472d89bd5c admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:22.002297 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-6f8eb62c-4179-4a04-81fb-bc472d89bd5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:22.016930 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8eb62c-4179-4a04-81fb-bc472d89bd5c admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:22.074045 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5806219c-6c56-4c2e-acfd-e75f2cadea23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:22.074939 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5806219c-6c56-4c2e-acfd-e75f2cadea23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:22.075224 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5806219c-6c56-4c2e-acfd-e75f2cadea23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:22.075564 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5806219c-6c56-4c2e-acfd-e75f2cadea23 admin admin] PATH_INFO: `/v3/users/7b9b5a3e202e462099bc70ced249a367` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:22.077316 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5806219c-6c56-4c2e-acfd-e75f2cadea23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b9b5a3e202e462099bc70ced249a367)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:22.079277 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5806219c-6c56-4c2e-acfd-e75f2cadea23 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:22.128310 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-5806219c-6c56-4c2e-acfd-e75f2cadea23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b9b5a3e202e462099bc70ced249a367'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:22.136692 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-5806219c-6c56-4c2e-acfd-e75f2cadea23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b9b5a3e202e462099bc70ced249a367'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:22.137352 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-5806219c-6c56-4c2e-acfd-e75f2cadea23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b9b5a3e202e462099bc70ced249a367'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:22.137959 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-5806219c-6c56-4c2e-acfd-e75f2cadea23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b9b5a3e202e462099bc70ced249a367'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:22.150833 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-5806219c-6c56-4c2e-acfd-e75f2cadea23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b9b5a3e202e462099bc70ced249a367'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:22.164885 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1126/2219] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:19:21 2022] DELETE /identity/v3/users/7b9b5a3e202e462099bc70ced249a367 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:19:22.637290 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f35141c-9797-4568-ad0b-51ccfa3ad33e admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:22.639089 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-7f35141c-9797-4568-ad0b-51ccfa3ad33e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:22.657735 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f35141c-9797-4568-ad0b-51ccfa3ad33e admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:22.725114 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf80d08-4ba8-4062-a764-7ab059f76461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:22.726138 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf80d08-4ba8-4062-a764-7ab059f76461 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:22.726415 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf80d08-4ba8-4062-a764-7ab059f76461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:22.726722 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf80d08-4ba8-4062-a764-7ab059f76461 admin admin] PATH_INFO: `/v3/projects/49608c5d792b402cb19f8917446b6a4a` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:22.727943 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf80d08-4ba8-4062-a764-7ab059f76461 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49608c5d792b402cb19f8917446b6a4a)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:22.729909 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf80d08-4ba8-4062-a764-7ab059f76461 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:22.788831 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ccf80d08-4ba8-4062-a764-7ab059f76461 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49608c5d792b402cb19f8917446b6a4a', 'request_id': 'req-ccf80d08-4ba8-4062-a764-7ab059f76461'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:22.794158 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ccf80d08-4ba8-4062-a764-7ab059f76461 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49608c5d792b402cb19f8917446b6a4a', 'request_id': 'req-ccf80d08-4ba8-4062-a764-7ab059f76461'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:22.802665 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ccf80d08-4ba8-4062-a764-7ab059f76461 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49608c5d792b402cb19f8917446b6a4a', 'request_id': 'req-ccf80d08-4ba8-4062-a764-7ab059f76461'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:22.814167 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ccf80d08-4ba8-4062-a764-7ab059f76461 admin admin] The token cache is being invalidate because project 49608c5d792b402cb19f8917446b6a4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:19:22.814854 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ccf80d08-4ba8-4062-a764-7ab059f76461 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:22.815095 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ccf80d08-4ba8-4062-a764-7ab059f76461 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:22.816677 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1094/2220] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:19:22 2022] DELETE /identity/v3/projects/49608c5d792b402cb19f8917446b6a4a => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:19:22.821668 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3dbb09-ee63-4eb6-9e7e-98282734a69d None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:22.822114 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3dbb09-ee63-4eb6-9e7e-98282734a69d None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:22.822285 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3dbb09-ee63-4eb6-9e7e-98282734a69d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:22.829384 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:22.842736 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-af3dbb09-ee63-4eb6-9e7e-98282734a69d None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:19:22.844930 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-af3dbb09-ee63-4eb6-9e7e-98282734a69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:22.914953 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1127/2221] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:19:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:19:22.922981 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60876d0-5256-445a-ae35-6c13351c9dd1 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:22.923464 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60876d0-5256-445a-ae35-6c13351c9dd1 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:22.923696 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60876d0-5256-445a-ae35-6c13351c9dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:22.942152 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-c60876d0-5256-445a-ae35-6c13351c9dd1 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:19:22.943399 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c60876d0-5256-445a-ae35-6c13351c9dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:22.951954 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1095/2222] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:19:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:19:22.955940 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3dbb09-ee63-4eb6-9e7e-98282734a69d None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:22.966252 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3dbb09-ee63-4eb6-9e7e-98282734a69d None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:22.970996 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca17b2cd-fe97-40cb-8177-9372d721770b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:22.972843 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17b2cd-fe97-40cb-8177-9372d721770b admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:22.972843 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17b2cd-fe97-40cb-8177-9372d721770b admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:22.972843 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17b2cd-fe97-40cb-8177-9372d721770b admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:22.973597 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca17b2cd-fe97-40cb-8177-9372d721770b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:19:22.973770 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca17b2cd-fe97-40cb-8177-9372d721770b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:22.975565 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca17b2cd-fe97-40cb-8177-9372d721770b admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:22.989333 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1128/2223] 10.222.0.42 () {58 vars in 1152 bytes} [Mon Jul 4 09:19:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:19:22.994001 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60876d0-5256-445a-ae35-6c13351c9dd1 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:23.004084 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60876d0-5256-445a-ae35-6c13351c9dd1 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:23.009751 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e38e8e5-b431-46e6-8248-ef450fa34c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:23.009751 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e38e8e5-b431-46e6-8248-ef450fa34c7b admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:23.010012 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e38e8e5-b431-46e6-8248-ef450fa34c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:23.010103 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e38e8e5-b431-46e6-8248-ef450fa34c7b admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:23.010799 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e38e8e5-b431-46e6-8248-ef450fa34c7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:23.012772 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e38e8e5-b431-46e6-8248-ef450fa34c7b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:23.044098 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1096/2224] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:19:22 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:19:23.045386 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca17b2cd-fe97-40cb-8177-9372d721770b admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:23.055861 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca17b2cd-fe97-40cb-8177-9372d721770b admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:23.119326 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2560d55d-bed6-48ea-b61f-96d8d4733972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:23.120065 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2560d55d-bed6-48ea-b61f-96d8d4733972 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:23.120347 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2560d55d-bed6-48ea-b61f-96d8d4733972 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:23.120624 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2560d55d-bed6-48ea-b61f-96d8d4733972 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:23.121348 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2560d55d-bed6-48ea-b61f-96d8d4733972 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:23.123327 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2560d55d-bed6-48ea-b61f-96d8d4733972 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:23.148282 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1129/2225] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:19:23 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:19:23.149491 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e38e8e5-b431-46e6-8248-ef450fa34c7b admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:23.160875 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e38e8e5-b431-46e6-8248-ef450fa34c7b admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:23.165687 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a44548-2ac1-4858-a6aa-9d8b190d5002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:23.166363 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a44548-2ac1-4858-a6aa-9d8b190d5002 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:23.166649 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a44548-2ac1-4858-a6aa-9d8b190d5002 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:23.166923 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a44548-2ac1-4858-a6aa-9d8b190d5002 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:23.167645 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a44548-2ac1-4858-a6aa-9d8b190d5002 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:23.169497 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a44548-2ac1-4858-a6aa-9d8b190d5002 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:23.180445 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1097/2226] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:19:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:19:23.184556 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2560d55d-bed6-48ea-b61f-96d8d4733972 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:23.195427 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2560d55d-bed6-48ea-b61f-96d8d4733972 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:23.201161 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8c66cf-a7b3-42f5-b734-80e7601cf9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:23.202124 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c66cf-a7b3-42f5-b734-80e7601cf9f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:23.202467 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c66cf-a7b3-42f5-b734-80e7601cf9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:23.202753 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c66cf-a7b3-42f5-b734-80e7601cf9f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:23.203498 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8c66cf-a7b3-42f5-b734-80e7601cf9f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:23.205179 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8c66cf-a7b3-42f5-b734-80e7601cf9f4 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:23.215820 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1130/2227] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:19:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:19:23.220163 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a44548-2ac1-4858-a6aa-9d8b190d5002 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:23.230608 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a44548-2ac1-4858-a6aa-9d8b190d5002 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:23.235332 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1fd6cb-8be6-47a4-bb5e-31382ad2d581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:23.236258 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1fd6cb-8be6-47a4-bb5e-31382ad2d581 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:23.236543 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1fd6cb-8be6-47a4-bb5e-31382ad2d581 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:23.236811 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1fd6cb-8be6-47a4-bb5e-31382ad2d581 admin admin] PATH_INFO: `/v3/projects/1956d7f3735b4d6691b8fa7e10aca731/users/49cb8004acc949fd8a6c2a31a3bce9c8/roles/81634e7812344f84afcb29b0dba2687c` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:23.248527 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:23.253578 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1fd6cb-8be6-47a4-bb5e-31382ad2d581 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1956d7f3735b4d6691b8fa7e10aca731, user_id=49cb8004acc949fd8a6c2a31a3bce9c8, role_id=81634e7812344f84afcb29b0dba2687c)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:23.256679 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1fd6cb-8be6-47a4-bb5e-31382ad2d581 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:23.270583 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1098/2228] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:19:23 2022] PUT /identity/v3/projects/1956d7f3735b4d6691b8fa7e10aca731/users/49cb8004acc949fd8a6c2a31a3bce9c8/roles/81634e7812344f84afcb29b0dba2687c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:19:23.281213 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce6790-524d-4d05-b094-d9af06eeedb6 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:23.281508 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce6790-524d-4d05-b094-d9af06eeedb6 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:23.281789 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce6790-524d-4d05-b094-d9af06eeedb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:23.307793 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-04ce6790-524d-4d05-b094-d9af06eeedb6 None None] MFA Rules not processed for user `49cb8004acc949fd8a6c2a31a3bce9c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:19:23.309085 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-04ce6790-524d-4d05-b094-d9af06eeedb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:23.379807 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:23.386589 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1131/2229] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:19:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:19:23.397714 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1fd6cb-8be6-47a4-bb5e-31382ad2d581 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:23.399531 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ba1fd6cb-8be6-47a4-bb5e-31382ad2d581 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:23.456850 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1fd6cb-8be6-47a4-bb5e-31382ad2d581 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:23.460573 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd00d207-a7bf-4df0-a0c6-362ccea265f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f86373d65440da97c853fff3c1d0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:23.461498 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd00d207-a7bf-4df0-a0c6-362ccea265f8 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:23.461787 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd00d207-a7bf-4df0-a0c6-362ccea265f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:23.462063 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd00d207-a7bf-4df0-a0c6-362ccea265f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:23.470792 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd00d207-a7bf-4df0-a0c6-362ccea265f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:23.472319 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd00d207-a7bf-4df0-a0c6-362ccea265f8 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:23.482153 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1099/2230] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:19:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:19:23.502892 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ce6790-524d-4d05-b094-d9af06eeedb6 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:23.571654 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ce6790-524d-4d05-b094-d9af06eeedb6 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:23.576851 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b3932b-e2c7-4aa3-9b5b-d39b81b056db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:23.580833 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b3932b-e2c7-4aa3-9b5b-d39b81b056db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:23.581119 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b3932b-e2c7-4aa3-9b5b-d39b81b056db admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:23.581402 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b3932b-e2c7-4aa3-9b5b-d39b81b056db admin admin] PATH_INFO: `/v3/users/49cb8004acc949fd8a6c2a31a3bce9c8` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:23.582739 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b3932b-e2c7-4aa3-9b5b-d39b81b056db admin admin] RBAC: Authorizing `identity:delete_user(user_id=49cb8004acc949fd8a6c2a31a3bce9c8)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:23.584726 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b3932b-e2c7-4aa3-9b5b-d39b81b056db admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:23.639630 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-20b3932b-e2c7-4aa3-9b5b-d39b81b056db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49cb8004acc949fd8a6c2a31a3bce9c8'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:23.651070 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-20b3932b-e2c7-4aa3-9b5b-d39b81b056db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49cb8004acc949fd8a6c2a31a3bce9c8'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:23.651973 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-20b3932b-e2c7-4aa3-9b5b-d39b81b056db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49cb8004acc949fd8a6c2a31a3bce9c8'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:23.652908 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-20b3932b-e2c7-4aa3-9b5b-d39b81b056db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49cb8004acc949fd8a6c2a31a3bce9c8'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:23.666929 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-20b3932b-e2c7-4aa3-9b5b-d39b81b056db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49cb8004acc949fd8a6c2a31a3bce9c8'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:23.681284 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1132/2231] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:19:23 2022] DELETE /identity/v3/users/49cb8004acc949fd8a6c2a31a3bce9c8 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:19:23.685657 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4efd0c9-d9af-45b9-88fc-764ffde90632 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:23.685952 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4efd0c9-d9af-45b9-88fc-764ffde90632 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:23.686254 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4efd0c9-d9af-45b9-88fc-764ffde90632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:23.708117 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-d4efd0c9-d9af-45b9-88fc-764ffde90632 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:19:23.709340 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d4efd0c9-d9af-45b9-88fc-764ffde90632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:23.776767 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1100/2232] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:19:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:19:23.786946 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b3932b-e2c7-4aa3-9b5b-d39b81b056db admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:23.788402 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-20b3932b-e2c7-4aa3-9b5b-d39b81b056db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:23.852948 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b3932b-e2c7-4aa3-9b5b-d39b81b056db admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:23.857457 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9142f99a-0758-4657-bb98-322354e04143 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:23.858128 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142f99a-0758-4657-bb98-322354e04143 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:23.858404 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142f99a-0758-4657-bb98-322354e04143 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:23.858684 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142f99a-0758-4657-bb98-322354e04143 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:23.869908 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9142f99a-0758-4657-bb98-322354e04143 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:23.871487 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9142f99a-0758-4657-bb98-322354e04143 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:23.881904 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1133/2233] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:19:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:19:24.157606 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4efd0c9-d9af-45b9-88fc-764ffde90632 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:24.159154 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d4efd0c9-d9af-45b9-88fc-764ffde90632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:24.190708 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4efd0c9-d9af-45b9-88fc-764ffde90632 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:24.195997 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf3d06-2b98-45a9-9f7b-326703d2f62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:24.196952 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf3d06-2b98-45a9-9f7b-326703d2f62e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:24.197308 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf3d06-2b98-45a9-9f7b-326703d2f62e admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:24.197652 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf3d06-2b98-45a9-9f7b-326703d2f62e admin admin] PATH_INFO: `/v3/projects/1956d7f3735b4d6691b8fa7e10aca731` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:24.198999 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaf3d06-2b98-45a9-9f7b-326703d2f62e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1956d7f3735b4d6691b8fa7e10aca731)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:24.201220 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaf3d06-2b98-45a9-9f7b-326703d2f62e admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:24.257691 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-bbaf3d06-2b98-45a9-9f7b-326703d2f62e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1956d7f3735b4d6691b8fa7e10aca731', 'request_id': 'req-bbaf3d06-2b98-45a9-9f7b-326703d2f62e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:24.264436 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-bbaf3d06-2b98-45a9-9f7b-326703d2f62e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1956d7f3735b4d6691b8fa7e10aca731', 'request_id': 'req-bbaf3d06-2b98-45a9-9f7b-326703d2f62e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:24.272844 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-bbaf3d06-2b98-45a9-9f7b-326703d2f62e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1956d7f3735b4d6691b8fa7e10aca731', 'request_id': 'req-bbaf3d06-2b98-45a9-9f7b-326703d2f62e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:24.287968 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-bbaf3d06-2b98-45a9-9f7b-326703d2f62e admin admin] The token cache is being invalidate because project 1956d7f3735b4d6691b8fa7e10aca731 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:19:24.287968 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-bbaf3d06-2b98-45a9-9f7b-326703d2f62e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:24.288742 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-bbaf3d06-2b98-45a9-9f7b-326703d2f62e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:24.291947 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1101/2234] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:19:24 2022] DELETE /identity/v3/projects/1956d7f3735b4d6691b8fa7e10aca731 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:19:24.296075 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd1978b-ba88-4ae6-a8af-d5f9eadcac93 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:24.296075 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd1978b-ba88-4ae6-a8af-d5f9eadcac93 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:24.296242 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd1978b-ba88-4ae6-a8af-d5f9eadcac93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:24.315469 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-bfd1978b-ba88-4ae6-a8af-d5f9eadcac93 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:19:24.316825 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-bfd1978b-ba88-4ae6-a8af-d5f9eadcac93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:24.331005 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:24.392259 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1134/2235] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:19:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:19:24.396792 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735125aa-f7b8-493c-afc0-fb23c3747a9b None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:24.397150 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735125aa-f7b8-493c-afc0-fb23c3747a9b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:24.397499 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735125aa-f7b8-493c-afc0-fb23c3747a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:24.416683 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-735125aa-f7b8-493c-afc0-fb23c3747a9b None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:19:24.417992 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-735125aa-f7b8-493c-afc0-fb23c3747a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:24.426292 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1102/2236] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:19:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:19:24.433181 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd1978b-ba88-4ae6-a8af-d5f9eadcac93 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:24.445653 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd1978b-ba88-4ae6-a8af-d5f9eadcac93 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:24.450671 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed13800-bbc6-4b6c-a6a6-cc3fefeab9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:24.451368 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed13800-bbc6-4b6c-a6a6-cc3fefeab9ec admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:24.451656 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed13800-bbc6-4b6c-a6a6-cc3fefeab9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:24.452118 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed13800-bbc6-4b6c-a6a6-cc3fefeab9ec admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:24.452890 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed13800-bbc6-4b6c-a6a6-cc3fefeab9ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:19:24.453257 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed13800-bbc6-4b6c-a6a6-cc3fefeab9ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:24.454958 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed13800-bbc6-4b6c-a6a6-cc3fefeab9ec admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:24.467962 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1135/2237] 10.222.0.42 () {58 vars in 1152 bytes} [Mon Jul 4 09:19:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:19:24.472253 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735125aa-f7b8-493c-afc0-fb23c3747a9b None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:24.482359 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735125aa-f7b8-493c-afc0-fb23c3747a9b None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:24.487074 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf77dcc9-5f59-4eff-b88f-80c88626ed38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:24.487736 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf77dcc9-5f59-4eff-b88f-80c88626ed38 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:24.488096 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf77dcc9-5f59-4eff-b88f-80c88626ed38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:24.488373 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf77dcc9-5f59-4eff-b88f-80c88626ed38 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:24.489050 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf77dcc9-5f59-4eff-b88f-80c88626ed38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:24.490997 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf77dcc9-5f59-4eff-b88f-80c88626ed38 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:24.495806 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:24.527916 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1103/2238] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:19:24 2022] POST /identity/v3/projects => generated 381 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:19:24.530280 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed13800-bbc6-4b6c-a6a6-cc3fefeab9ec admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:24.541126 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed13800-bbc6-4b6c-a6a6-cc3fefeab9ec admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:24.605734 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6db3395-ef52-471e-bbb1-ed73272fc8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:24.606425 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db3395-ef52-471e-bbb1-ed73272fc8c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:24.606744 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db3395-ef52-471e-bbb1-ed73272fc8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:24.607121 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db3395-ef52-471e-bbb1-ed73272fc8c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:24.607855 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6db3395-ef52-471e-bbb1-ed73272fc8c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:24.609837 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6db3395-ef52-471e-bbb1-ed73272fc8c3 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:24.632855 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1136/2239] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:19:24 2022] POST /identity/v3/users => generated 291 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:19:24.636659 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf77dcc9-5f59-4eff-b88f-80c88626ed38 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:24.648010 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf77dcc9-5f59-4eff-b88f-80c88626ed38 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:24.653064 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e53024a-7b2f-457f-bc88-d0c9237c1cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:24.653801 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e53024a-7b2f-457f-bc88-d0c9237c1cd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:24.654073 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e53024a-7b2f-457f-bc88-d0c9237c1cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:24.654346 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e53024a-7b2f-457f-bc88-d0c9237c1cd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:24.655098 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e53024a-7b2f-457f-bc88-d0c9237c1cd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:24.656837 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e53024a-7b2f-457f-bc88-d0c9237c1cd3 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:24.670783 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1104/2240] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:19:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:19:24.672085 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6db3395-ef52-471e-bbb1-ed73272fc8c3 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:24.683239 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6db3395-ef52-471e-bbb1-ed73272fc8c3 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:24.687900 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18385bca-8694-42c4-9fc2-20f1414d42f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:24.688614 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18385bca-8694-42c4-9fc2-20f1414d42f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:24.688899 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18385bca-8694-42c4-9fc2-20f1414d42f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:24.689177 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18385bca-8694-42c4-9fc2-20f1414d42f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:24.690348 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18385bca-8694-42c4-9fc2-20f1414d42f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:24.691616 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18385bca-8694-42c4-9fc2-20f1414d42f0 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:24.708511 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1137/2241] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:19:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:19:24.710881 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e53024a-7b2f-457f-bc88-d0c9237c1cd3 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:24.721928 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e53024a-7b2f-457f-bc88-d0c9237c1cd3 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:24.727793 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2382527d-a39d-49f7-bd3c-d284597a27cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:24.728709 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2382527d-a39d-49f7-bd3c-d284597a27cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:24.728993 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2382527d-a39d-49f7-bd3c-d284597a27cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:24.729268 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2382527d-a39d-49f7-bd3c-d284597a27cd admin admin] PATH_INFO: `/v3/projects/2c4039e594ba44618fbd660f70db8443/users/28a4b0ef24334b7a893d5b5fbee98d38/roles/81634e7812344f84afcb29b0dba2687c` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:24.745213 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2382527d-a39d-49f7-bd3c-d284597a27cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c4039e594ba44618fbd660f70db8443, user_id=28a4b0ef24334b7a893d5b5fbee98d38, role_id=81634e7812344f84afcb29b0dba2687c)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:24.748722 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2382527d-a39d-49f7-bd3c-d284597a27cd admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:24.768062 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1105/2242] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:19:24 2022] PUT /identity/v3/projects/2c4039e594ba44618fbd660f70db8443/users/28a4b0ef24334b7a893d5b5fbee98d38/roles/81634e7812344f84afcb29b0dba2687c => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:19:24.789248 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ebfb25-bae0-45dc-a11c-cca2a19d2e52 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:24.789546 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ebfb25-bae0-45dc-a11c-cca2a19d2e52 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:24.789895 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ebfb25-bae0-45dc-a11c-cca2a19d2e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:24.828199 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-39ebfb25-bae0-45dc-a11c-cca2a19d2e52 None None] MFA Rules not processed for user `28a4b0ef24334b7a893d5b5fbee98d38`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:19:24.828199 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-39ebfb25-bae0-45dc-a11c-cca2a19d2e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:24.902897 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1138/2243] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:19:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:19:24.913571 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2382527d-a39d-49f7-bd3c-d284597a27cd admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:24.915835 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-2382527d-a39d-49f7-bd3c-d284597a27cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:24.973766 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2382527d-a39d-49f7-bd3c-d284597a27cd admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:24.977373 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb1e42e-2c9b-4162-9d2c-13902cd6c784 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f86373d65440da97c853fff3c1d0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:24.978045 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb1e42e-2c9b-4162-9d2c-13902cd6c784 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:24.978324 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb1e42e-2c9b-4162-9d2c-13902cd6c784 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:24.978623 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb1e42e-2c9b-4162-9d2c-13902cd6c784 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:24.987152 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb1e42e-2c9b-4162-9d2c-13902cd6c784 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:24.988670 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb1e42e-2c9b-4162-9d2c-13902cd6c784 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:24.997632 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1106/2244] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:19:24 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:19:27.787439 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa27df1-41b2-4bb0-9a10-5c6f3561e308 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:27.787952 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa27df1-41b2-4bb0-9a10-5c6f3561e308 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:27.788158 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa27df1-41b2-4bb0-9a10-5c6f3561e308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:27.806969 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-baa27df1-41b2-4bb0-9a10-5c6f3561e308 None None] MFA Rules not processed for user `0375760c788b4bd0992302f291a2dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:19:27.808337 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-baa27df1-41b2-4bb0-9a10-5c6f3561e308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:27.818007 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:27.865921 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1139/2245] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:19:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:19:29.273308 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb1e42e-2c9b-4162-9d2c-13902cd6c784 service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:29.274829 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-beb1e42e-2c9b-4162-9d2c-13902cd6c784 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:29.402605 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb1e42e-2c9b-4162-9d2c-13902cd6c784 service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:29.408774 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0688df-0025-4ef7-9e9a-43b694c7f69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:29.409686 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0688df-0025-4ef7-9e9a-43b694c7f69a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:29.409977 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0688df-0025-4ef7-9e9a-43b694c7f69a admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:29.410253 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0688df-0025-4ef7-9e9a-43b694c7f69a admin admin] PATH_INFO: `/v3/users/c5ac5fd1cb4c4e21bc8bc2f96906532f` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:29.411741 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0688df-0025-4ef7-9e9a-43b694c7f69a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5ac5fd1cb4c4e21bc8bc2f96906532f)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:29.414154 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0688df-0025-4ef7-9e9a-43b694c7f69a admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:29.480034 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3e0688df-0025-4ef7-9e9a-43b694c7f69a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5ac5fd1cb4c4e21bc8bc2f96906532f'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:29.480695 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3e0688df-0025-4ef7-9e9a-43b694c7f69a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5ac5fd1cb4c4e21bc8bc2f96906532f'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:29.488569 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3e0688df-0025-4ef7-9e9a-43b694c7f69a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5ac5fd1cb4c4e21bc8bc2f96906532f'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:29.489506 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3e0688df-0025-4ef7-9e9a-43b694c7f69a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5ac5fd1cb4c4e21bc8bc2f96906532f'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:29.491524 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:29.503831 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3e0688df-0025-4ef7-9e9a-43b694c7f69a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5ac5fd1cb4c4e21bc8bc2f96906532f'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:29.515941 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1107/2246] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:19:29 2022] DELETE /identity/v3/users/c5ac5fd1cb4c4e21bc8bc2f96906532f => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:19:29.522677 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284615b6-604b-4911-a726-97bbd11c6d81 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:29.523217 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284615b6-604b-4911-a726-97bbd11c6d81 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:29.523313 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284615b6-604b-4911-a726-97bbd11c6d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:29.544671 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-284615b6-604b-4911-a726-97bbd11c6d81 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:19:29.545894 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-284615b6-604b-4911-a726-97bbd11c6d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:29.629937 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1140/2247] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:19:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:19:29.647860 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0688df-0025-4ef7-9e9a-43b694c7f69a admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:29.649388 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3e0688df-0025-4ef7-9e9a-43b694c7f69a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:29.748633 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0688df-0025-4ef7-9e9a-43b694c7f69a admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:29.754467 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f224563-0df0-452e-b1b9-e8aa6eaa4421 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:29.755465 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f224563-0df0-452e-b1b9-e8aa6eaa4421 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:29.755961 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f224563-0df0-452e-b1b9-e8aa6eaa4421 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:29.756294 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f224563-0df0-452e-b1b9-e8aa6eaa4421 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:29.769944 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f224563-0df0-452e-b1b9-e8aa6eaa4421 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:29.771625 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f224563-0df0-452e-b1b9-e8aa6eaa4421 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:29.783390 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1108/2248] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:19:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:19:30.218053 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284615b6-604b-4911-a726-97bbd11c6d81 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:30.219792 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-284615b6-604b-4911-a726-97bbd11c6d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:30.234306 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284615b6-604b-4911-a726-97bbd11c6d81 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:30.240135 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d26b00-b893-4a8e-88b1-9145cd41a615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:30.240855 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d26b00-b893-4a8e-88b1-9145cd41a615 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:30.241219 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d26b00-b893-4a8e-88b1-9145cd41a615 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:30.241650 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d26b00-b893-4a8e-88b1-9145cd41a615 admin admin] PATH_INFO: `/v3/projects/b956a992838141b98e2f438d6a659b00` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:30.243147 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d26b00-b893-4a8e-88b1-9145cd41a615 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b956a992838141b98e2f438d6a659b00)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:30.245527 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d26b00-b893-4a8e-88b1-9145cd41a615 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:30.297380 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-e0d26b00-b893-4a8e-88b1-9145cd41a615 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b956a992838141b98e2f438d6a659b00', 'request_id': 'req-e0d26b00-b893-4a8e-88b1-9145cd41a615'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:30.305750 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-e0d26b00-b893-4a8e-88b1-9145cd41a615 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b956a992838141b98e2f438d6a659b00', 'request_id': 'req-e0d26b00-b893-4a8e-88b1-9145cd41a615'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:30.312336 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-e0d26b00-b893-4a8e-88b1-9145cd41a615 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b956a992838141b98e2f438d6a659b00', 'request_id': 'req-e0d26b00-b893-4a8e-88b1-9145cd41a615'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:30.325606 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-e0d26b00-b893-4a8e-88b1-9145cd41a615 admin admin] The token cache is being invalidate because project b956a992838141b98e2f438d6a659b00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:19:30.325606 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-e0d26b00-b893-4a8e-88b1-9145cd41a615 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:30.326395 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-e0d26b00-b893-4a8e-88b1-9145cd41a615 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:30.328610 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1141/2249] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:19:30 2022] DELETE /identity/v3/projects/b956a992838141b98e2f438d6a659b00 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:19:30.333354 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b1989-7ed6-4390-b1f3-acaf284537c8 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:30.333815 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b1989-7ed6-4390-b1f3-acaf284537c8 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:30.333928 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b1989-7ed6-4390-b1f3-acaf284537c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:30.355077 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-401b1989-7ed6-4390-b1f3-acaf284537c8 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:19:30.356480 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-401b1989-7ed6-4390-b1f3-acaf284537c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:30.442267 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1109/2250] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:19:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:19:30.444511 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269414e-10f0-4ccc-a1d3-2365548248e7 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:30.444813 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269414e-10f0-4ccc-a1d3-2365548248e7 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:30.445107 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269414e-10f0-4ccc-a1d3-2365548248e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:30.469744 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-2269414e-10f0-4ccc-a1d3-2365548248e7 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:19:30.471233 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-2269414e-10f0-4ccc-a1d3-2365548248e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:30.480404 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1142/2251] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:19:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:19:30.485359 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401b1989-7ed6-4390-b1f3-acaf284537c8 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:30.497661 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401b1989-7ed6-4390-b1f3-acaf284537c8 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:30.521490 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f6f6c4-ab14-482b-8305-7796eceef9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:30.522282 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f6f6c4-ab14-482b-8305-7796eceef9d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:30.522635 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f6f6c4-ab14-482b-8305-7796eceef9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:30.522983 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f6f6c4-ab14-482b-8305-7796eceef9d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:30.523818 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f6f6c4-ab14-482b-8305-7796eceef9d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:19:30.524648 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f6f6c4-ab14-482b-8305-7796eceef9d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:30.527691 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f6f6c4-ab14-482b-8305-7796eceef9d5 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:30.534149 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2269414e-10f0-4ccc-a1d3-2365548248e7 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:30.538479 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-2269414e-10f0-4ccc-a1d3-2365548248e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:30.550643 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1110/2252] 10.222.0.42 () {58 vars in 1152 bytes} [Mon Jul 4 09:19:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:19:30.556555 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f6f6c4-ab14-482b-8305-7796eceef9d5 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:30.569981 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f6f6c4-ab14-482b-8305-7796eceef9d5 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:30.576913 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81589fa-4634-441a-814d-96602d75242b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:30.577727 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81589fa-4634-441a-814d-96602d75242b admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:30.577727 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81589fa-4634-441a-814d-96602d75242b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:30.578089 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81589fa-4634-441a-814d-96602d75242b admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:30.578976 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81589fa-4634-441a-814d-96602d75242b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:30.580113 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2269414e-10f0-4ccc-a1d3-2365548248e7 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:30.581155 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81589fa-4634-441a-814d-96602d75242b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:30.586945 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eae1b7-c537-42af-a896-761bedc787e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:30.589330 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eae1b7-c537-42af-a896-761bedc787e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:30.589936 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eae1b7-c537-42af-a896-761bedc787e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:30.590471 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eae1b7-c537-42af-a896-761bedc787e5 admin admin] PATH_INFO: `/v3/users/28a4b0ef24334b7a893d5b5fbee98d38` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:30.592264 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eae1b7-c537-42af-a896-761bedc787e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28a4b0ef24334b7a893d5b5fbee98d38)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:30.597472 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eae1b7-c537-42af-a896-761bedc787e5 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:30.614122 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1111/2253] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:19:30 2022] POST /identity/v3/projects => generated 391 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:19:30.615946 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81589fa-4634-441a-814d-96602d75242b admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:30.642264 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:30.658571 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-59eae1b7-c537-42af-a896-761bedc787e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28a4b0ef24334b7a893d5b5fbee98d38'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:30.668072 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-59eae1b7-c537-42af-a896-761bedc787e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28a4b0ef24334b7a893d5b5fbee98d38'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:30.668802 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-59eae1b7-c537-42af-a896-761bedc787e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28a4b0ef24334b7a893d5b5fbee98d38'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:30.669483 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:30.669665 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-59eae1b7-c537-42af-a896-761bedc787e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28a4b0ef24334b7a893d5b5fbee98d38'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:30.682690 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-59eae1b7-c537-42af-a896-761bedc787e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28a4b0ef24334b7a893d5b5fbee98d38'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:30.692200 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81589fa-4634-441a-814d-96602d75242b admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:30.698159 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6745fd76-8169-48f8-a2be-7875d1cd032d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:30.698837 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6745fd76-8169-48f8-a2be-7875d1cd032d admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:30.699241 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6745fd76-8169-48f8-a2be-7875d1cd032d admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:30.699576 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6745fd76-8169-48f8-a2be-7875d1cd032d admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:30.700397 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1143/2254] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:19:30 2022] DELETE /identity/v3/users/28a4b0ef24334b7a893d5b5fbee98d38 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:19:30.700519 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6745fd76-8169-48f8-a2be-7875d1cd032d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:30.702563 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6745fd76-8169-48f8-a2be-7875d1cd032d admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:30.705068 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f660ee2-a2f5-41a4-91c8-ce07bcde8375 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:30.705405 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f660ee2-a2f5-41a4-91c8-ce07bcde8375 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:30.705674 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f660ee2-a2f5-41a4-91c8-ce07bcde8375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:30.727204 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-5f660ee2-a2f5-41a4-91c8-ce07bcde8375 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:19:30.728495 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-5f660ee2-a2f5-41a4-91c8-ce07bcde8375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:30.733586 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1112/2255] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:19:30 2022] POST /identity/v3/users => generated 296 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:19:30.735288 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6745fd76-8169-48f8-a2be-7875d1cd032d admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:30.737120 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6745fd76-8169-48f8-a2be-7875d1cd032d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:30.750447 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6745fd76-8169-48f8-a2be-7875d1cd032d admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:30.795849 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1144/2256] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:19:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:19:30.806423 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f660ee2-a2f5-41a4-91c8-ce07bcde8375 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:30.807806 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-5f660ee2-a2f5-41a4-91c8-ce07bcde8375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:30.817760 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd87778c-5055-4e58-a9cd-8de5cd04706b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:30.818460 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd87778c-5055-4e58-a9cd-8de5cd04706b admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:30.818977 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd87778c-5055-4e58-a9cd-8de5cd04706b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:30.818977 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd87778c-5055-4e58-a9cd-8de5cd04706b admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:30.819732 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd87778c-5055-4e58-a9cd-8de5cd04706b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:30.821489 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd87778c-5055-4e58-a9cd-8de5cd04706b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:30.832272 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1113/2257] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:19:30 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:19:30.836224 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd87778c-5055-4e58-a9cd-8de5cd04706b admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:30.846694 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd87778c-5055-4e58-a9cd-8de5cd04706b admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:30.852229 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e41827-4019-4b3e-8613-7d3ea4e10ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:30.852409 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e41827-4019-4b3e-8613-7d3ea4e10ab9 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:30.852672 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e41827-4019-4b3e-8613-7d3ea4e10ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:30.852946 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e41827-4019-4b3e-8613-7d3ea4e10ab9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:30.853714 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e41827-4019-4b3e-8613-7d3ea4e10ab9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:30.855358 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e41827-4019-4b3e-8613-7d3ea4e10ab9 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:30.870864 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1114/2258] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:19:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:19:30.872246 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e41827-4019-4b3e-8613-7d3ea4e10ab9 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:30.874811 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f660ee2-a2f5-41a4-91c8-ce07bcde8375 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:30.882274 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e41827-4019-4b3e-8613-7d3ea4e10ab9 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:30.886416 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ba4f4-9185-409c-99d7-69f3cc47be45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:30.887200 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ba4f4-9185-409c-99d7-69f3cc47be45 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:30.891903 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ba4f4-9185-409c-99d7-69f3cc47be45 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:30.891903 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ba4f4-9185-409c-99d7-69f3cc47be45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:30.892098 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39290ff8-b2b0-4a43-ac67-a3454246cdd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:30.892098 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39290ff8-b2b0-4a43-ac67-a3454246cdd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:30.892098 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39290ff8-b2b0-4a43-ac67-a3454246cdd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:30.892098 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39290ff8-b2b0-4a43-ac67-a3454246cdd4 admin admin] PATH_INFO: `/v3/projects/b55ccbf3c49249c2adf9c814573bb017/users/e224864ab78b4f33a80e1d63cf1c7067/roles/81634e7812344f84afcb29b0dba2687c` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:30.898551 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405ba4f4-9185-409c-99d7-69f3cc47be45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:30.900124 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405ba4f4-9185-409c-99d7-69f3cc47be45 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:30.905415 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39290ff8-b2b0-4a43-ac67-a3454246cdd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b55ccbf3c49249c2adf9c814573bb017, user_id=e224864ab78b4f33a80e1d63cf1c7067, role_id=81634e7812344f84afcb29b0dba2687c)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:30.908279 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39290ff8-b2b0-4a43-ac67-a3454246cdd4 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:30.910342 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1145/2259] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:19:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 09:19:30.924888 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1115/2260] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:19:30 2022] PUT /identity/v3/projects/b55ccbf3c49249c2adf9c814573bb017/users/e224864ab78b4f33a80e1d63cf1c7067/roles/81634e7812344f84afcb29b0dba2687c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:19:30.936278 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b3ad42-d9f0-4a0b-a688-37fb8db826e5 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:30.936787 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b3ad42-d9f0-4a0b-a688-37fb8db826e5 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:30.937283 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b3ad42-d9f0-4a0b-a688-37fb8db826e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:30.966564 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-43b3ad42-d9f0-4a0b-a688-37fb8db826e5 None None] MFA Rules not processed for user `e224864ab78b4f33a80e1d63cf1c7067`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:19:30.967963 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-43b3ad42-d9f0-4a0b-a688-37fb8db826e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:31.017895 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:31.042442 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1146/2261] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:19:30 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:19:31.061030 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39290ff8-b2b0-4a43-ac67-a3454246cdd4 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:31.062827 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-39290ff8-b2b0-4a43-ac67-a3454246cdd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:31.126103 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39290ff8-b2b0-4a43-ac67-a3454246cdd4 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:31.130775 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec326c83-f5b9-4cdf-9614-99c2bb1aa457 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f86373d65440da97c853fff3c1d0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:31.131440 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec326c83-f5b9-4cdf-9614-99c2bb1aa457 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:31.131725 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec326c83-f5b9-4cdf-9614-99c2bb1aa457 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:31.132043 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec326c83-f5b9-4cdf-9614-99c2bb1aa457 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:31.141505 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec326c83-f5b9-4cdf-9614-99c2bb1aa457 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:31.142999 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec326c83-f5b9-4cdf-9614-99c2bb1aa457 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:31.153642 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1116/2262] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:19:31 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:19:31.236383 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b3ad42-d9f0-4a0b-a688-37fb8db826e5 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:31.238482 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-43b3ad42-d9f0-4a0b-a688-37fb8db826e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:31.355053 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b3ad42-d9f0-4a0b-a688-37fb8db826e5 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:31.361404 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eaa32e-9343-4716-85f2-f354ce6d534e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:31.362523 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eaa32e-9343-4716-85f2-f354ce6d534e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:31.362878 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eaa32e-9343-4716-85f2-f354ce6d534e admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:31.363256 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eaa32e-9343-4716-85f2-f354ce6d534e admin admin] PATH_INFO: `/v3/projects/2c4039e594ba44618fbd660f70db8443` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:31.365036 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eaa32e-9343-4716-85f2-f354ce6d534e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c4039e594ba44618fbd660f70db8443)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:31.367131 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eaa32e-9343-4716-85f2-f354ce6d534e admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:31.442504 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-28eaa32e-9343-4716-85f2-f354ce6d534e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c4039e594ba44618fbd660f70db8443', 'request_id': 'req-28eaa32e-9343-4716-85f2-f354ce6d534e'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:31.474362 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-28eaa32e-9343-4716-85f2-f354ce6d534e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c4039e594ba44618fbd660f70db8443', 'request_id': 'req-28eaa32e-9343-4716-85f2-f354ce6d534e'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:31.494653 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-28eaa32e-9343-4716-85f2-f354ce6d534e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c4039e594ba44618fbd660f70db8443', 'request_id': 'req-28eaa32e-9343-4716-85f2-f354ce6d534e'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:31.510402 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-28eaa32e-9343-4716-85f2-f354ce6d534e admin admin] The token cache is being invalidate because project 2c4039e594ba44618fbd660f70db8443 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:19:31.511202 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-28eaa32e-9343-4716-85f2-f354ce6d534e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:31.512116 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-28eaa32e-9343-4716-85f2-f354ce6d534e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:31.517694 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1147/2263] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:19:31 2022] DELETE /identity/v3/projects/2c4039e594ba44618fbd660f70db8443 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:19:31.520030 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f002f-94a4-4185-afcd-bce455b535f3 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:31.520030 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f002f-94a4-4185-afcd-bce455b535f3 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:31.520452 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f002f-94a4-4185-afcd-bce455b535f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:31.542766 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-b35f002f-94a4-4185-afcd-bce455b535f3 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:19:31.544361 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b35f002f-94a4-4185-afcd-bce455b535f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:31.581576 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:31.622788 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1117/2264] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:19:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:19:31.631799 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f329e-000e-47e0-8be8-52a486dad939 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:31.632359 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f329e-000e-47e0-8be8-52a486dad939 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:31.632582 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f329e-000e-47e0-8be8-52a486dad939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:31.657716 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-5c6f329e-000e-47e0-8be8-52a486dad939 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:19:31.659038 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-5c6f329e-000e-47e0-8be8-52a486dad939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:31.670422 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1148/2265] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:19:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:19:31.674655 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35f002f-94a4-4185-afcd-bce455b535f3 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:31.684729 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35f002f-94a4-4185-afcd-bce455b535f3 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:31.692289 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bdbb92-ad61-4450-97fa-f242955eea5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:31.692959 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bdbb92-ad61-4450-97fa-f242955eea5a admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:31.693243 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bdbb92-ad61-4450-97fa-f242955eea5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:31.693516 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bdbb92-ad61-4450-97fa-f242955eea5a admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:31.694256 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bdbb92-ad61-4450-97fa-f242955eea5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:19:31.694557 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bdbb92-ad61-4450-97fa-f242955eea5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:31.696249 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bdbb92-ad61-4450-97fa-f242955eea5a admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:31.711978 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1118/2266] 10.222.0.42 () {58 vars in 1152 bytes} [Mon Jul 4 09:19:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:19:31.714372 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6f329e-000e-47e0-8be8-52a486dad939 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:31.727319 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6f329e-000e-47e0-8be8-52a486dad939 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:31.733500 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d0e964-6a19-4e32-8c81-ba51e50b1579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:31.734243 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d0e964-6a19-4e32-8c81-ba51e50b1579 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:31.734432 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d0e964-6a19-4e32-8c81-ba51e50b1579 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:31.734703 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d0e964-6a19-4e32-8c81-ba51e50b1579 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:31.735409 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d0e964-6a19-4e32-8c81-ba51e50b1579 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:31.737825 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d0e964-6a19-4e32-8c81-ba51e50b1579 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:31.772066 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1149/2267] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:19:31 2022] POST /identity/v3/projects => generated 375 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:19:31.776836 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bdbb92-ad61-4450-97fa-f242955eea5a admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:31.791823 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bdbb92-ad61-4450-97fa-f242955eea5a admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:31.860393 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d213860-25ce-4857-a600-47e8b5f3d930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:31.861513 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d213860-25ce-4857-a600-47e8b5f3d930 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:31.861877 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d213860-25ce-4857-a600-47e8b5f3d930 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:31.862272 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d213860-25ce-4857-a600-47e8b5f3d930 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:31.862980 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d213860-25ce-4857-a600-47e8b5f3d930 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:31.865138 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d213860-25ce-4857-a600-47e8b5f3d930 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:31.891702 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1119/2268] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:19:31 2022] POST /identity/v3/users => generated 288 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:19:31.902466 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d0e964-6a19-4e32-8c81-ba51e50b1579 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:31.923015 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d0e964-6a19-4e32-8c81-ba51e50b1579 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:31.931808 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c88671-0772-4532-b74b-9c94bce7118a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:31.932926 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c88671-0772-4532-b74b-9c94bce7118a admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:31.933317 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c88671-0772-4532-b74b-9c94bce7118a admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:31.933742 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c88671-0772-4532-b74b-9c94bce7118a admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:31.935139 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c88671-0772-4532-b74b-9c94bce7118a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:31.937516 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c88671-0772-4532-b74b-9c94bce7118a admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:31.950515 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1150/2269] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:19:31 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:19:31.954978 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d213860-25ce-4857-a600-47e8b5f3d930 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:31.966564 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d213860-25ce-4857-a600-47e8b5f3d930 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:31.974167 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fdc110-4f3b-47b5-a413-14546699ce50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:31.974886 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fdc110-4f3b-47b5-a413-14546699ce50 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:31.975545 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fdc110-4f3b-47b5-a413-14546699ce50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:31.975858 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fdc110-4f3b-47b5-a413-14546699ce50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:31.976892 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fdc110-4f3b-47b5-a413-14546699ce50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:31.979033 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fdc110-4f3b-47b5-a413-14546699ce50 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:31.993056 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1120/2270] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:19:31 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:19:31.997499 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c88671-0772-4532-b74b-9c94bce7118a admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:32.008876 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c88671-0772-4532-b74b-9c94bce7118a admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:32.017385 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ba49f5-1273-47ec-8a57-bd719378d7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:32.018397 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba49f5-1273-47ec-8a57-bd719378d7f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:32.018695 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba49f5-1273-47ec-8a57-bd719378d7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:32.019004 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba49f5-1273-47ec-8a57-bd719378d7f3 admin admin] PATH_INFO: `/v3/projects/a3fbab9174344696ba032893aad4f4f1/users/321fe261ecf54e00ab29ede882e424d6/roles/81634e7812344f84afcb29b0dba2687c` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:32.037138 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ba49f5-1273-47ec-8a57-bd719378d7f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3fbab9174344696ba032893aad4f4f1, user_id=321fe261ecf54e00ab29ede882e424d6, role_id=81634e7812344f84afcb29b0dba2687c)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:32.039798 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ba49f5-1273-47ec-8a57-bd719378d7f3 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:32.068355 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1151/2271] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:19:31 2022] PUT /identity/v3/projects/a3fbab9174344696ba032893aad4f4f1/users/321fe261ecf54e00ab29ede882e424d6/roles/81634e7812344f84afcb29b0dba2687c => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:19:32.075127 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b53971-232f-4519-91c5-b7c904801e76 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:32.075590 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b53971-232f-4519-91c5-b7c904801e76 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:32.076590 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b53971-232f-4519-91c5-b7c904801e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:32.145829 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-71b53971-232f-4519-91c5-b7c904801e76 None None] MFA Rules not processed for user `321fe261ecf54e00ab29ede882e424d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:19:32.147065 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-71b53971-232f-4519-91c5-b7c904801e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:32.238335 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1121/2272] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:19:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:19:32.251153 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ba49f5-1273-47ec-8a57-bd719378d7f3 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:32.252920 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-f5ba49f5-1273-47ec-8a57-bd719378d7f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:32.266031 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:32.319056 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ba49f5-1273-47ec-8a57-bd719378d7f3 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:32.322713 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458fa795-b6ad-4d2f-a0ba-ccaed865abae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f86373d65440da97c853fff3c1d0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:32.323401 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458fa795-b6ad-4d2f-a0ba-ccaed865abae service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:32.323688 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458fa795-b6ad-4d2f-a0ba-ccaed865abae service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:32.323997 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458fa795-b6ad-4d2f-a0ba-ccaed865abae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:32.334249 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458fa795-b6ad-4d2f-a0ba-ccaed865abae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:32.336396 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458fa795-b6ad-4d2f-a0ba-ccaed865abae service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:32.345597 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1152/2273] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:19:32 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:19:35.641247 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b53971-232f-4519-91c5-b7c904801e76 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:35.687113 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:35.724398 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b53971-232f-4519-91c5-b7c904801e76 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:35.729529 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c71f4-cc1f-42a4-b5d0-e48e0339f40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:35.730612 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c71f4-cc1f-42a4-b5d0-e48e0339f40d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:35.730921 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c71f4-cc1f-42a4-b5d0-e48e0339f40d admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:35.731270 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c71f4-cc1f-42a4-b5d0-e48e0339f40d admin admin] PATH_INFO: `/v3/users/321fe261ecf54e00ab29ede882e424d6` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:35.732611 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825c71f4-cc1f-42a4-b5d0-e48e0339f40d admin admin] RBAC: Authorizing `identity:delete_user(user_id=321fe261ecf54e00ab29ede882e424d6)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:35.734958 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825c71f4-cc1f-42a4-b5d0-e48e0339f40d admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:35.798482 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-825c71f4-cc1f-42a4-b5d0-e48e0339f40d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '321fe261ecf54e00ab29ede882e424d6'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:35.799799 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-825c71f4-cc1f-42a4-b5d0-e48e0339f40d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '321fe261ecf54e00ab29ede882e424d6'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:35.810380 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-825c71f4-cc1f-42a4-b5d0-e48e0339f40d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '321fe261ecf54e00ab29ede882e424d6'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:35.811217 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-825c71f4-cc1f-42a4-b5d0-e48e0339f40d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '321fe261ecf54e00ab29ede882e424d6'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:35.827681 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e659c95-a4ea-447f-a9f5-99574cc98448 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:35.828803 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e659c95-a4ea-447f-a9f5-99574cc98448 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:35.829231 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e659c95-a4ea-447f-a9f5-99574cc98448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:35.836243 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-825c71f4-cc1f-42a4-b5d0-e48e0339f40d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '321fe261ecf54e00ab29ede882e424d6'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:35.852931 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-2e659c95-a4ea-447f-a9f5-99574cc98448 None None] MFA Rules not processed for user `defd27b64b204349a191a7b50b2d4cc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:19:35.856648 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1122/2274] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:19:35 2022] DELETE /identity/v3/users/321fe261ecf54e00ab29ede882e424d6 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:19:35.856772 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-2e659c95-a4ea-447f-a9f5-99574cc98448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:35.858642 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8537b142-8d61-43d3-835b-0bb1e3decd63 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:35.858934 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8537b142-8d61-43d3-835b-0bb1e3decd63 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:35.859209 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8537b142-8d61-43d3-835b-0bb1e3decd63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:35.884010 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-8537b142-8d61-43d3-835b-0bb1e3decd63 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:19:35.884010 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-8537b142-8d61-43d3-835b-0bb1e3decd63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:35.930499 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1153/2275] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:19:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:19:35.954580 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c311f7-1ea6-45fb-b771-09871c1e756d None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:35.955213 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c311f7-1ea6-45fb-b771-09871c1e756d None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:35.955458 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c311f7-1ea6-45fb-b771-09871c1e756d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:35.964213 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1123/2276] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:19:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:19:35.974389 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8537b142-8d61-43d3-835b-0bb1e3decd63 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:35.976143 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-8537b142-8d61-43d3-835b-0bb1e3decd63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:35.977281 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-48c311f7-1ea6-45fb-b771-09871c1e756d None None] MFA Rules not processed for user `1c1ef56d5b9f4545865414d14f861907`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:19:35.978526 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-48c311f7-1ea6-45fb-b771-09871c1e756d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:36.042315 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8537b142-8d61-43d3-835b-0bb1e3decd63 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:36.043924 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1154/2277] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:19:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:19:36.052252 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b2d2f9-3539-43fb-ad57-b3d574138cbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:36.052980 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b2d2f9-3539-43fb-ad57-b3d574138cbd service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:36.053286 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b2d2f9-3539-43fb-ad57-b3d574138cbd service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:36.053580 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b2d2f9-3539-43fb-ad57-b3d574138cbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:36.060515 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:36.066665 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b2d2f9-3539-43fb-ad57-b3d574138cbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:36.070091 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b2d2f9-3539-43fb-ad57-b3d574138cbd service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:36.083103 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1124/2278] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:19:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 09:19:36.962722 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c311f7-1ea6-45fb-b771-09871c1e756d None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:36.966349 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-48c311f7-1ea6-45fb-b771-09871c1e756d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:36.991267 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c311f7-1ea6-45fb-b771-09871c1e756d None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:37.006505 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0c473d-195b-4ca8-8783-a85e1c91bf94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:37.008035 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c473d-195b-4ca8-8783-a85e1c91bf94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:37.009183 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c473d-195b-4ca8-8783-a85e1c91bf94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:37.009694 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c473d-195b-4ca8-8783-a85e1c91bf94 admin admin] PATH_INFO: `/v3/projects/a3fbab9174344696ba032893aad4f4f1` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:37.012137 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0c473d-195b-4ca8-8783-a85e1c91bf94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3fbab9174344696ba032893aad4f4f1)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:37.015733 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0c473d-195b-4ca8-8783-a85e1c91bf94 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:37.089864 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-3f0c473d-195b-4ca8-8783-a85e1c91bf94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3fbab9174344696ba032893aad4f4f1', 'request_id': 'req-3f0c473d-195b-4ca8-8783-a85e1c91bf94'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:37.109104 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-3f0c473d-195b-4ca8-8783-a85e1c91bf94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3fbab9174344696ba032893aad4f4f1', 'request_id': 'req-3f0c473d-195b-4ca8-8783-a85e1c91bf94'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:37.113218 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:37.125967 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-3f0c473d-195b-4ca8-8783-a85e1c91bf94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3fbab9174344696ba032893aad4f4f1', 'request_id': 'req-3f0c473d-195b-4ca8-8783-a85e1c91bf94'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:37.161013 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-3f0c473d-195b-4ca8-8783-a85e1c91bf94 admin admin] The token cache is being invalidate because project a3fbab9174344696ba032893aad4f4f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:19:37.161221 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-3f0c473d-195b-4ca8-8783-a85e1c91bf94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:37.162400 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-3f0c473d-195b-4ca8-8783-a85e1c91bf94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:37.166256 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1155/2279] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:19:36 2022] DELETE /identity/v3/projects/a3fbab9174344696ba032893aad4f4f1 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:19:37.171251 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aadc602-b32c-41d7-a79f-587e3f91ada5 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:37.171863 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aadc602-b32c-41d7-a79f-587e3f91ada5 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:37.171863 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aadc602-b32c-41d7-a79f-587e3f91ada5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:37.197290 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-3aadc602-b32c-41d7-a79f-587e3f91ada5 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:19:37.198782 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3aadc602-b32c-41d7-a79f-587e3f91ada5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:37.269993 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1125/2280] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:19:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:19:37.278006 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df49468-4a60-4fba-92a1-38233d48e9cf None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:37.278491 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df49468-4a60-4fba-92a1-38233d48e9cf None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:37.278853 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df49468-4a60-4fba-92a1-38233d48e9cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:37.300569 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-0df49468-4a60-4fba-92a1-38233d48e9cf None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:19:37.301937 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-0df49468-4a60-4fba-92a1-38233d48e9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:37.314275 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1156/2281] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:19:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:19:37.318562 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aadc602-b32c-41d7-a79f-587e3f91ada5 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:37.331927 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aadc602-b32c-41d7-a79f-587e3f91ada5 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:37.339106 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6f2d31-52ee-41a3-b026-3851f41d6501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:37.340162 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f2d31-52ee-41a3-b026-3851f41d6501 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:37.340513 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f2d31-52ee-41a3-b026-3851f41d6501 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:37.340922 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f2d31-52ee-41a3-b026-3851f41d6501 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:37.341739 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6f2d31-52ee-41a3-b026-3851f41d6501 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:19:37.342111 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6f2d31-52ee-41a3-b026-3851f41d6501 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:37.343912 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6f2d31-52ee-41a3-b026-3851f41d6501 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:37.366477 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1126/2282] 10.222.0.42 () {58 vars in 1152 bytes} [Mon Jul 4 09:19:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:19:37.370653 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df49468-4a60-4fba-92a1-38233d48e9cf None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:37.395694 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df49468-4a60-4fba-92a1-38233d48e9cf None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:37.404787 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725758eb-d411-432c-83fa-b50315f5937c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:37.405478 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725758eb-d411-432c-83fa-b50315f5937c admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:37.406210 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725758eb-d411-432c-83fa-b50315f5937c admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:37.406499 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725758eb-d411-432c-83fa-b50315f5937c admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:37.407631 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725758eb-d411-432c-83fa-b50315f5937c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:37.409746 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725758eb-d411-432c-83fa-b50315f5937c admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:37.451905 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1157/2283] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:19:37 2022] POST /identity/v3/projects => generated 371 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:19:37.456190 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6f2d31-52ee-41a3-b026-3851f41d6501 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:37.468649 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6f2d31-52ee-41a3-b026-3851f41d6501 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:37.558502 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe95043-76f9-48f2-8bf8-de9350820d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:37.558502 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe95043-76f9-48f2-8bf8-de9350820d39 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:37.558502 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe95043-76f9-48f2-8bf8-de9350820d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:37.559362 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe95043-76f9-48f2-8bf8-de9350820d39 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:37.560159 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe95043-76f9-48f2-8bf8-de9350820d39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:37.562511 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe95043-76f9-48f2-8bf8-de9350820d39 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:37.596185 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1127/2284] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:19:37 2022] POST /identity/v3/users => generated 286 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:19:37.601299 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725758eb-d411-432c-83fa-b50315f5937c admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:37.615746 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725758eb-d411-432c-83fa-b50315f5937c admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:37.622822 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a2ed1e-dc87-4a5a-a8ea-401eaea0d691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:37.623627 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a2ed1e-dc87-4a5a-a8ea-401eaea0d691 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:37.624055 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a2ed1e-dc87-4a5a-a8ea-401eaea0d691 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:37.624375 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a2ed1e-dc87-4a5a-a8ea-401eaea0d691 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:37.625206 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a2ed1e-dc87-4a5a-a8ea-401eaea0d691 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:37.627039 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a2ed1e-dc87-4a5a-a8ea-401eaea0d691 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:37.643917 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1158/2285] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:19:37 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:19:37.648364 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe95043-76f9-48f2-8bf8-de9350820d39 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:37.663324 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe95043-76f9-48f2-8bf8-de9350820d39 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:37.669468 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5e71c1-7658-4de2-8552-6b05193e14bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:37.670679 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5e71c1-7658-4de2-8552-6b05193e14bb admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:37.671103 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5e71c1-7658-4de2-8552-6b05193e14bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:37.671717 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5e71c1-7658-4de2-8552-6b05193e14bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:37.672889 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5e71c1-7658-4de2-8552-6b05193e14bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:37.675409 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5e71c1-7658-4de2-8552-6b05193e14bb admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:37.688881 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1128/2286] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:19:37 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:19:37.693719 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a2ed1e-dc87-4a5a-a8ea-401eaea0d691 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:37.710461 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a2ed1e-dc87-4a5a-a8ea-401eaea0d691 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:37.716815 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36db8c53-8afc-4eeb-982e-f7fb22fe1994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:37.717372 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db8c53-8afc-4eeb-982e-f7fb22fe1994 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:37.717723 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db8c53-8afc-4eeb-982e-f7fb22fe1994 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:37.718000 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db8c53-8afc-4eeb-982e-f7fb22fe1994 admin admin] PATH_INFO: `/v3/projects/dd9ef6caac134d9a9860a7868c0f9548/users/205819046de546cfbc3285d55225fa38/roles/81634e7812344f84afcb29b0dba2687c` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:37.734657 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36db8c53-8afc-4eeb-982e-f7fb22fe1994 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd9ef6caac134d9a9860a7868c0f9548, user_id=205819046de546cfbc3285d55225fa38, role_id=81634e7812344f84afcb29b0dba2687c)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:37.744792 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36db8c53-8afc-4eeb-982e-f7fb22fe1994 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:37.760904 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1159/2287] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:19:37 2022] PUT /identity/v3/projects/dd9ef6caac134d9a9860a7868c0f9548/users/205819046de546cfbc3285d55225fa38/roles/81634e7812344f84afcb29b0dba2687c => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:19:37.833101 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b6319-2175-4c89-b6c7-7ab48d271f70 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:37.833371 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b6319-2175-4c89-b6c7-7ab48d271f70 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:37.833810 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b6319-2175-4c89-b6c7-7ab48d271f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:37.864355 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-f51b6319-2175-4c89-b6c7-7ab48d271f70 None None] MFA Rules not processed for user `205819046de546cfbc3285d55225fa38`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:19:37.865561 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f51b6319-2175-4c89-b6c7-7ab48d271f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:37.920014 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:37.943477 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1129/2288] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:19:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:19:37.954802 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36db8c53-8afc-4eeb-982e-f7fb22fe1994 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:37.956609 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-36db8c53-8afc-4eeb-982e-f7fb22fe1994 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:38.038292 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36db8c53-8afc-4eeb-982e-f7fb22fe1994 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:38.046413 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccd1b77-b005-43b0-b141-eb651543b6fd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92e3804048824cde829e6273ce7c19b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:38.048635 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd1b77-b005-43b0-b141-eb651543b6fd service glance] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:38.049052 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd1b77-b005-43b0-b141-eb651543b6fd service glance] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:38.049354 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd1b77-b005-43b0-b141-eb651543b6fd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:38.082986 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccd1b77-b005-43b0-b141-eb651543b6fd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:38.087525 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccd1b77-b005-43b0-b141-eb651543b6fd service glance] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:38.103271 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1160/2289] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:19:37 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:19:42.088256 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51b6319-2175-4c89-b6c7-7ab48d271f70 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:42.089602 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f51b6319-2175-4c89-b6c7-7ab48d271f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:42.179310 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51b6319-2175-4c89-b6c7-7ab48d271f70 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:42.184618 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582b9ace-d4fe-4b52-9660-2f16889beb0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:42.185652 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b9ace-d4fe-4b52-9660-2f16889beb0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:42.185981 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b9ace-d4fe-4b52-9660-2f16889beb0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:42.186268 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b9ace-d4fe-4b52-9660-2f16889beb0f admin admin] PATH_INFO: `/v3/users/e224864ab78b4f33a80e1d63cf1c7067` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:42.187489 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582b9ace-d4fe-4b52-9660-2f16889beb0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e224864ab78b4f33a80e1d63cf1c7067)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:42.189686 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582b9ace-d4fe-4b52-9660-2f16889beb0f admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:42.238035 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-582b9ace-d4fe-4b52-9660-2f16889beb0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e224864ab78b4f33a80e1d63cf1c7067'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:42.238659 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-582b9ace-d4fe-4b52-9660-2f16889beb0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e224864ab78b4f33a80e1d63cf1c7067'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:42.246239 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-582b9ace-d4fe-4b52-9660-2f16889beb0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e224864ab78b4f33a80e1d63cf1c7067'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:42.247065 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-582b9ace-d4fe-4b52-9660-2f16889beb0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e224864ab78b4f33a80e1d63cf1c7067'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:42.261216 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-582b9ace-d4fe-4b52-9660-2f16889beb0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e224864ab78b4f33a80e1d63cf1c7067'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:42.273658 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1130/2290] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:19:42 2022] DELETE /identity/v3/users/e224864ab78b4f33a80e1d63cf1c7067 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:19:42.278470 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bd4fa4-f80b-4ed2-a9f7-153b613029e7 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:42.278993 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bd4fa4-f80b-4ed2-a9f7-153b613029e7 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:42.279101 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bd4fa4-f80b-4ed2-a9f7-153b613029e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:42.297179 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-93bd4fa4-f80b-4ed2-a9f7-153b613029e7 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:19:42.298447 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-93bd4fa4-f80b-4ed2-a9f7-153b613029e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:42.377685 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1161/2291] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:19:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:19:42.388492 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582b9ace-d4fe-4b52-9660-2f16889beb0f admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:42.390110 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-582b9ace-d4fe-4b52-9660-2f16889beb0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:42.470438 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582b9ace-d4fe-4b52-9660-2f16889beb0f admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:42.477047 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a88cd9-14c4-49ee-8346-165e11e1bdfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:42.477734 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a88cd9-14c4-49ee-8346-165e11e1bdfb service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:42.478017 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a88cd9-14c4-49ee-8346-165e11e1bdfb service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:42.478286 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a88cd9-14c4-49ee-8346-165e11e1bdfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:42.497264 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a88cd9-14c4-49ee-8346-165e11e1bdfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:42.498824 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a88cd9-14c4-49ee-8346-165e11e1bdfb service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:42.511566 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1131/2292] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:19:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:19:43.069097 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bd4fa4-f80b-4ed2-a9f7-153b613029e7 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:43.077372 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-93bd4fa4-f80b-4ed2-a9f7-153b613029e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:43.110779 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bd4fa4-f80b-4ed2-a9f7-153b613029e7 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:43.139545 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f594a722-2aaf-427e-8085-b73fa6aa73f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:43.140611 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f594a722-2aaf-427e-8085-b73fa6aa73f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:43.141162 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f594a722-2aaf-427e-8085-b73fa6aa73f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:43.141451 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f594a722-2aaf-427e-8085-b73fa6aa73f3 admin admin] PATH_INFO: `/v3/projects/b55ccbf3c49249c2adf9c814573bb017` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:43.147257 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f594a722-2aaf-427e-8085-b73fa6aa73f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b55ccbf3c49249c2adf9c814573bb017)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:43.150046 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f594a722-2aaf-427e-8085-b73fa6aa73f3 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:43.191740 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:43.229401 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-f594a722-2aaf-427e-8085-b73fa6aa73f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b55ccbf3c49249c2adf9c814573bb017', 'request_id': 'req-f594a722-2aaf-427e-8085-b73fa6aa73f3'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:43.242046 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-f594a722-2aaf-427e-8085-b73fa6aa73f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b55ccbf3c49249c2adf9c814573bb017', 'request_id': 'req-f594a722-2aaf-427e-8085-b73fa6aa73f3'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:43.249308 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-f594a722-2aaf-427e-8085-b73fa6aa73f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b55ccbf3c49249c2adf9c814573bb017', 'request_id': 'req-f594a722-2aaf-427e-8085-b73fa6aa73f3'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:43.264125 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-f594a722-2aaf-427e-8085-b73fa6aa73f3 admin admin] The token cache is being invalidate because project b55ccbf3c49249c2adf9c814573bb017 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:19:43.264467 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-f594a722-2aaf-427e-8085-b73fa6aa73f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:43.265243 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-f594a722-2aaf-427e-8085-b73fa6aa73f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:19:43.267111 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1162/2293] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:19:43 2022] DELETE /identity/v3/projects/b55ccbf3c49249c2adf9c814573bb017 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:19:51.815781 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4f0ac-f838-41e0-85be-5352235bd418 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:51.816319 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4f0ac-f838-41e0-85be-5352235bd418 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:51.816417 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4f0ac-f838-41e0-85be-5352235bd418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:51.834146 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-d0c4f0ac-f838-41e0-85be-5352235bd418 None None] MFA Rules not processed for user `bd758d5b21684027b0d199021df0ad2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:19:51.835448 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d0c4f0ac-f838-41e0-85be-5352235bd418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:51.841016 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:51.895810 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1132/2294] 10.222.0.42 () {58 vars in 1009 bytes} [Mon Jul 4 09:19:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:19:51.939561 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f594a722-2aaf-427e-8085-b73fa6aa73f3 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:51.941019 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-f594a722-2aaf-427e-8085-b73fa6aa73f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:52.013484 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f594a722-2aaf-427e-8085-b73fa6aa73f3 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:52.018602 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c9c67e-e3a2-4e00-b067-be0c656ac5d6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59d8698c45fb46259765eb3c8de2297f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:52.019274 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9c67e-e3a2-4e00-b067-be0c656ac5d6 service swift] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:52.019524 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9c67e-e3a2-4e00-b067-be0c656ac5d6 service swift] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:52.019799 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9c67e-e3a2-4e00-b067-be0c656ac5d6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:52.028757 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c9c67e-e3a2-4e00-b067-be0c656ac5d6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:52.030286 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c9c67e-e3a2-4e00-b067-be0c656ac5d6 service swift] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:52.038602 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1163/2295] 10.222.0.42 () {60 vars in 1384 bytes} [Mon Jul 4 09:19:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 04 09:19:58.392804 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa96da1-9593-4447-94f7-ff40a3e31f93 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:58.394050 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa96da1-9593-4447-94f7-ff40a3e31f93 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:58.394539 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa96da1-9593-4447-94f7-ff40a3e31f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:58.415297 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-daa96da1-9593-4447-94f7-ff40a3e31f93 None None] MFA Rules not processed for user `bd758d5b21684027b0d199021df0ad2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:19:58.416687 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-daa96da1-9593-4447-94f7-ff40a3e31f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:19:58.430458 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1133/2296] 10.222.0.42 () {58 vars in 1009 bytes} [Mon Jul 4 09:19:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:19:58.440805 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c9c67e-e3a2-4e00-b067-be0c656ac5d6 service swift] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:19:58.451832 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c9c67e-e3a2-4e00-b067-be0c656ac5d6 service swift] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:19:58.459098 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4686e78-09a0-41b6-b770-bb650ff747d6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59d8698c45fb46259765eb3c8de2297f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:19:58.460221 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4686e78-09a0-41b6-b770-bb650ff747d6 service swift] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:19:58.460775 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4686e78-09a0-41b6-b770-bb650ff747d6 service swift] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:19:58.461249 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4686e78-09a0-41b6-b770-bb650ff747d6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:19:58.480779 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4686e78-09a0-41b6-b770-bb650ff747d6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:19:58.482881 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4686e78-09a0-41b6-b770-bb650ff747d6 service swift] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:19:58.494813 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1164/2297] 10.222.0.42 () {60 vars in 1384 bytes} [Mon Jul 4 09:19:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 04 09:20:04.994556 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa96da1-9593-4447-94f7-ff40a3e31f93 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:20:04.996530 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-daa96da1-9593-4447-94f7-ff40a3e31f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:20:05.090226 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa96da1-9593-4447-94f7-ff40a3e31f93 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:20:05.095132 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46116fe-85a9-42b1-ade0-8e32d4a86e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:20:05.096197 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46116fe-85a9-42b1-ade0-8e32d4a86e1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:20:05.096983 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46116fe-85a9-42b1-ade0-8e32d4a86e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:20:05.096983 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46116fe-85a9-42b1-ade0-8e32d4a86e1c admin admin] PATH_INFO: `/v3/users/205819046de546cfbc3285d55225fa38` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:20:05.098696 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46116fe-85a9-42b1-ade0-8e32d4a86e1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=205819046de546cfbc3285d55225fa38)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:20:05.101395 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46116fe-85a9-42b1-ade0-8e32d4a86e1c admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:20:05.212246 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a46116fe-85a9-42b1-ade0-8e32d4a86e1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '205819046de546cfbc3285d55225fa38'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:20:05.214253 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a46116fe-85a9-42b1-ade0-8e32d4a86e1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '205819046de546cfbc3285d55225fa38'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:20:05.228322 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a46116fe-85a9-42b1-ade0-8e32d4a86e1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '205819046de546cfbc3285d55225fa38'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:20:05.229267 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a46116fe-85a9-42b1-ade0-8e32d4a86e1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '205819046de546cfbc3285d55225fa38'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:20:05.256249 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a46116fe-85a9-42b1-ade0-8e32d4a86e1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '205819046de546cfbc3285d55225fa38'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:20:05.273332 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1134/2298] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:20:04 2022] DELETE /identity/v3/users/205819046de546cfbc3285d55225fa38 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:20:05.277961 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e737f5b6-d572-4e37-bcac-69abd7644f97 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:20:05.278481 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e737f5b6-d572-4e37-bcac-69abd7644f97 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:20:05.278481 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e737f5b6-d572-4e37-bcac-69abd7644f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:20:05.297006 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-e737f5b6-d572-4e37-bcac-69abd7644f97 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:20:05.298497 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-e737f5b6-d572-4e37-bcac-69abd7644f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:20:05.367941 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1165/2299] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:20:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:20:05.376186 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46116fe-85a9-42b1-ade0-8e32d4a86e1c admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:20:05.377994 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a46116fe-85a9-42b1-ade0-8e32d4a86e1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:20:05.418441 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:20:05.461796 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46116fe-85a9-42b1-ade0-8e32d4a86e1c admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:20:05.466219 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67ec30f-71d6-469b-83d3-61cf1b69c557 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:20:05.467193 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ec30f-71d6-469b-83d3-61cf1b69c557 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:20:05.467711 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ec30f-71d6-469b-83d3-61cf1b69c557 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:20:05.468332 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ec30f-71d6-469b-83d3-61cf1b69c557 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:20:05.480356 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67ec30f-71d6-469b-83d3-61cf1b69c557 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:20:05.483192 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67ec30f-71d6-469b-83d3-61cf1b69c557 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:20:05.495661 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1135/2300] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:20:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:20:06.127768 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e737f5b6-d572-4e37-bcac-69abd7644f97 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:20:06.129277 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-e737f5b6-d572-4e37-bcac-69abd7644f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:20:06.147798 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e737f5b6-d572-4e37-bcac-69abd7644f97 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:20:06.160614 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8ccee5-9ca4-40bb-b075-dc336a62843d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:20:06.169136 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ccee5-9ca4-40bb-b075-dc336a62843d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:20:06.169420 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ccee5-9ca4-40bb-b075-dc336a62843d admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:20:06.169717 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ccee5-9ca4-40bb-b075-dc336a62843d admin admin] PATH_INFO: `/v3/projects/dd9ef6caac134d9a9860a7868c0f9548` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:20:06.173473 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8ccee5-9ca4-40bb-b075-dc336a62843d admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd9ef6caac134d9a9860a7868c0f9548)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:20:06.175594 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8ccee5-9ca4-40bb-b075-dc336a62843d admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:20:06.263116 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:20:06.309332 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-ae8ccee5-9ca4-40bb-b075-dc336a62843d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd9ef6caac134d9a9860a7868c0f9548', 'request_id': 'req-ae8ccee5-9ca4-40bb-b075-dc336a62843d'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:20:06.329718 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-ae8ccee5-9ca4-40bb-b075-dc336a62843d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd9ef6caac134d9a9860a7868c0f9548', 'request_id': 'req-ae8ccee5-9ca4-40bb-b075-dc336a62843d'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:20:06.347502 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-ae8ccee5-9ca4-40bb-b075-dc336a62843d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd9ef6caac134d9a9860a7868c0f9548', 'request_id': 'req-ae8ccee5-9ca4-40bb-b075-dc336a62843d'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:20:06.376659 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-ae8ccee5-9ca4-40bb-b075-dc336a62843d admin admin] The token cache is being invalidate because project dd9ef6caac134d9a9860a7868c0f9548 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:20:06.377288 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-ae8ccee5-9ca4-40bb-b075-dc336a62843d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:20:06.378000 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-ae8ccee5-9ca4-40bb-b075-dc336a62843d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:20:06.379933 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1166/2301] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:20:06 2022] DELETE /identity/v3/projects/dd9ef6caac134d9a9860a7868c0f9548 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:20:10.937068 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984740f-91e7-412d-b4b1-aaec111e6692 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:20:10.937625 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984740f-91e7-412d-b4b1-aaec111e6692 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:20:10.937720 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984740f-91e7-412d-b4b1-aaec111e6692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:20:10.968461 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-5984740f-91e7-412d-b4b1-aaec111e6692 None None] MFA Rules not processed for user `bd758d5b21684027b0d199021df0ad2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:20:10.969705 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-5984740f-91e7-412d-b4b1-aaec111e6692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:20:11.047136 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1136/2302] 10.222.0.42 () {58 vars in 967 bytes} [Mon Jul 4 09:20:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:20:11.060278 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8ccee5-9ca4-40bb-b075-dc336a62843d admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:20:11.061836 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-ae8ccee5-9ca4-40bb-b075-dc336a62843d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:20:11.161352 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8ccee5-9ca4-40bb-b075-dc336a62843d admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:20:11.168512 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf67cee8-593d-4c06-850b-e0cb6776fa00 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59d8698c45fb46259765eb3c8de2297f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:20:11.169388 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf67cee8-593d-4c06-850b-e0cb6776fa00 service swift] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:20:11.169829 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf67cee8-593d-4c06-850b-e0cb6776fa00 service swift] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:20:11.170261 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf67cee8-593d-4c06-850b-e0cb6776fa00 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:20:11.180788 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf67cee8-593d-4c06-850b-e0cb6776fa00 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:20:11.182358 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf67cee8-593d-4c06-850b-e0cb6776fa00 service swift] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:20:11.190933 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1167/2303] 10.222.0.42 () {60 vars in 1384 bytes} [Mon Jul 4 09:20:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 04 09:20:13.224821 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660cef7-4d0d-484d-9a5e-271b873f977a None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:20:13.225371 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660cef7-4d0d-484d-9a5e-271b873f977a None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:20:13.225476 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660cef7-4d0d-484d-9a5e-271b873f977a None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:20:13.226992 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1137/2304] 10.222.0.42 () {54 vars in 921 bytes} [Mon Jul 4 09:20:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:20:13.232053 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b6ff2-0c72-4750-a1a0-591a80b942cc None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:20:13.232534 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b6ff2-0c72-4750-a1a0-591a80b942cc None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:20:13.232632 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b6ff2-0c72-4750-a1a0-591a80b942cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:20:13.251711 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-5c1b6ff2-0c72-4750-a1a0-591a80b942cc None None] MFA Rules not processed for user `46ec1a2091f1434cabc69066eb3b6725`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:20:13.252955 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-5c1b6ff2-0c72-4750-a1a0-591a80b942cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:20:13.289099 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1660cef7-4d0d-484d-9a5e-271b873f977a None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:20:13.291108 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-1660cef7-4d0d-484d-9a5e-271b873f977a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:20:13.332469 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1168/2305] 10.222.0.42 () {58 vars in 1018 bytes} [Mon Jul 4 09:20:13 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:20:13.344895 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1b6ff2-0c72-4750-a1a0-591a80b942cc None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:20:13.346908 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-5c1b6ff2-0c72-4750-a1a0-591a80b942cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:20:13.363044 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1b6ff2-0c72-4750-a1a0-591a80b942cc None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:20:13.368950 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2112dd-5b76-4a52-85fa-b73add128089 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46ec1a2091f1434cabc69066eb3b6725', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:20:13.370313 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2112dd-5b76-4a52-85fa-b73add128089 service placement] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:20:13.370735 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2112dd-5b76-4a52-85fa-b73add128089 service placement] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:20:13.371107 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2112dd-5b76-4a52-85fa-b73add128089 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:20:13.378640 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:20:13.381320 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2112dd-5b76-4a52-85fa-b73add128089 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:20:13.383323 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2112dd-5b76-4a52-85fa-b73add128089 service placement] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:20:13.395484 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1169/2306] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:20:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 09:20:13.399725 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1660cef7-4d0d-484d-9a5e-271b873f977a None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:20:13.404720 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0314d220-ce15-43a4-85e9-63d519f6efc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:20:13.405664 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314d220-ce15-43a4-85e9-63d519f6efc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:20:13.405941 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314d220-ce15-43a4-85e9-63d519f6efc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:20:13.406209 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314d220-ce15-43a4-85e9-63d519f6efc3 admin admin] PATH_INFO: `/v3/users/0375760c788b4bd0992302f291a2dd35` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:20:13.407419 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0314d220-ce15-43a4-85e9-63d519f6efc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0375760c788b4bd0992302f291a2dd35)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:20:13.409417 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0314d220-ce15-43a4-85e9-63d519f6efc3 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:20:13.433680 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:20:13.458399 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0314d220-ce15-43a4-85e9-63d519f6efc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0375760c788b4bd0992302f291a2dd35'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:20:13.459290 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0314d220-ce15-43a4-85e9-63d519f6efc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0375760c788b4bd0992302f291a2dd35'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:20:13.468242 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0314d220-ce15-43a4-85e9-63d519f6efc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0375760c788b4bd0992302f291a2dd35'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:20:13.469239 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0314d220-ce15-43a4-85e9-63d519f6efc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0375760c788b4bd0992302f291a2dd35'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:20:13.485656 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0314d220-ce15-43a4-85e9-63d519f6efc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0375760c788b4bd0992302f291a2dd35'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:20:13.499541 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1138/2307] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:20:13 2022] DELETE /identity/v3/users/0375760c788b4bd0992302f291a2dd35 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:20:13.691503 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2112dd-5b76-4a52-85fa-b73add128089 service placement] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:20:13.704944 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2112dd-5b76-4a52-85fa-b73add128089 service placement] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:20:13.786481 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55e9556-7001-48dc-bd20-c03550e87e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:20:13.787934 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e9556-7001-48dc-bd20-c03550e87e29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:20:13.788373 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e9556-7001-48dc-bd20-c03550e87e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:20:13.788774 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e9556-7001-48dc-bd20-c03550e87e29 admin admin] PATH_INFO: `/v3/projects/b1930be8ccd841deaa4d41ed54368a39` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:20:13.790247 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55e9556-7001-48dc-bd20-c03550e87e29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1930be8ccd841deaa4d41ed54368a39)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:20:13.792358 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55e9556-7001-48dc-bd20-c03550e87e29 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:20:13.846078 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-b55e9556-7001-48dc-bd20-c03550e87e29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1930be8ccd841deaa4d41ed54368a39', 'request_id': 'req-b55e9556-7001-48dc-bd20-c03550e87e29'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:20:13.855058 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-b55e9556-7001-48dc-bd20-c03550e87e29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1930be8ccd841deaa4d41ed54368a39', 'request_id': 'req-b55e9556-7001-48dc-bd20-c03550e87e29'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:20:13.861127 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-b55e9556-7001-48dc-bd20-c03550e87e29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1930be8ccd841deaa4d41ed54368a39', 'request_id': 'req-b55e9556-7001-48dc-bd20-c03550e87e29'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:20:13.872997 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-b55e9556-7001-48dc-bd20-c03550e87e29 admin admin] The token cache is being invalidate because project b1930be8ccd841deaa4d41ed54368a39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:20:13.873267 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-b55e9556-7001-48dc-bd20-c03550e87e29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:20:13.873923 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-b55e9556-7001-48dc-bd20-c03550e87e29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:20:13.887930 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1170/2308] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:20:13 2022] DELETE /identity/v3/projects/b1930be8ccd841deaa4d41ed54368a39 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:20:14.284103 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c9d4e-49c9-4c70-8c3d-43e45a4c59fe None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:20:14.284672 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c9d4e-49c9-4c70-8c3d-43e45a4c59fe None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:20:14.284672 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c9d4e-49c9-4c70-8c3d-43e45a4c59fe None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:20:14.286049 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1139/2309] 10.222.0.42 () {54 vars in 921 bytes} [Mon Jul 4 09:20:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:20:14.291789 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c43244-04e7-4805-986e-2958c1655b81 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:20:14.292263 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c43244-04e7-4805-986e-2958c1655b81 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:20:14.292456 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c43244-04e7-4805-986e-2958c1655b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:20:14.311703 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-c6c43244-04e7-4805-986e-2958c1655b81 None None] MFA Rules not processed for user `af3b6e252a8c434a99432bcece6493b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:20:14.313048 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-c6c43244-04e7-4805-986e-2958c1655b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:20:14.383471 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1171/2310] 10.222.0.42 () {58 vars in 1018 bytes} [Mon Jul 4 09:20:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:20:14.395702 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7c9d4e-49c9-4c70-8c3d-43e45a4c59fe None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:20:14.397406 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-de7c9d4e-49c9-4c70-8c3d-43e45a4c59fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:20:14.463846 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7c9d4e-49c9-4c70-8c3d-43e45a4c59fe None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:20:14.467709 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61350e5b-df4f-4869-8e25-63fad6fdbda8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92e3804048824cde829e6273ce7c19b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:20:14.468385 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61350e5b-df4f-4869-8e25-63fad6fdbda8 service glance] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:20:14.468640 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61350e5b-df4f-4869-8e25-63fad6fdbda8 service glance] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:20:14.468916 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61350e5b-df4f-4869-8e25-63fad6fdbda8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:20:14.480066 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61350e5b-df4f-4869-8e25-63fad6fdbda8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:20:14.481531 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61350e5b-df4f-4869-8e25-63fad6fdbda8 service glance] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:20:14.492441 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1140/2311] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:20:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:20:14.566643 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c8c867-9726-4b38-81a2-b530f91cda0b None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:20:14.566928 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c8c867-9726-4b38-81a2-b530f91cda0b None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:20:14.567200 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c8c867-9726-4b38-81a2-b530f91cda0b None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:20:14.568629 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1172/2312] 10.222.0.42 () {54 vars in 921 bytes} [Mon Jul 4 09:20:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:20:14.573923 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a919a-edee-4fd1-b026-72bf764f4fbd None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:20:14.574211 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a919a-edee-4fd1-b026-72bf764f4fbd None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:20:14.574486 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a919a-edee-4fd1-b026-72bf764f4fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:20:14.606538 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-934a919a-edee-4fd1-b026-72bf764f4fbd None None] MFA Rules not processed for user `4db0575f076240559f64e9548b56ffeb`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:20:14.607741 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-934a919a-edee-4fd1-b026-72bf764f4fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:20:14.670559 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1141/2313] 10.222.0.42 () {58 vars in 1018 bytes} [Mon Jul 4 09:20:14 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:20:14.682345 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c8c867-9726-4b38-81a2-b530f91cda0b None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:20:14.684347 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-18c8c867-9726-4b38-81a2-b530f91cda0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:20:14.698057 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c8c867-9726-4b38-81a2-b530f91cda0b None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:20:14.701958 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2e5e62-19ea-46d7-9637-3de467a06b71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:20:14.702608 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e5e62-19ea-46d7-9637-3de467a06b71 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:20:14.702893 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e5e62-19ea-46d7-9637-3de467a06b71 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:20:14.703168 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e5e62-19ea-46d7-9637-3de467a06b71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:20:14.711678 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2e5e62-19ea-46d7-9637-3de467a06b71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:20:14.713228 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2e5e62-19ea-46d7-9637-3de467a06b71 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:20:14.721413 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1173/2314] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:20:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:20:14.806532 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaffce9-72b8-41de-92af-cdcd60bcdf31 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:20:14.806827 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaffce9-72b8-41de-92af-cdcd60bcdf31 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:20:14.807069 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaffce9-72b8-41de-92af-cdcd60bcdf31 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:20:14.808596 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1142/2315] 10.222.0.42 () {54 vars in 921 bytes} [Mon Jul 4 09:20:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:20:14.814289 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f37486-8896-4b70-af75-e19a787b7342 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:20:14.814581 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f37486-8896-4b70-af75-e19a787b7342 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:20:14.814890 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f37486-8896-4b70-af75-e19a787b7342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:20:14.822804 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:20:14.835469 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-a1f37486-8896-4b70-af75-e19a787b7342 None None] MFA Rules not processed for user `af3b6e252a8c434a99432bcece6493b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:20:14.837267 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-a1f37486-8896-4b70-af75-e19a787b7342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:20:14.847816 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1174/2316] 10.222.0.42 () {58 vars in 1018 bytes} [Mon Jul 4 09:20:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:20:14.858480 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaffce9-72b8-41de-92af-cdcd60bcdf31 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:20:14.860378 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-dfaffce9-72b8-41de-92af-cdcd60bcdf31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:20:14.876686 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaffce9-72b8-41de-92af-cdcd60bcdf31 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:20:14.881128 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f46738b-1d14-48ec-9a00-81709c408289 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:20:14.881777 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f46738b-1d14-48ec-9a00-81709c408289 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:20:14.882056 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f46738b-1d14-48ec-9a00-81709c408289 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:20:14.882325 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f46738b-1d14-48ec-9a00-81709c408289 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:20:14.894214 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f46738b-1d14-48ec-9a00-81709c408289 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:20:14.895928 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f46738b-1d14-48ec-9a00-81709c408289 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:20:14.906982 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1143/2317] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:20:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:20:17.194318 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b4a879-9fc9-4549-aeed-cefd19d9ae06 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:20:17.194808 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b4a879-9fc9-4549-aeed-cefd19d9ae06 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:20:17.194909 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b4a879-9fc9-4549-aeed-cefd19d9ae06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:20:17.214264 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-c8b4a879-9fc9-4549-aeed-cefd19d9ae06 None None] MFA Rules not processed for user `bd758d5b21684027b0d199021df0ad2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:20:17.215490 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-c8b4a879-9fc9-4549-aeed-cefd19d9ae06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:20:17.280129 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1175/2318] 10.222.0.42 () {58 vars in 1009 bytes} [Mon Jul 4 09:20:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:20:17.297054 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f46738b-1d14-48ec-9a00-81709c408289 service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:20:17.298534 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-7f46738b-1d14-48ec-9a00-81709c408289 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:20:17.318910 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:20:17.370298 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f46738b-1d14-48ec-9a00-81709c408289 service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:20:17.375456 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13750068-c2f3-4339-a214-c4e0f8834020 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59d8698c45fb46259765eb3c8de2297f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:20:17.376231 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13750068-c2f3-4339-a214-c4e0f8834020 service swift] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:20:17.376516 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13750068-c2f3-4339-a214-c4e0f8834020 service swift] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:20:17.376789 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13750068-c2f3-4339-a214-c4e0f8834020 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:20:17.385019 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13750068-c2f3-4339-a214-c4e0f8834020 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:20:17.386826 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13750068-c2f3-4339-a214-c4e0f8834020 service swift] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:20:17.394967 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1144/2319] 10.222.0.42 () {60 vars in 1384 bytes} [Mon Jul 4 09:20:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 04 09:20:27.272886 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=26 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:20:27.391823 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=24 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:20:34.342197 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0040864-feee-409b-b998-b4b165b767e2 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:20:34.342694 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0040864-feee-409b-b998-b4b165b767e2 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:20:34.342811 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0040864-feee-409b-b998-b4b165b767e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:20:34.373317 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-d0040864-feee-409b-b998-b4b165b767e2 None None] MFA Rules not processed for user `bd758d5b21684027b0d199021df0ad2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:20:34.374525 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-d0040864-feee-409b-b998-b4b165b767e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:20:34.396210 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1176/2320] 10.222.0.42 () {58 vars in 967 bytes} [Mon Jul 4 09:20:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:20:34.414466 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13750068-c2f3-4339-a214-c4e0f8834020 service swift] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:20:34.426930 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13750068-c2f3-4339-a214-c4e0f8834020 service swift] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:20:34.433096 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98ad7f8-44fc-4116-b26b-da32cd309eab service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59d8698c45fb46259765eb3c8de2297f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:20:34.433750 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ad7f8-44fc-4116-b26b-da32cd309eab service swift] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:20:34.434036 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ad7f8-44fc-4116-b26b-da32cd309eab service swift] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:20:34.434366 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ad7f8-44fc-4116-b26b-da32cd309eab service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:20:34.443790 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98ad7f8-44fc-4116-b26b-da32cd309eab service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:20:34.445460 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98ad7f8-44fc-4116-b26b-da32cd309eab service swift] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:20:34.454778 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1145/2321] 10.222.0.42 () {60 vars in 1384 bytes} [Mon Jul 4 09:20:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 04 09:20:43.774388 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0040864-feee-409b-b998-b4b165b767e2 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:20:43.776550 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-d0040864-feee-409b-b998-b4b165b767e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:20:43.930783 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0040864-feee-409b-b998-b4b165b767e2 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:20:43.942776 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7282ad37-50c4-40d8-a05b-7435b5ca6563 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46ec1a2091f1434cabc69066eb3b6725', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:20:43.944045 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7282ad37-50c4-40d8-a05b-7435b5ca6563 service placement] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:20:43.944404 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7282ad37-50c4-40d8-a05b-7435b5ca6563 service placement] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:20:43.944601 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7282ad37-50c4-40d8-a05b-7435b5ca6563 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:20:43.946721 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-7282ad37-50c4-40d8-a05b-7435b5ca6563 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:20:43.962303 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7282ad37-50c4-40d8-a05b-7435b5ca6563 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:20:43.964382 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7282ad37-50c4-40d8-a05b-7435b5ca6563 service placement] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:20:43.989008 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1177/2322] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:20:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:20:44.450723 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=6 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:20:53.975238 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=51 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:20:54.670835 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20466a7a-1455-4753-a367-e380b0fa6829 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:20:54.671337 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20466a7a-1455-4753-a367-e380b0fa6829 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:20:54.671448 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20466a7a-1455-4753-a367-e380b0fa6829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:20:54.689281 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-20466a7a-1455-4753-a367-e380b0fa6829 None None] MFA Rules not processed for user `defd27b64b204349a191a7b50b2d4cc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:20:54.690485 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-20466a7a-1455-4753-a367-e380b0fa6829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:20:54.756004 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1146/2323] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:20:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:21:04.748516 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=25 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:21:05.986968 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f4c0f7-9155-4c13-80bb-37acad9f088c None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:21:05.987532 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f4c0f7-9155-4c13-80bb-37acad9f088c None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:21:05.987532 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f4c0f7-9155-4c13-80bb-37acad9f088c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:21:06.006201 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-66f4c0f7-9155-4c13-80bb-37acad9f088c None None] MFA Rules not processed for user `1c1ef56d5b9f4545865414d14f861907`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:21:06.007425 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-66f4c0f7-9155-4c13-80bb-37acad9f088c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:21:06.064687 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1178/2324] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:21:05 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:21:16.058303 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=25 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:21:20.825299 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761fac7a-8156-4400-8e68-25cb6156763a None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:21:20.825778 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761fac7a-8156-4400-8e68-25cb6156763a None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:21:20.825906 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761fac7a-8156-4400-8e68-25cb6156763a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:21:20.844648 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-761fac7a-8156-4400-8e68-25cb6156763a None None] MFA Rules not processed for user `34b5671b702a4d369463b45fb5dbe07a`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:21:20.845872 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-761fac7a-8156-4400-8e68-25cb6156763a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:21:20.908628 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1147/2325] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:21:20 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:21:30.898548 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=25 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:22:01.630206 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5764eb4d-90de-4caa-8c78-80948397a82e None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:01.630815 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5764eb4d-90de-4caa-8c78-80948397a82e None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:01.630815 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5764eb4d-90de-4caa-8c78-80948397a82e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:01.648838 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-5764eb4d-90de-4caa-8c78-80948397a82e None None] MFA Rules not processed for user `6d13b840941349d78da243f9b4c2c72e`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:22:01.650222 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-5764eb4d-90de-4caa-8c78-80948397a82e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:22:01.713507 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1179/2326] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:22:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:22:02.973390 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2832737e-1546-4134-b89f-ddcc86b05a25 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:02.973857 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2832737e-1546-4134-b89f-ddcc86b05a25 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:02.973969 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2832737e-1546-4134-b89f-ddcc86b05a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:02.992505 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-2832737e-1546-4134-b89f-ddcc86b05a25 None None] MFA Rules not processed for user `defd27b64b204349a191a7b50b2d4cc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:22:02.994539 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-2832737e-1546-4134-b89f-ddcc86b05a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:22:03.003597 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1148/2327] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:22:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:22:11.705582 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=25 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:22:12.986158 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:22:16.936567 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5764eb4d-90de-4caa-8c78-80948397a82e None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:22:16.939101 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-5764eb4d-90de-4caa-8c78-80948397a82e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:22:17.041240 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5764eb4d-90de-4caa-8c78-80948397a82e None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:22:17.045822 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdb7d87-c534-427f-92f2-5f5fd58d1637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:22:17.046733 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb7d87-c534-427f-92f2-5f5fd58d1637 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:17.047018 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb7d87-c534-427f-92f2-5f5fd58d1637 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:17.047303 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb7d87-c534-427f-92f2-5f5fd58d1637 admin admin] PATH_INFO: `/v3/users/1c1ef56d5b9f4545865414d14f861907` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:17.048524 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdb7d87-c534-427f-92f2-5f5fd58d1637 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c1ef56d5b9f4545865414d14f861907)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:22:17.050502 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdb7d87-c534-427f-92f2-5f5fd58d1637 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:22:17.099919 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-6cdb7d87-c534-427f-92f2-5f5fd58d1637 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c1ef56d5b9f4545865414d14f861907'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:22:17.108866 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-6cdb7d87-c534-427f-92f2-5f5fd58d1637 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c1ef56d5b9f4545865414d14f861907'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:22:17.109494 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-6cdb7d87-c534-427f-92f2-5f5fd58d1637 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c1ef56d5b9f4545865414d14f861907'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:22:17.110245 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-6cdb7d87-c534-427f-92f2-5f5fd58d1637 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c1ef56d5b9f4545865414d14f861907'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:22:17.126553 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-6cdb7d87-c534-427f-92f2-5f5fd58d1637 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c1ef56d5b9f4545865414d14f861907'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:22:17.140872 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1180/2328] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:22:16 2022] DELETE /identity/v3/users/1c1ef56d5b9f4545865414d14f861907 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:22:17.321692 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2832737e-1546-4134-b89f-ddcc86b05a25 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:22:17.337447 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2832737e-1546-4134-b89f-ddcc86b05a25 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:22:17.395534 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebfe78a-4f11-4ae9-a216-4b952fb0c2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:22:17.396444 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebfe78a-4f11-4ae9-a216-4b952fb0c2c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:17.396732 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebfe78a-4f11-4ae9-a216-4b952fb0c2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:17.397004 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebfe78a-4f11-4ae9-a216-4b952fb0c2c3 admin admin] PATH_INFO: `/v3/projects/e5be1dfd2c694925a02e87630ea22eca` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:17.398515 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebfe78a-4f11-4ae9-a216-4b952fb0c2c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5be1dfd2c694925a02e87630ea22eca)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:22:17.400507 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebfe78a-4f11-4ae9-a216-4b952fb0c2c3 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:22:17.458214 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9ebfe78a-4f11-4ae9-a216-4b952fb0c2c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5be1dfd2c694925a02e87630ea22eca', 'request_id': 'req-9ebfe78a-4f11-4ae9-a216-4b952fb0c2c3'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:22:17.467189 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9ebfe78a-4f11-4ae9-a216-4b952fb0c2c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5be1dfd2c694925a02e87630ea22eca', 'request_id': 'req-9ebfe78a-4f11-4ae9-a216-4b952fb0c2c3'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:22:17.480342 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9ebfe78a-4f11-4ae9-a216-4b952fb0c2c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5be1dfd2c694925a02e87630ea22eca', 'request_id': 'req-9ebfe78a-4f11-4ae9-a216-4b952fb0c2c3'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:22:17.496920 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9ebfe78a-4f11-4ae9-a216-4b952fb0c2c3 admin admin] The token cache is being invalidate because project e5be1dfd2c694925a02e87630ea22eca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:22:17.497344 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9ebfe78a-4f11-4ae9-a216-4b952fb0c2c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:22:17.498352 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9ebfe78a-4f11-4ae9-a216-4b952fb0c2c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:22:17.500541 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1149/2329] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:22:17 2022] DELETE /identity/v3/projects/e5be1dfd2c694925a02e87630ea22eca => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:22:17.505666 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4862c4b0-d47c-4214-8fbb-c4f1eebdeca7 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:17.505958 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4862c4b0-d47c-4214-8fbb-c4f1eebdeca7 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:17.506237 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4862c4b0-d47c-4214-8fbb-c4f1eebdeca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:17.564381 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-4862c4b0-d47c-4214-8fbb-c4f1eebdeca7 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:22:17.565575 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-4862c4b0-d47c-4214-8fbb-c4f1eebdeca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:22:17.621233 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:22:17.638912 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1181/2330] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:22:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:22:17.646899 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c0bc3-cba3-4181-b9c6-73476105982f None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:17.647189 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c0bc3-cba3-4181-b9c6-73476105982f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:17.647463 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c0bc3-cba3-4181-b9c6-73476105982f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:17.666433 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-ac3c0bc3-cba3-4181-b9c6-73476105982f None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:22:17.667632 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ac3c0bc3-cba3-4181-b9c6-73476105982f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:22:17.676771 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1150/2331] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:22:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:22:17.681741 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4862c4b0-d47c-4214-8fbb-c4f1eebdeca7 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:22:17.691958 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4862c4b0-d47c-4214-8fbb-c4f1eebdeca7 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:22:17.697634 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbc96c6-51b1-47d2-ac2a-98d5cff412f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:22:17.698290 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc96c6-51b1-47d2-ac2a-98d5cff412f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:17.698575 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc96c6-51b1-47d2-ac2a-98d5cff412f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:17.698847 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc96c6-51b1-47d2-ac2a-98d5cff412f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:17.699581 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbc96c6-51b1-47d2-ac2a-98d5cff412f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:22:17.699897 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbc96c6-51b1-47d2-ac2a-98d5cff412f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:22:17.701514 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbc96c6-51b1-47d2-ac2a-98d5cff412f3 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:22:17.713595 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1182/2332] 10.222.0.42 () {58 vars in 1152 bytes} [Mon Jul 4 09:22:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:22:17.717884 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c0bc3-cba3-4181-b9c6-73476105982f None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:22:17.727764 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c0bc3-cba3-4181-b9c6-73476105982f None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:22:17.732556 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d035808-7c1e-4c5b-8d02-bc4c2cc0cc9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:22:17.733215 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d035808-7c1e-4c5b-8d02-bc4c2cc0cc9d admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:17.733493 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d035808-7c1e-4c5b-8d02-bc4c2cc0cc9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:17.733766 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d035808-7c1e-4c5b-8d02-bc4c2cc0cc9d admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:17.734537 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d035808-7c1e-4c5b-8d02-bc4c2cc0cc9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:22:17.736527 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d035808-7c1e-4c5b-8d02-bc4c2cc0cc9d admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:22:17.764458 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1151/2333] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:22:17 2022] POST /identity/v3/projects => generated 403 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:22:17.768841 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbc96c6-51b1-47d2-ac2a-98d5cff412f3 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:22:17.779342 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbc96c6-51b1-47d2-ac2a-98d5cff412f3 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:22:17.839219 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebdcae1-0362-4837-9790-c034f759a6f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:22:17.840004 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebdcae1-0362-4837-9790-c034f759a6f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:17.840292 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebdcae1-0362-4837-9790-c034f759a6f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:17.840569 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebdcae1-0362-4837-9790-c034f759a6f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:17.841413 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebdcae1-0362-4837-9790-c034f759a6f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:22:17.843371 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebdcae1-0362-4837-9790-c034f759a6f2 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:22:17.865467 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1183/2334] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:22:17 2022] POST /identity/v3/users => generated 302 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:22:17.868875 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d035808-7c1e-4c5b-8d02-bc4c2cc0cc9d admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:22:17.881531 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d035808-7c1e-4c5b-8d02-bc4c2cc0cc9d admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:22:17.887050 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918be505-b1bc-4d7b-83a5-010d594c7fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:22:17.892510 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918be505-b1bc-4d7b-83a5-010d594c7fb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:17.892818 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918be505-b1bc-4d7b-83a5-010d594c7fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:17.893099 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918be505-b1bc-4d7b-83a5-010d594c7fb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:17.893867 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918be505-b1bc-4d7b-83a5-010d594c7fb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:22:17.895571 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918be505-b1bc-4d7b-83a5-010d594c7fb4 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:22:17.906969 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1152/2335] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:22:17 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:22:17.910979 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebdcae1-0362-4837-9790-c034f759a6f2 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:22:17.922019 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebdcae1-0362-4837-9790-c034f759a6f2 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:22:17.926655 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5e87cb-0d4e-4f00-b475-c996e2f0393f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:22:17.927313 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e87cb-0d4e-4f00-b475-c996e2f0393f admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:17.927616 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e87cb-0d4e-4f00-b475-c996e2f0393f admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:17.927916 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e87cb-0d4e-4f00-b475-c996e2f0393f admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:17.928672 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5e87cb-0d4e-4f00-b475-c996e2f0393f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:22:17.930264 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5e87cb-0d4e-4f00-b475-c996e2f0393f admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:22:17.940229 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1184/2336] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:22:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:22:17.944555 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918be505-b1bc-4d7b-83a5-010d594c7fb4 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:22:17.955075 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918be505-b1bc-4d7b-83a5-010d594c7fb4 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:22:17.959950 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0885e98-3b13-457a-8358-94ce111bb6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:22:17.960824 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0885e98-3b13-457a-8358-94ce111bb6c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:17.961104 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0885e98-3b13-457a-8358-94ce111bb6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:17.961378 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0885e98-3b13-457a-8358-94ce111bb6c9 admin admin] PATH_INFO: `/v3/projects/94634701dbbb4f878c746bee8565c0c5/users/a41c6bff9627491ea4f96aa0f06a473e/roles/81634e7812344f84afcb29b0dba2687c` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:17.976805 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0885e98-3b13-457a-8358-94ce111bb6c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94634701dbbb4f878c746bee8565c0c5, user_id=a41c6bff9627491ea4f96aa0f06a473e, role_id=81634e7812344f84afcb29b0dba2687c)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:22:17.979467 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0885e98-3b13-457a-8358-94ce111bb6c9 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:22:17.995002 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1153/2337] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:22:17 2022] PUT /identity/v3/projects/94634701dbbb4f878c746bee8565c0c5/users/a41c6bff9627491ea4f96aa0f06a473e/roles/81634e7812344f84afcb29b0dba2687c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:22:18.006641 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eff6144-d00a-4e5e-b9d9-d0d28c1ca9de None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:18.006934 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eff6144-d00a-4e5e-b9d9-d0d28c1ca9de None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:18.007211 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eff6144-d00a-4e5e-b9d9-d0d28c1ca9de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:18.035303 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-7eff6144-d00a-4e5e-b9d9-d0d28c1ca9de None None] MFA Rules not processed for user `a41c6bff9627491ea4f96aa0f06a473e`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:22:18.036593 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-7eff6144-d00a-4e5e-b9d9-d0d28c1ca9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:22:18.105228 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1185/2338] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:22:18 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:22:18.110026 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0885e98-3b13-457a-8358-94ce111bb6c9 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:22:18.141179 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:22:18.178360 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0885e98-3b13-457a-8358-94ce111bb6c9 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:22:18.184302 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4f160b-2d3c-4761-8eb9-30f574886ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:22:18.184954 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f160b-2d3c-4761-8eb9-30f574886ae0 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:18.185232 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f160b-2d3c-4761-8eb9-30f574886ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:18.185499 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f160b-2d3c-4761-8eb9-30f574886ae0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:18.186162 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4f160b-2d3c-4761-8eb9-30f574886ae0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:22:18.188130 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4f160b-2d3c-4761-8eb9-30f574886ae0 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:22:18.215078 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1154/2339] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:22:18 2022] POST /identity/v3/projects => generated 403 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:22:18.219458 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eff6144-d00a-4e5e-b9d9-d0d28c1ca9de None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:22:18.231449 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eff6144-d00a-4e5e-b9d9-d0d28c1ca9de None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:22:18.275595 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:22:18.294041 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fedd34b-cbf5-4dad-90f6-e8297587fc6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:22:18.294814 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fedd34b-cbf5-4dad-90f6-e8297587fc6a admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:18.295106 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fedd34b-cbf5-4dad-90f6-e8297587fc6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:18.295397 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fedd34b-cbf5-4dad-90f6-e8297587fc6a admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:18.296194 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fedd34b-cbf5-4dad-90f6-e8297587fc6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:22:18.298188 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fedd34b-cbf5-4dad-90f6-e8297587fc6a admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:22:18.325419 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1186/2340] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:22:18 2022] POST /identity/v3/users => generated 308 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:22:18.329652 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4f160b-2d3c-4761-8eb9-30f574886ae0 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:22:18.340881 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4f160b-2d3c-4761-8eb9-30f574886ae0 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:22:18.345624 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a39815-ff1b-469e-a802-7327bdafcbc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:22:18.346603 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a39815-ff1b-469e-a802-7327bdafcbc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:18.346882 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a39815-ff1b-469e-a802-7327bdafcbc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:18.347150 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a39815-ff1b-469e-a802-7327bdafcbc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:18.347888 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a39815-ff1b-469e-a802-7327bdafcbc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:22:18.349626 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a39815-ff1b-469e-a802-7327bdafcbc7 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:22:18.363098 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1155/2341] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:22:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:22:18.366852 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fedd34b-cbf5-4dad-90f6-e8297587fc6a admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:22:18.379170 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fedd34b-cbf5-4dad-90f6-e8297587fc6a admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:22:18.384855 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8a43c4-6896-40ae-a970-3ec828891c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:22:18.386020 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a43c4-6896-40ae-a970-3ec828891c55 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:18.386311 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a43c4-6896-40ae-a970-3ec828891c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:18.387003 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a43c4-6896-40ae-a970-3ec828891c55 admin admin] PATH_INFO: `/v3/projects/560cfc1c892d4883a1e4d9662ddb4aeb/users/cb99b8ccd8714a59b6b84ef903c33b9a/roles/965049e7ce6144aaad23c15f3a5e37c3` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:18.405653 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8a43c4-6896-40ae-a970-3ec828891c55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=560cfc1c892d4883a1e4d9662ddb4aeb, user_id=cb99b8ccd8714a59b6b84ef903c33b9a, role_id=965049e7ce6144aaad23c15f3a5e37c3)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:22:18.408415 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8a43c4-6896-40ae-a970-3ec828891c55 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:22:18.426992 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1187/2342] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:22:18 2022] PUT /identity/v3/projects/560cfc1c892d4883a1e4d9662ddb4aeb/users/cb99b8ccd8714a59b6b84ef903c33b9a/roles/965049e7ce6144aaad23c15f3a5e37c3 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:22:18.428722 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a39815-ff1b-469e-a802-7327bdafcbc7 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:22:18.439535 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a39815-ff1b-469e-a802-7327bdafcbc7 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:22:18.505996 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4e498e-aa48-4602-bf43-b07c76166d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:22:18.506673 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e498e-aa48-4602-bf43-b07c76166d46 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:18.506958 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e498e-aa48-4602-bf43-b07c76166d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:18.507231 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e498e-aa48-4602-bf43-b07c76166d46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:18.507993 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4e498e-aa48-4602-bf43-b07c76166d46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:22:18.509614 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4e498e-aa48-4602-bf43-b07c76166d46 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:22:18.525247 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1156/2343] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:22:18 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:22:18.526471 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8a43c4-6896-40ae-a970-3ec828891c55 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:22:18.537354 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8a43c4-6896-40ae-a970-3ec828891c55 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:22:18.542438 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62498a5-68e2-440b-9b8b-b74cde8d093a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:22:18.542916 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62498a5-68e2-440b-9b8b-b74cde8d093a admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:18.543201 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62498a5-68e2-440b-9b8b-b74cde8d093a admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:18.543481 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62498a5-68e2-440b-9b8b-b74cde8d093a admin admin] PATH_INFO: `/v3/projects/560cfc1c892d4883a1e4d9662ddb4aeb/users/cb99b8ccd8714a59b6b84ef903c33b9a/roles/965049e7ce6144aaad23c15f3a5e37c3` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:18.545487 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62498a5-68e2-440b-9b8b-b74cde8d093a admin admin] RBAC: Authorizing `identity:create_grant(project_id=560cfc1c892d4883a1e4d9662ddb4aeb, user_id=cb99b8ccd8714a59b6b84ef903c33b9a, role_id=965049e7ce6144aaad23c15f3a5e37c3)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:22:18.548240 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62498a5-68e2-440b-9b8b-b74cde8d093a admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:22:18.559184 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1188/2344] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:22:18 2022] PUT /identity/v3/projects/560cfc1c892d4883a1e4d9662ddb4aeb/users/cb99b8ccd8714a59b6b84ef903c33b9a/roles/965049e7ce6144aaad23c15f3a5e37c3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:22:18.569815 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e2863-2613-4880-a450-089898091f64 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:18.570113 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e2863-2613-4880-a450-089898091f64 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:18.570441 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e2863-2613-4880-a450-089898091f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:18.607484 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-159e2863-2613-4880-a450-089898091f64 None None] MFA Rules not processed for user `cb99b8ccd8714a59b6b84ef903c33b9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:22:18.608740 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-159e2863-2613-4880-a450-089898091f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:22:18.698972 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1157/2345] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:22:18 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:22:18.710612 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62498a5-68e2-440b-9b8b-b74cde8d093a admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:22:18.712471 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-f62498a5-68e2-440b-9b8b-b74cde8d093a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:22:18.801400 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62498a5-68e2-440b-9b8b-b74cde8d093a admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:22:18.805353 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1de32fe-671a-4bf6-895b-a71bb5efe5a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f86373d65440da97c853fff3c1d0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:22:18.806006 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de32fe-671a-4bf6-895b-a71bb5efe5a2 service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:18.806287 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de32fe-671a-4bf6-895b-a71bb5efe5a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:18.806560 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de32fe-671a-4bf6-895b-a71bb5efe5a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:18.816186 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1de32fe-671a-4bf6-895b-a71bb5efe5a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:22:18.817667 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1de32fe-671a-4bf6-895b-a71bb5efe5a2 service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:22:18.827896 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1189/2346] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:22:18 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:22:18.977533 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e2863-2613-4880-a450-089898091f64 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:22:19.008685 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:22:19.046536 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e2863-2613-4880-a450-089898091f64 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:22:19.051569 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9610a7a8-88e8-4e17-acf9-e8db1ae29555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:22:19.052477 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9610a7a8-88e8-4e17-acf9-e8db1ae29555 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:19.052757 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9610a7a8-88e8-4e17-acf9-e8db1ae29555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:19.053010 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9610a7a8-88e8-4e17-acf9-e8db1ae29555 admin admin] PATH_INFO: `/v3/users/a41c6bff9627491ea4f96aa0f06a473e` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:19.054241 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9610a7a8-88e8-4e17-acf9-e8db1ae29555 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a41c6bff9627491ea4f96aa0f06a473e)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:22:19.056242 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9610a7a8-88e8-4e17-acf9-e8db1ae29555 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:22:19.104264 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9610a7a8-88e8-4e17-acf9-e8db1ae29555 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a41c6bff9627491ea4f96aa0f06a473e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:22:19.104915 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9610a7a8-88e8-4e17-acf9-e8db1ae29555 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a41c6bff9627491ea4f96aa0f06a473e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:22:19.113804 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9610a7a8-88e8-4e17-acf9-e8db1ae29555 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a41c6bff9627491ea4f96aa0f06a473e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:22:19.114413 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9610a7a8-88e8-4e17-acf9-e8db1ae29555 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a41c6bff9627491ea4f96aa0f06a473e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:22:19.133321 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9610a7a8-88e8-4e17-acf9-e8db1ae29555 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a41c6bff9627491ea4f96aa0f06a473e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:22:19.147063 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1158/2347] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:22:18 2022] DELETE /identity/v3/users/a41c6bff9627491ea4f96aa0f06a473e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:22:19.151758 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70810256-9b98-4747-8821-0e2ac5378901 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:19.152275 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70810256-9b98-4747-8821-0e2ac5378901 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:19.152371 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70810256-9b98-4747-8821-0e2ac5378901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:19.169683 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-70810256-9b98-4747-8821-0e2ac5378901 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:22:19.170898 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-70810256-9b98-4747-8821-0e2ac5378901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:22:19.233088 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1190/2348] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:22:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:22:19.243455 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9610a7a8-88e8-4e17-acf9-e8db1ae29555 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:22:19.245104 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9610a7a8-88e8-4e17-acf9-e8db1ae29555 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:22:19.319075 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9610a7a8-88e8-4e17-acf9-e8db1ae29555 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:22:19.323349 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b68277-c224-4680-822e-25d9eb7c5d59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:22:19.324038 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b68277-c224-4680-822e-25d9eb7c5d59 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:19.324291 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b68277-c224-4680-822e-25d9eb7c5d59 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:19.324598 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b68277-c224-4680-822e-25d9eb7c5d59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:19.335577 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b68277-c224-4680-822e-25d9eb7c5d59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:22:19.337587 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b68277-c224-4680-822e-25d9eb7c5d59 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:22:19.353494 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1159/2349] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:22:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:22:19.634496 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70810256-9b98-4747-8821-0e2ac5378901 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:22:19.636237 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-70810256-9b98-4747-8821-0e2ac5378901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:22:19.650073 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70810256-9b98-4747-8821-0e2ac5378901 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:22:19.656617 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde8129d-5b73-4af2-8a85-dfa7ecdd5924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:22:19.657984 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8129d-5b73-4af2-8a85-dfa7ecdd5924 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:19.657984 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8129d-5b73-4af2-8a85-dfa7ecdd5924 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:19.658177 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8129d-5b73-4af2-8a85-dfa7ecdd5924 admin admin] PATH_INFO: `/v3/projects/94634701dbbb4f878c746bee8565c0c5` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:19.659379 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde8129d-5b73-4af2-8a85-dfa7ecdd5924 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94634701dbbb4f878c746bee8565c0c5)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:22:19.661398 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde8129d-5b73-4af2-8a85-dfa7ecdd5924 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:22:19.679706 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:22:19.724277 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-cde8129d-5b73-4af2-8a85-dfa7ecdd5924 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94634701dbbb4f878c746bee8565c0c5', 'request_id': 'req-cde8129d-5b73-4af2-8a85-dfa7ecdd5924'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:22:19.735447 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-cde8129d-5b73-4af2-8a85-dfa7ecdd5924 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94634701dbbb4f878c746bee8565c0c5', 'request_id': 'req-cde8129d-5b73-4af2-8a85-dfa7ecdd5924'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:22:19.742469 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-cde8129d-5b73-4af2-8a85-dfa7ecdd5924 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94634701dbbb4f878c746bee8565c0c5', 'request_id': 'req-cde8129d-5b73-4af2-8a85-dfa7ecdd5924'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:22:19.755300 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-cde8129d-5b73-4af2-8a85-dfa7ecdd5924 admin admin] The token cache is being invalidate because project 94634701dbbb4f878c746bee8565c0c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:22:19.755582 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-cde8129d-5b73-4af2-8a85-dfa7ecdd5924 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:22:19.756248 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-cde8129d-5b73-4af2-8a85-dfa7ecdd5924 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:22:19.758048 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1191/2350] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:22:19 2022] DELETE /identity/v3/projects/94634701dbbb4f878c746bee8565c0c5 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:22:19.761831 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b68277-c224-4680-822e-25d9eb7c5d59 service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:22:19.774543 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b68277-c224-4680-822e-25d9eb7c5d59 service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:22:19.816158 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:22:19.832413 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e251965-8125-42ff-b702-9eb50221bcab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:22:19.833482 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e251965-8125-42ff-b702-9eb50221bcab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:19.833778 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e251965-8125-42ff-b702-9eb50221bcab admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:19.834050 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e251965-8125-42ff-b702-9eb50221bcab admin admin] PATH_INFO: `/v3/users/cb99b8ccd8714a59b6b84ef903c33b9a` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:19.835289 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e251965-8125-42ff-b702-9eb50221bcab admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb99b8ccd8714a59b6b84ef903c33b9a)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:22:19.837294 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e251965-8125-42ff-b702-9eb50221bcab admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:22:19.900075 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-6e251965-8125-42ff-b702-9eb50221bcab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb99b8ccd8714a59b6b84ef903c33b9a'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:22:19.901007 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-6e251965-8125-42ff-b702-9eb50221bcab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb99b8ccd8714a59b6b84ef903c33b9a'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:22:19.910647 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-6e251965-8125-42ff-b702-9eb50221bcab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb99b8ccd8714a59b6b84ef903c33b9a'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:22:19.911627 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-6e251965-8125-42ff-b702-9eb50221bcab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb99b8ccd8714a59b6b84ef903c33b9a'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:22:19.930151 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-6e251965-8125-42ff-b702-9eb50221bcab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb99b8ccd8714a59b6b84ef903c33b9a'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:22:19.943619 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1160/2351] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:22:19 2022] DELETE /identity/v3/users/cb99b8ccd8714a59b6b84ef903c33b9a => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:22:20.237528 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde8129d-5b73-4af2-8a85-dfa7ecdd5924 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:22:20.239039 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-cde8129d-5b73-4af2-8a85-dfa7ecdd5924 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:22:20.252433 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde8129d-5b73-4af2-8a85-dfa7ecdd5924 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:22:20.347592 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c2fa0-d2b8-4a1c-a400-8fd7a5940f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:22:20.348643 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c2fa0-d2b8-4a1c-a400-8fd7a5940f25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:20.348928 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c2fa0-d2b8-4a1c-a400-8fd7a5940f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:20.349218 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c2fa0-d2b8-4a1c-a400-8fd7a5940f25 admin admin] PATH_INFO: `/v3/projects/560cfc1c892d4883a1e4d9662ddb4aeb` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:20.350472 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64c2fa0-d2b8-4a1c-a400-8fd7a5940f25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=560cfc1c892d4883a1e4d9662ddb4aeb)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:22:20.352632 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64c2fa0-d2b8-4a1c-a400-8fd7a5940f25 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:22:20.430102 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-b64c2fa0-d2b8-4a1c-a400-8fd7a5940f25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '560cfc1c892d4883a1e4d9662ddb4aeb', 'request_id': 'req-b64c2fa0-d2b8-4a1c-a400-8fd7a5940f25'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:22:20.444216 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-b64c2fa0-d2b8-4a1c-a400-8fd7a5940f25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '560cfc1c892d4883a1e4d9662ddb4aeb', 'request_id': 'req-b64c2fa0-d2b8-4a1c-a400-8fd7a5940f25'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:22:20.455848 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-b64c2fa0-d2b8-4a1c-a400-8fd7a5940f25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '560cfc1c892d4883a1e4d9662ddb4aeb', 'request_id': 'req-b64c2fa0-d2b8-4a1c-a400-8fd7a5940f25'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:22:20.471233 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-b64c2fa0-d2b8-4a1c-a400-8fd7a5940f25 admin admin] The token cache is being invalidate because project 560cfc1c892d4883a1e4d9662ddb4aeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:22:20.471518 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-b64c2fa0-d2b8-4a1c-a400-8fd7a5940f25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:22:20.472224 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-b64c2fa0-d2b8-4a1c-a400-8fd7a5940f25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:22:20.473851 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1192/2352] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:22:20 2022] DELETE /identity/v3/projects/560cfc1c892d4883a1e4d9662ddb4aeb => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:22:20.478853 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5fb94-22a0-4225-9ca5-433662aad450 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:20.479399 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5fb94-22a0-4225-9ca5-433662aad450 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:20.479528 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5fb94-22a0-4225-9ca5-433662aad450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:20.501263 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-cfd5fb94-22a0-4225-9ca5-433662aad450 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:22:20.502648 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-cfd5fb94-22a0-4225-9ca5-433662aad450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:22:20.567782 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1161/2353] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:22:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:22:20.575543 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20977f85-cfd9-424a-b26a-91c52b6dad5e None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:20.575853 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20977f85-cfd9-424a-b26a-91c52b6dad5e None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:20.576168 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20977f85-cfd9-424a-b26a-91c52b6dad5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:20.606951 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-20977f85-cfd9-424a-b26a-91c52b6dad5e None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:22:20.608943 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-20977f85-cfd9-424a-b26a-91c52b6dad5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:22:20.616942 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1193/2354] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:22:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:22:20.623681 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd5fb94-22a0-4225-9ca5-433662aad450 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:22:20.632249 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd5fb94-22a0-4225-9ca5-433662aad450 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:22:20.638914 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c53b8f-497c-4c22-9677-1f793fca0847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:22:20.639561 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c53b8f-497c-4c22-9677-1f793fca0847 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:20.640366 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c53b8f-497c-4c22-9677-1f793fca0847 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:20.640366 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c53b8f-497c-4c22-9677-1f793fca0847 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:20.641222 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c53b8f-497c-4c22-9677-1f793fca0847 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:22:20.641535 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c53b8f-497c-4c22-9677-1f793fca0847 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:22:20.643232 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c53b8f-497c-4c22-9677-1f793fca0847 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:22:20.661481 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20977f85-cfd9-424a-b26a-91c52b6dad5e None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:22:20.667397 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1162/2355] 10.222.0.42 () {58 vars in 1152 bytes} [Mon Jul 4 09:22:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:22:20.671536 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20977f85-cfd9-424a-b26a-91c52b6dad5e None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:22:20.677284 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853cde40-68fa-47a0-8333-0a816f856a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:22:20.677997 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853cde40-68fa-47a0-8333-0a816f856a36 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:20.678381 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853cde40-68fa-47a0-8333-0a816f856a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:20.678754 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853cde40-68fa-47a0-8333-0a816f856a36 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:20.679584 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853cde40-68fa-47a0-8333-0a816f856a36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:22:20.681670 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853cde40-68fa-47a0-8333-0a816f856a36 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:22:20.713225 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1194/2356] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:22:20 2022] POST /identity/v3/projects => generated 401 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:22:20.717516 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c53b8f-497c-4c22-9677-1f793fca0847 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:22:20.729557 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c53b8f-497c-4c22-9677-1f793fca0847 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:22:20.789285 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:22:20.807054 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557421a4-de3f-43a9-a63e-962322d70556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:22:20.807887 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557421a4-de3f-43a9-a63e-962322d70556 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:20.808476 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557421a4-de3f-43a9-a63e-962322d70556 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:20.808777 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557421a4-de3f-43a9-a63e-962322d70556 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:20.809599 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557421a4-de3f-43a9-a63e-962322d70556 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:22:20.811577 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557421a4-de3f-43a9-a63e-962322d70556 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:22:20.834681 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1163/2357] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:22:20 2022] POST /identity/v3/users => generated 301 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:22:20.838821 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853cde40-68fa-47a0-8333-0a816f856a36 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:22:20.847186 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:22:20.851312 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853cde40-68fa-47a0-8333-0a816f856a36 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:22:20.858187 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6df39c2-cc66-4401-94f7-ba12eeb4eadb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:22:20.859369 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df39c2-cc66-4401-94f7-ba12eeb4eadb admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:20.860314 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df39c2-cc66-4401-94f7-ba12eeb4eadb admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:20.861025 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df39c2-cc66-4401-94f7-ba12eeb4eadb admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:20.862284 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6df39c2-cc66-4401-94f7-ba12eeb4eadb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:22:20.864299 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6df39c2-cc66-4401-94f7-ba12eeb4eadb admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:22:20.876517 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1195/2358] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:22:20 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:22:20.886309 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557421a4-de3f-43a9-a63e-962322d70556 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:22:20.904343 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557421a4-de3f-43a9-a63e-962322d70556 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:22:20.909826 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5d09e5-7898-4696-a494-5d04ef200b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:22:20.910579 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d09e5-7898-4696-a494-5d04ef200b4a admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:20.911017 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d09e5-7898-4696-a494-5d04ef200b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:20.911360 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d09e5-7898-4696-a494-5d04ef200b4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:20.912218 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5d09e5-7898-4696-a494-5d04ef200b4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:22:20.913993 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5d09e5-7898-4696-a494-5d04ef200b4a admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:22:20.924715 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1164/2359] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:22:20 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:22:20.929612 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6df39c2-cc66-4401-94f7-ba12eeb4eadb admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:22:20.939603 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6df39c2-cc66-4401-94f7-ba12eeb4eadb admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:22:20.944244 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de8ee92-5e8f-48c9-afb6-d16fc32ce710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:22:20.945129 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de8ee92-5e8f-48c9-afb6-d16fc32ce710 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:20.945415 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de8ee92-5e8f-48c9-afb6-d16fc32ce710 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:20.945687 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de8ee92-5e8f-48c9-afb6-d16fc32ce710 admin admin] PATH_INFO: `/v3/projects/ff9b5fa1c46944888c6924b4256e83aa/users/03f1765746424c188eeb2543a265df83/roles/81634e7812344f84afcb29b0dba2687c` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:20.960866 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de8ee92-5e8f-48c9-afb6-d16fc32ce710 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff9b5fa1c46944888c6924b4256e83aa, user_id=03f1765746424c188eeb2543a265df83, role_id=81634e7812344f84afcb29b0dba2687c)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:22:20.963586 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de8ee92-5e8f-48c9-afb6-d16fc32ce710 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:22:20.979739 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1196/2360] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:22:20 2022] PUT /identity/v3/projects/ff9b5fa1c46944888c6924b4256e83aa/users/03f1765746424c188eeb2543a265df83/roles/81634e7812344f84afcb29b0dba2687c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:22:20.984819 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c26be-bf96-4bcb-ad39-e37d8869b7e2 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:20.985111 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c26be-bf96-4bcb-ad39-e37d8869b7e2 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:20.985387 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c26be-bf96-4bcb-ad39-e37d8869b7e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:21.004724 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-ac7c26be-bf96-4bcb-ad39-e37d8869b7e2 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:22:21.005956 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ac7c26be-bf96-4bcb-ad39-e37d8869b7e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:22:21.068469 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1165/2361] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:22:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:22:21.078292 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de8ee92-5e8f-48c9-afb6-d16fc32ce710 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:22:21.080078 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-8de8ee92-5e8f-48c9-afb6-d16fc32ce710 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:22:21.141900 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de8ee92-5e8f-48c9-afb6-d16fc32ce710 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:22:21.146530 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9985a388-d7f7-4527-8309-1015afb57b7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:22:21.147183 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9985a388-d7f7-4527-8309-1015afb57b7b service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:21.147465 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9985a388-d7f7-4527-8309-1015afb57b7b service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:21.147740 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9985a388-d7f7-4527-8309-1015afb57b7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:21.159052 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9985a388-d7f7-4527-8309-1015afb57b7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:22:21.160553 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9985a388-d7f7-4527-8309-1015afb57b7b service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:22:21.170232 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1197/2362] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:22:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:22:21.892870 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e55984e-74c6-46c8-99c3-1ebf030125f3 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:21.893389 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e55984e-74c6-46c8-99c3-1ebf030125f3 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:21.893549 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e55984e-74c6-46c8-99c3-1ebf030125f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:21.927254 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-9e55984e-74c6-46c8-99c3-1ebf030125f3 None None] MFA Rules not processed for user `03f1765746424c188eeb2543a265df83`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:22:21.928654 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9e55984e-74c6-46c8-99c3-1ebf030125f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:22:22.005886 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1166/2363] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:22:21 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:22:22.009922 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9985a388-d7f7-4527-8309-1015afb57b7b service neutron] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:22:22.020330 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9985a388-d7f7-4527-8309-1015afb57b7b service neutron] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:22:22.025688 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fce347-bdce-4709-8168-6945819df40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:22:22.026459 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fce347-bdce-4709-8168-6945819df40a admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:22.026808 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fce347-bdce-4709-8168-6945819df40a admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:22.027159 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fce347-bdce-4709-8168-6945819df40a admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:22.027960 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fce347-bdce-4709-8168-6945819df40a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:22:22.029966 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fce347-bdce-4709-8168-6945819df40a admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:22:22.064323 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1198/2364] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:22:22 2022] POST /identity/v3/projects => generated 405 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:22:22.065477 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e55984e-74c6-46c8-99c3-1ebf030125f3 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:22:22.077118 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e55984e-74c6-46c8-99c3-1ebf030125f3 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:22:22.144475 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcc6d75-00e6-401e-a4da-27b6cba108fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:22:22.145177 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc6d75-00e6-401e-a4da-27b6cba108fa admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:22.145554 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc6d75-00e6-401e-a4da-27b6cba108fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:22.145816 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc6d75-00e6-401e-a4da-27b6cba108fa admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:22.146624 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcc6d75-00e6-401e-a4da-27b6cba108fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:22:22.148653 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcc6d75-00e6-401e-a4da-27b6cba108fa admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:22:22.155374 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:22:22.171372 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1167/2365] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:22:22 2022] POST /identity/v3/users => generated 309 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:22:22.175470 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fce347-bdce-4709-8168-6945819df40a admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:22:22.185995 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fce347-bdce-4709-8168-6945819df40a admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:22:22.190854 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dfe7c7-bbf1-4013-99b3-04403670b7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:22:22.191518 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dfe7c7-bbf1-4013-99b3-04403670b7d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:22.191809 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dfe7c7-bbf1-4013-99b3-04403670b7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:22.192274 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dfe7c7-bbf1-4013-99b3-04403670b7d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:22.193017 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dfe7c7-bbf1-4013-99b3-04403670b7d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:22:22.194670 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dfe7c7-bbf1-4013-99b3-04403670b7d8 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:22:22.205434 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1199/2366] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:22:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:22:22.209980 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcc6d75-00e6-401e-a4da-27b6cba108fa admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:22:22.220738 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcc6d75-00e6-401e-a4da-27b6cba108fa admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:22:22.226953 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7be208-2879-4041-9150-c5bc286e98b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:22:22.227856 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7be208-2879-4041-9150-c5bc286e98b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:22.228170 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7be208-2879-4041-9150-c5bc286e98b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:22.228449 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7be208-2879-4041-9150-c5bc286e98b3 admin admin] PATH_INFO: `/v3/projects/1b6bef5e41fd40ac834ec9cc84c36838/users/83618fb4c5f14eb48cec6191594065a6/roles/965049e7ce6144aaad23c15f3a5e37c3` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:22.245059 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7be208-2879-4041-9150-c5bc286e98b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b6bef5e41fd40ac834ec9cc84c36838, user_id=83618fb4c5f14eb48cec6191594065a6, role_id=965049e7ce6144aaad23c15f3a5e37c3)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:22:22.247849 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7be208-2879-4041-9150-c5bc286e98b3 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:22:22.263797 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1168/2367] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:22:22 2022] PUT /identity/v3/projects/1b6bef5e41fd40ac834ec9cc84c36838/users/83618fb4c5f14eb48cec6191594065a6/roles/965049e7ce6144aaad23c15f3a5e37c3 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:22:22.267964 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dfe7c7-bbf1-4013-99b3-04403670b7d8 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:22:22.278913 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dfe7c7-bbf1-4013-99b3-04403670b7d8 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:22:22.339217 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956c8bcf-6e7f-4331-bcfc-5f745580e067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:22:22.340117 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c8bcf-6e7f-4331-bcfc-5f745580e067 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:22.340509 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c8bcf-6e7f-4331-bcfc-5f745580e067 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:22.340883 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c8bcf-6e7f-4331-bcfc-5f745580e067 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:22.341731 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956c8bcf-6e7f-4331-bcfc-5f745580e067 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:22:22.343492 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956c8bcf-6e7f-4331-bcfc-5f745580e067 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:22:22.355541 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1200/2368] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:22:22 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:22:22.359844 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7be208-2879-4041-9150-c5bc286e98b3 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:22:22.370862 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7be208-2879-4041-9150-c5bc286e98b3 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:22:22.376577 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b57afc-0817-4732-b99c-67ae4ec24ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:22:22.377469 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b57afc-0817-4732-b99c-67ae4ec24ac1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:22.377748 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b57afc-0817-4732-b99c-67ae4ec24ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:22.378021 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b57afc-0817-4732-b99c-67ae4ec24ac1 admin admin] PATH_INFO: `/v3/projects/1b6bef5e41fd40ac834ec9cc84c36838/users/83618fb4c5f14eb48cec6191594065a6/roles/965049e7ce6144aaad23c15f3a5e37c3` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:22.380279 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b57afc-0817-4732-b99c-67ae4ec24ac1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b6bef5e41fd40ac834ec9cc84c36838, user_id=83618fb4c5f14eb48cec6191594065a6, role_id=965049e7ce6144aaad23c15f3a5e37c3)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:22:22.383051 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b57afc-0817-4732-b99c-67ae4ec24ac1 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:22:22.394404 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1169/2369] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:22:22 2022] PUT /identity/v3/projects/1b6bef5e41fd40ac834ec9cc84c36838/users/83618fb4c5f14eb48cec6191594065a6/roles/965049e7ce6144aaad23c15f3a5e37c3 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:22:23.059707 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f835958-9164-4450-9077-bcf4c61244d8 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:23.060454 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f835958-9164-4450-9077-bcf4c61244d8 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:23.060745 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f835958-9164-4450-9077-bcf4c61244d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:23.106417 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-9f835958-9164-4450-9077-bcf4c61244d8 None None] MFA Rules not processed for user `83618fb4c5f14eb48cec6191594065a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:22:23.108182 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-9f835958-9164-4450-9077-bcf4c61244d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:22:23.154502 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:22:23.204226 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1201/2370] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:22:23 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:22:24.305795 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b57afc-0817-4732-b99c-67ae4ec24ac1 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:22:24.371524 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b57afc-0817-4732-b99c-67ae4ec24ac1 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:22:24.376526 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531606c6-d62d-43f9-ba01-8f5add3c83fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:22:24.377414 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531606c6-d62d-43f9-ba01-8f5add3c83fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:24.377677 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531606c6-d62d-43f9-ba01-8f5add3c83fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:24.377968 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531606c6-d62d-43f9-ba01-8f5add3c83fb admin admin] PATH_INFO: `/v3/users/03f1765746424c188eeb2543a265df83` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:24.379231 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531606c6-d62d-43f9-ba01-8f5add3c83fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=03f1765746424c188eeb2543a265df83)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:22:24.381391 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531606c6-d62d-43f9-ba01-8f5add3c83fb admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:22:24.432834 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-531606c6-d62d-43f9-ba01-8f5add3c83fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03f1765746424c188eeb2543a265df83'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:22:24.433589 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-531606c6-d62d-43f9-ba01-8f5add3c83fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03f1765746424c188eeb2543a265df83'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:22:24.442944 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-531606c6-d62d-43f9-ba01-8f5add3c83fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03f1765746424c188eeb2543a265df83'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:22:24.443552 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-531606c6-d62d-43f9-ba01-8f5add3c83fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03f1765746424c188eeb2543a265df83'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:22:24.457950 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-531606c6-d62d-43f9-ba01-8f5add3c83fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03f1765746424c188eeb2543a265df83'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:22:24.473343 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1170/2371] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:22:24 2022] DELETE /identity/v3/users/03f1765746424c188eeb2543a265df83 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:22:24.661364 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f835958-9164-4450-9077-bcf4c61244d8 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:22:24.674530 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f835958-9164-4450-9077-bcf4c61244d8 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:22:24.737551 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9615f5-938e-44c9-aced-ea7d32327dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:22:24.738373 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9615f5-938e-44c9-aced-ea7d32327dfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:24.738654 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9615f5-938e-44c9-aced-ea7d32327dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:24.739011 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9615f5-938e-44c9-aced-ea7d32327dfc admin admin] PATH_INFO: `/v3/projects/ff9b5fa1c46944888c6924b4256e83aa` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:24.741436 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9615f5-938e-44c9-aced-ea7d32327dfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff9b5fa1c46944888c6924b4256e83aa)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:22:24.743401 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9615f5-938e-44c9-aced-ea7d32327dfc admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:22:24.797931 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-fb9615f5-938e-44c9-aced-ea7d32327dfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff9b5fa1c46944888c6924b4256e83aa', 'request_id': 'req-fb9615f5-938e-44c9-aced-ea7d32327dfc'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:22:24.807841 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-fb9615f5-938e-44c9-aced-ea7d32327dfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff9b5fa1c46944888c6924b4256e83aa', 'request_id': 'req-fb9615f5-938e-44c9-aced-ea7d32327dfc'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:22:24.813579 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-fb9615f5-938e-44c9-aced-ea7d32327dfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff9b5fa1c46944888c6924b4256e83aa', 'request_id': 'req-fb9615f5-938e-44c9-aced-ea7d32327dfc'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:22:24.825235 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-fb9615f5-938e-44c9-aced-ea7d32327dfc admin admin] The token cache is being invalidate because project ff9b5fa1c46944888c6924b4256e83aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:22:24.825518 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-fb9615f5-938e-44c9-aced-ea7d32327dfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:22:24.826195 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-fb9615f5-938e-44c9-aced-ea7d32327dfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:22:24.827809 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1202/2372] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:22:24 2022] DELETE /identity/v3/projects/ff9b5fa1c46944888c6924b4256e83aa => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:22:24.833303 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531606c6-d62d-43f9-ba01-8f5add3c83fb admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:22:24.834725 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-531606c6-d62d-43f9-ba01-8f5add3c83fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:22:24.848186 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531606c6-d62d-43f9-ba01-8f5add3c83fb admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:22:24.877318 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:INSERT=6,keystone:SELECT=84,keystone:DELETE=10 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:22:24.907898 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a2cdf5-83fc-4fd0-a13b-f795e4a85842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:22:24.908807 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a2cdf5-83fc-4fd0-a13b-f795e4a85842 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:24.909084 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a2cdf5-83fc-4fd0-a13b-f795e4a85842 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:24.909352 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a2cdf5-83fc-4fd0-a13b-f795e4a85842 admin admin] PATH_INFO: `/v3/users/83618fb4c5f14eb48cec6191594065a6` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:24.910544 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a2cdf5-83fc-4fd0-a13b-f795e4a85842 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83618fb4c5f14eb48cec6191594065a6)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:22:24.912577 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a2cdf5-83fc-4fd0-a13b-f795e4a85842 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:22:24.960757 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-87a2cdf5-83fc-4fd0-a13b-f795e4a85842 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83618fb4c5f14eb48cec6191594065a6'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:22:24.961478 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-87a2cdf5-83fc-4fd0-a13b-f795e4a85842 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83618fb4c5f14eb48cec6191594065a6'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:22:24.969456 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-87a2cdf5-83fc-4fd0-a13b-f795e4a85842 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83618fb4c5f14eb48cec6191594065a6'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:22:24.970164 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-87a2cdf5-83fc-4fd0-a13b-f795e4a85842 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83618fb4c5f14eb48cec6191594065a6'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:22:24.982708 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-87a2cdf5-83fc-4fd0-a13b-f795e4a85842 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83618fb4c5f14eb48cec6191594065a6'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:22:24.996029 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1171/2373] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:22:24 2022] DELETE /identity/v3/users/83618fb4c5f14eb48cec6191594065a6 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:22:25.189360 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9615f5-938e-44c9-aced-ea7d32327dfc admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:22:25.190862 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-fb9615f5-938e-44c9-aced-ea7d32327dfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:22:25.204197 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9615f5-938e-44c9-aced-ea7d32327dfc admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:22:25.254585 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:22:25.266190 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dd2bec-4c42-4665-a8ca-475d835c8201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:22:25.267137 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dd2bec-4c42-4665-a8ca-475d835c8201 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:25.267419 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dd2bec-4c42-4665-a8ca-475d835c8201 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:25.267708 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dd2bec-4c42-4665-a8ca-475d835c8201 admin admin] PATH_INFO: `/v3/projects/1b6bef5e41fd40ac834ec9cc84c36838` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:25.269038 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dd2bec-4c42-4665-a8ca-475d835c8201 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b6bef5e41fd40ac834ec9cc84c36838)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:22:25.271012 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dd2bec-4c42-4665-a8ca-475d835c8201 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:22:25.316385 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-09dd2bec-4c42-4665-a8ca-475d835c8201 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b6bef5e41fd40ac834ec9cc84c36838', 'request_id': 'req-09dd2bec-4c42-4665-a8ca-475d835c8201'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:22:25.325349 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-09dd2bec-4c42-4665-a8ca-475d835c8201 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b6bef5e41fd40ac834ec9cc84c36838', 'request_id': 'req-09dd2bec-4c42-4665-a8ca-475d835c8201'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:22:25.331446 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-09dd2bec-4c42-4665-a8ca-475d835c8201 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b6bef5e41fd40ac834ec9cc84c36838', 'request_id': 'req-09dd2bec-4c42-4665-a8ca-475d835c8201'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:22:25.343001 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-09dd2bec-4c42-4665-a8ca-475d835c8201 admin admin] The token cache is being invalidate because project 1b6bef5e41fd40ac834ec9cc84c36838 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:22:25.343286 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-09dd2bec-4c42-4665-a8ca-475d835c8201 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:22:25.344008 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-09dd2bec-4c42-4665-a8ca-475d835c8201 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:22:25.345583 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1203/2374] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:22:25 2022] DELETE /identity/v3/projects/1b6bef5e41fd40ac834ec9cc84c36838 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:22:25.351364 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c48e129-eda8-497c-b42a-c57869b99784 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:25.351857 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c48e129-eda8-497c-b42a-c57869b99784 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:25.351857 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c48e129-eda8-497c-b42a-c57869b99784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:25.370912 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-0c48e129-eda8-497c-b42a-c57869b99784 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:22:25.372166 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0c48e129-eda8-497c-b42a-c57869b99784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:22:25.434834 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1172/2375] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:22:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:22:25.443083 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7756a7-0f62-4966-b4e6-6bcffa2a17d6 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:25.443372 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7756a7-0f62-4966-b4e6-6bcffa2a17d6 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:25.443656 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7756a7-0f62-4966-b4e6-6bcffa2a17d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:25.463783 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-6e7756a7-0f62-4966-b4e6-6bcffa2a17d6 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:22:25.465041 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-6e7756a7-0f62-4966-b4e6-6bcffa2a17d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:22:25.475160 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1204/2376] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:22:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:22:25.479611 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c48e129-eda8-497c-b42a-c57869b99784 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:22:25.489622 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c48e129-eda8-497c-b42a-c57869b99784 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:22:25.494807 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce99f039-5139-4308-a0b8-c39ea790feee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:22:25.495462 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce99f039-5139-4308-a0b8-c39ea790feee admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:25.495747 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce99f039-5139-4308-a0b8-c39ea790feee admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:25.496050 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce99f039-5139-4308-a0b8-c39ea790feee admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:25.496809 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce99f039-5139-4308-a0b8-c39ea790feee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:22:25.497116 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce99f039-5139-4308-a0b8-c39ea790feee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:22:25.498779 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce99f039-5139-4308-a0b8-c39ea790feee admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:22:25.510821 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1173/2377] 10.222.0.42 () {58 vars in 1152 bytes} [Mon Jul 4 09:22:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:22:25.515103 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7756a7-0f62-4966-b4e6-6bcffa2a17d6 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:22:25.525072 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7756a7-0f62-4966-b4e6-6bcffa2a17d6 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:22:25.530975 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25693293-cffd-428c-b77f-203b3d5abf52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:22:25.531658 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25693293-cffd-428c-b77f-203b3d5abf52 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:25.531963 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25693293-cffd-428c-b77f-203b3d5abf52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:25.532242 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25693293-cffd-428c-b77f-203b3d5abf52 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:25.532939 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25693293-cffd-428c-b77f-203b3d5abf52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:22:25.534905 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25693293-cffd-428c-b77f-203b3d5abf52 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:22:25.563801 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1205/2378] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:22:25 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:22:25.568322 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce99f039-5139-4308-a0b8-c39ea790feee admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:22:25.578749 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce99f039-5139-4308-a0b8-c39ea790feee admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:22:25.616517 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:22:25.642782 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2343d684-2974-44e6-8eea-5eedad2e9dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:22:25.643477 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343d684-2974-44e6-8eea-5eedad2e9dea admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:25.643766 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343d684-2974-44e6-8eea-5eedad2e9dea admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:25.644080 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343d684-2974-44e6-8eea-5eedad2e9dea admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:25.644772 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2343d684-2974-44e6-8eea-5eedad2e9dea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:22:25.646915 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2343d684-2974-44e6-8eea-5eedad2e9dea admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:22:25.667851 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1174/2379] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:22:25 2022] POST /identity/v3/users => generated 286 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:22:25.672214 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25693293-cffd-428c-b77f-203b3d5abf52 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:22:25.683848 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25693293-cffd-428c-b77f-203b3d5abf52 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:22:25.690390 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0522b6f5-c5d9-465e-aad5-4c2640bd2a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:22:25.691026 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0522b6f5-c5d9-465e-aad5-4c2640bd2a89 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:25.691307 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0522b6f5-c5d9-465e-aad5-4c2640bd2a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:25.691577 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0522b6f5-c5d9-465e-aad5-4c2640bd2a89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:25.692349 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0522b6f5-c5d9-465e-aad5-4c2640bd2a89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:22:25.693986 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0522b6f5-c5d9-465e-aad5-4c2640bd2a89 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:22:25.705231 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1206/2380] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:22:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:22:25.709561 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2343d684-2974-44e6-8eea-5eedad2e9dea admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:22:25.720155 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2343d684-2974-44e6-8eea-5eedad2e9dea admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:22:25.727110 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a21de24-3e07-4ad9-b49a-545edd5f0f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:22:25.727769 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21de24-3e07-4ad9-b49a-545edd5f0f1a admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:25.728096 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21de24-3e07-4ad9-b49a-545edd5f0f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:25.728371 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21de24-3e07-4ad9-b49a-545edd5f0f1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:25.729104 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a21de24-3e07-4ad9-b49a-545edd5f0f1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:22:25.730768 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a21de24-3e07-4ad9-b49a-545edd5f0f1a admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:22:25.742138 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1175/2381] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:22:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:22:25.746381 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0522b6f5-c5d9-465e-aad5-4c2640bd2a89 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:22:25.756959 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0522b6f5-c5d9-465e-aad5-4c2640bd2a89 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:22:25.763208 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73f3c55-921c-47d3-bacc-3db0748cf111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:22:25.764225 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f3c55-921c-47d3-bacc-3db0748cf111 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:25.764531 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f3c55-921c-47d3-bacc-3db0748cf111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:25.764853 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f3c55-921c-47d3-bacc-3db0748cf111 admin admin] PATH_INFO: `/v3/projects/5870c90e3d1f42a598ba5dc8fae9080f/users/1677a373b7944daf813218fa20424c22/roles/81634e7812344f84afcb29b0dba2687c` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:25.781375 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73f3c55-921c-47d3-bacc-3db0748cf111 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5870c90e3d1f42a598ba5dc8fae9080f, user_id=1677a373b7944daf813218fa20424c22, role_id=81634e7812344f84afcb29b0dba2687c)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:22:25.784122 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73f3c55-921c-47d3-bacc-3db0748cf111 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:22:25.801152 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1207/2382] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:22:25 2022] PUT /identity/v3/projects/5870c90e3d1f42a598ba5dc8fae9080f/users/1677a373b7944daf813218fa20424c22/roles/81634e7812344f84afcb29b0dba2687c => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:22:25.818088 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b394c6-4cff-4a26-ae44-4c7246c6b413 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:25.818375 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b394c6-4cff-4a26-ae44-4c7246c6b413 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:25.818655 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b394c6-4cff-4a26-ae44-4c7246c6b413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:25.846672 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-97b394c6-4cff-4a26-ae44-4c7246c6b413 None None] MFA Rules not processed for user `1677a373b7944daf813218fa20424c22`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:22:25.847926 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-97b394c6-4cff-4a26-ae44-4c7246c6b413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:22:25.915014 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1176/2383] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:22:25 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:22:25.919789 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73f3c55-921c-47d3-bacc-3db0748cf111 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:22:25.984821 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73f3c55-921c-47d3-bacc-3db0748cf111 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:22:25.991016 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ae63fe-83a1-4085-87ee-c4623cc49604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:22:25.991682 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae63fe-83a1-4085-87ee-c4623cc49604 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:25.992000 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae63fe-83a1-4085-87ee-c4623cc49604 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:25.992276 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae63fe-83a1-4085-87ee-c4623cc49604 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:25.992974 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ae63fe-83a1-4085-87ee-c4623cc49604 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:22:25.994892 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ae63fe-83a1-4085-87ee-c4623cc49604 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:22:26.023447 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1208/2384] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:22:25 2022] POST /identity/v3/projects => generated 373 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:22:26.027808 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b394c6-4cff-4a26-ae44-4c7246c6b413 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:22:26.039327 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b394c6-4cff-4a26-ae44-4c7246c6b413 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:22:26.098850 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247c9b03-069e-4172-8124-6800408704b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:22:26.099532 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c9b03-069e-4172-8124-6800408704b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:26.099814 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c9b03-069e-4172-8124-6800408704b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:26.100119 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c9b03-069e-4172-8124-6800408704b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:26.100819 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247c9b03-069e-4172-8124-6800408704b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:22:26.102766 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247c9b03-069e-4172-8124-6800408704b4 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:22:26.124427 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1177/2385] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:22:26 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:22:26.129864 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ae63fe-83a1-4085-87ee-c4623cc49604 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:22:26.135527 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:22:26.141910 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ae63fe-83a1-4085-87ee-c4623cc49604 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:22:26.148274 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1e336b-7717-4c3d-850c-4d06f563d613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:22:26.148969 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e336b-7717-4c3d-850c-4d06f563d613 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:26.149263 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e336b-7717-4c3d-850c-4d06f563d613 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:26.149726 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e336b-7717-4c3d-850c-4d06f563d613 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:26.150626 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1e336b-7717-4c3d-850c-4d06f563d613 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:22:26.152515 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1e336b-7717-4c3d-850c-4d06f563d613 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:22:26.163326 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1209/2386] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:22:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:22:26.167483 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247c9b03-069e-4172-8124-6800408704b4 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:22:26.178513 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247c9b03-069e-4172-8124-6800408704b4 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:22:26.183361 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab8af36-e617-4f23-9702-6d1ce8326545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:22:26.184300 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab8af36-e617-4f23-9702-6d1ce8326545 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:26.184555 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab8af36-e617-4f23-9702-6d1ce8326545 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:26.184828 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab8af36-e617-4f23-9702-6d1ce8326545 admin admin] PATH_INFO: `/v3/projects/15e9adbec9494e448d23264a72517faf/users/3329b315a36e4343b055a29ac9f3bc5b/roles/965049e7ce6144aaad23c15f3a5e37c3` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:26.200261 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab8af36-e617-4f23-9702-6d1ce8326545 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15e9adbec9494e448d23264a72517faf, user_id=3329b315a36e4343b055a29ac9f3bc5b, role_id=965049e7ce6144aaad23c15f3a5e37c3)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:22:26.202965 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab8af36-e617-4f23-9702-6d1ce8326545 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:22:26.218727 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1178/2387] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:22:26 2022] PUT /identity/v3/projects/15e9adbec9494e448d23264a72517faf/users/3329b315a36e4343b055a29ac9f3bc5b/roles/965049e7ce6144aaad23c15f3a5e37c3 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:22:26.223314 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1e336b-7717-4c3d-850c-4d06f563d613 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:22:26.233634 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1e336b-7717-4c3d-850c-4d06f563d613 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:22:26.291963 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270e400f-f6d5-47be-9934-e6a50ac2f5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:22:26.292574 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e400f-f6d5-47be-9934-e6a50ac2f5ad admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:26.292858 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e400f-f6d5-47be-9934-e6a50ac2f5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:26.293137 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e400f-f6d5-47be-9934-e6a50ac2f5ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:26.293867 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270e400f-f6d5-47be-9934-e6a50ac2f5ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:22:26.295532 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270e400f-f6d5-47be-9934-e6a50ac2f5ad admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:22:26.305355 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1210/2388] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:22:26 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:22:26.309714 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab8af36-e617-4f23-9702-6d1ce8326545 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:22:26.320198 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab8af36-e617-4f23-9702-6d1ce8326545 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:22:26.325038 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e90e1c0-a229-459e-a466-7a4722f0e4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:22:26.325908 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e90e1c0-a229-459e-a466-7a4722f0e4d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:26.326188 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e90e1c0-a229-459e-a466-7a4722f0e4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:26.326460 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e90e1c0-a229-459e-a466-7a4722f0e4d5 admin admin] PATH_INFO: `/v3/projects/15e9adbec9494e448d23264a72517faf/users/3329b315a36e4343b055a29ac9f3bc5b/roles/965049e7ce6144aaad23c15f3a5e37c3` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:26.328511 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e90e1c0-a229-459e-a466-7a4722f0e4d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15e9adbec9494e448d23264a72517faf, user_id=3329b315a36e4343b055a29ac9f3bc5b, role_id=965049e7ce6144aaad23c15f3a5e37c3)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:22:26.331167 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e90e1c0-a229-459e-a466-7a4722f0e4d5 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:22:26.336988 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:22:26.342576 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1179/2389] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:22:26 2022] PUT /identity/v3/projects/15e9adbec9494e448d23264a72517faf/users/3329b315a36e4343b055a29ac9f3bc5b/roles/965049e7ce6144aaad23c15f3a5e37c3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:22:26.353318 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d0b06-0cd4-478d-ae60-c2725e429e26 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:26.354050 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d0b06-0cd4-478d-ae60-c2725e429e26 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:26.354050 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d0b06-0cd4-478d-ae60-c2725e429e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:26.381515 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-5f0d0b06-0cd4-478d-ae60-c2725e429e26 None None] MFA Rules not processed for user `3329b315a36e4343b055a29ac9f3bc5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:22:26.382764 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-5f0d0b06-0cd4-478d-ae60-c2725e429e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:22:26.467045 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1211/2390] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:22:26 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:22:26.481602 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e90e1c0-a229-459e-a466-7a4722f0e4d5 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:22:26.483489 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-5e90e1c0-a229-459e-a466-7a4722f0e4d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:22:26.540460 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e90e1c0-a229-459e-a466-7a4722f0e4d5 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:22:26.544569 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d745939c-45e6-40b5-aab8-09c5c5a3075e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f86373d65440da97c853fff3c1d0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:22:26.545140 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745939c-45e6-40b5-aab8-09c5c5a3075e service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:26.545419 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745939c-45e6-40b5-aab8-09c5c5a3075e service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:26.545691 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745939c-45e6-40b5-aab8-09c5c5a3075e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:26.555069 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d745939c-45e6-40b5-aab8-09c5c5a3075e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:22:26.556564 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d745939c-45e6-40b5-aab8-09c5c5a3075e service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:22:26.565922 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1180/2391] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:22:26 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:22:26.645104 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0d0b06-0cd4-478d-ae60-c2725e429e26 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:22:26.661359 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0d0b06-0cd4-478d-ae60-c2725e429e26 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:22:26.665719 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db893519-655b-42c3-b63a-ff8a0356ac75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f86373d65440da97c853fff3c1d0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:22:26.666338 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db893519-655b-42c3-b63a-ff8a0356ac75 service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:26.666647 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db893519-655b-42c3-b63a-ff8a0356ac75 service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:26.666924 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db893519-655b-42c3-b63a-ff8a0356ac75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:26.726682 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db893519-655b-42c3-b63a-ff8a0356ac75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:22:26.728239 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db893519-655b-42c3-b63a-ff8a0356ac75 service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:22:26.737918 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1212/2392] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:22:26 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:22:36.561782 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=27 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:22:36.733934 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=95 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:22:45.691294 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d745939c-45e6-40b5-aab8-09c5c5a3075e service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:22:45.692775 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d745939c-45e6-40b5-aab8-09c5c5a3075e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:22:45.754654 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d745939c-45e6-40b5-aab8-09c5c5a3075e service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:22:45.758431 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bd9abd-5d3c-405c-8740-70a29c7170f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:22:45.759081 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd9abd-5d3c-405c-8740-70a29c7170f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:45.759374 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd9abd-5d3c-405c-8740-70a29c7170f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:45.759631 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd9abd-5d3c-405c-8740-70a29c7170f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:45.761583 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-31bd9abd-5d3c-405c-8740-70a29c7170f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:22:45.863586 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bd9abd-5d3c-405c-8740-70a29c7170f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:22:45.865130 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bd9abd-5d3c-405c-8740-70a29c7170f6 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:22:45.886389 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1181/2393] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:22:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:22:49.450062 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db893519-655b-42c3-b63a-ff8a0356ac75 service cinder] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:22:49.451558 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-db893519-655b-42c3-b63a-ff8a0356ac75 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:22:49.463594 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db893519-655b-42c3-b63a-ff8a0356ac75 service cinder] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:22:49.467342 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f918c-9a02-4078-b7c5-a3af0ccf6d90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:22:49.468035 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f918c-9a02-4078-b7c5-a3af0ccf6d90 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:49.468321 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f918c-9a02-4078-b7c5-a3af0ccf6d90 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:49.468600 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f918c-9a02-4078-b7c5-a3af0ccf6d90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:49.470342 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-0a5f918c-9a02-4078-b7c5-a3af0ccf6d90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:22:49.484788 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5f918c-9a02-4078-b7c5-a3af0ccf6d90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:22:49.486369 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5f918c-9a02-4078-b7c5-a3af0ccf6d90 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:22:49.497703 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1213/2394] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:22:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:22:55.883249 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=63 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:22:56.230868 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bd9abd-5d3c-405c-8740-70a29c7170f6 service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:22:56.309944 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bd9abd-5d3c-405c-8740-70a29c7170f6 service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:22:56.314604 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb17e0ff-0bb9-4b26-a711-9c83d1035e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:22:56.315542 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17e0ff-0bb9-4b26-a711-9c83d1035e42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:56.315760 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17e0ff-0bb9-4b26-a711-9c83d1035e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:56.316061 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17e0ff-0bb9-4b26-a711-9c83d1035e42 admin admin] PATH_INFO: `/v3/users/1677a373b7944daf813218fa20424c22` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:56.317286 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb17e0ff-0bb9-4b26-a711-9c83d1035e42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1677a373b7944daf813218fa20424c22)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:22:56.320059 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb17e0ff-0bb9-4b26-a711-9c83d1035e42 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:22:56.372792 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-bb17e0ff-0bb9-4b26-a711-9c83d1035e42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1677a373b7944daf813218fa20424c22'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:22:56.373942 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-bb17e0ff-0bb9-4b26-a711-9c83d1035e42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1677a373b7944daf813218fa20424c22'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:22:56.383706 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-bb17e0ff-0bb9-4b26-a711-9c83d1035e42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1677a373b7944daf813218fa20424c22'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:22:56.384433 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-bb17e0ff-0bb9-4b26-a711-9c83d1035e42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1677a373b7944daf813218fa20424c22'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:22:56.397481 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-bb17e0ff-0bb9-4b26-a711-9c83d1035e42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1677a373b7944daf813218fa20424c22'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:22:56.409676 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1182/2395] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:22:56 2022] DELETE /identity/v3/users/1677a373b7944daf813218fa20424c22 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:22:56.414358 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2fee2-f9f6-46b9-84b4-d874c1362f42 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:56.414815 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2fee2-f9f6-46b9-84b4-d874c1362f42 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:56.415006 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2fee2-f9f6-46b9-84b4-d874c1362f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:56.432443 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-00e2fee2-f9f6-46b9-84b4-d874c1362f42 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:22:56.433671 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-00e2fee2-f9f6-46b9-84b4-d874c1362f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:22:56.495299 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1214/2396] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:22:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:22:56.506732 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb17e0ff-0bb9-4b26-a711-9c83d1035e42 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:22:56.508320 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-bb17e0ff-0bb9-4b26-a711-9c83d1035e42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:22:56.567258 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb17e0ff-0bb9-4b26-a711-9c83d1035e42 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:22:56.571277 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7fa790-2c33-4818-a944-a6ed9e9a4591 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:22:56.571965 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7fa790-2c33-4818-a944-a6ed9e9a4591 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:56.572250 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7fa790-2c33-4818-a944-a6ed9e9a4591 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:56.572645 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7fa790-2c33-4818-a944-a6ed9e9a4591 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:56.582608 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7fa790-2c33-4818-a944-a6ed9e9a4591 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:22:56.584161 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7fa790-2c33-4818-a944-a6ed9e9a4591 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:22:56.594828 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1183/2397] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:22:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:22:56.876417 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e2fee2-f9f6-46b9-84b4-d874c1362f42 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:22:56.877912 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-00e2fee2-f9f6-46b9-84b4-d874c1362f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:22:56.896701 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e2fee2-f9f6-46b9-84b4-d874c1362f42 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:22:56.902708 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8778cb69-2440-4961-a4dc-bd0b767bd8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:22:56.903600 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8778cb69-2440-4961-a4dc-bd0b767bd8fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:56.903918 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8778cb69-2440-4961-a4dc-bd0b767bd8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:56.904646 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8778cb69-2440-4961-a4dc-bd0b767bd8fe admin admin] PATH_INFO: `/v3/projects/5870c90e3d1f42a598ba5dc8fae9080f` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:56.906163 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8778cb69-2440-4961-a4dc-bd0b767bd8fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=5870c90e3d1f42a598ba5dc8fae9080f)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:22:56.908266 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8778cb69-2440-4961-a4dc-bd0b767bd8fe admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:22:56.956113 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-8778cb69-2440-4961-a4dc-bd0b767bd8fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5870c90e3d1f42a598ba5dc8fae9080f', 'request_id': 'req-8778cb69-2440-4961-a4dc-bd0b767bd8fe'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:22:56.964509 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-8778cb69-2440-4961-a4dc-bd0b767bd8fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5870c90e3d1f42a598ba5dc8fae9080f', 'request_id': 'req-8778cb69-2440-4961-a4dc-bd0b767bd8fe'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:22:56.970165 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-8778cb69-2440-4961-a4dc-bd0b767bd8fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5870c90e3d1f42a598ba5dc8fae9080f', 'request_id': 'req-8778cb69-2440-4961-a4dc-bd0b767bd8fe'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:22:56.981938 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-8778cb69-2440-4961-a4dc-bd0b767bd8fe admin admin] The token cache is being invalidate because project 5870c90e3d1f42a598ba5dc8fae9080f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:22:56.982291 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-8778cb69-2440-4961-a4dc-bd0b767bd8fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:22:56.983014 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-8778cb69-2440-4961-a4dc-bd0b767bd8fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:22:56.984690 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1215/2398] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:22:56 2022] DELETE /identity/v3/projects/5870c90e3d1f42a598ba5dc8fae9080f => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:22:56.988839 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7fa790-2c33-4818-a944-a6ed9e9a4591 service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:22:56.998519 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7fa790-2c33-4818-a944-a6ed9e9a4591 service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:22:57.019252 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:22:57.070690 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8295a158-5bb6-483f-95d5-be284b572223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:22:57.071575 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295a158-5bb6-483f-95d5-be284b572223 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:57.071853 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295a158-5bb6-483f-95d5-be284b572223 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:57.072159 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295a158-5bb6-483f-95d5-be284b572223 admin admin] PATH_INFO: `/v3/users/3329b315a36e4343b055a29ac9f3bc5b` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:57.074226 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8295a158-5bb6-483f-95d5-be284b572223 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3329b315a36e4343b055a29ac9f3bc5b)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:22:57.077233 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8295a158-5bb6-483f-95d5-be284b572223 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:22:57.129320 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8295a158-5bb6-483f-95d5-be284b572223 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3329b315a36e4343b055a29ac9f3bc5b'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:22:57.129981 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8295a158-5bb6-483f-95d5-be284b572223 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3329b315a36e4343b055a29ac9f3bc5b'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:22:57.138862 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8295a158-5bb6-483f-95d5-be284b572223 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3329b315a36e4343b055a29ac9f3bc5b'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:22:57.139518 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8295a158-5bb6-483f-95d5-be284b572223 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3329b315a36e4343b055a29ac9f3bc5b'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:22:57.151496 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8295a158-5bb6-483f-95d5-be284b572223 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3329b315a36e4343b055a29ac9f3bc5b'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:22:57.164028 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1184/2399] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:22:56 2022] DELETE /identity/v3/users/3329b315a36e4343b055a29ac9f3bc5b => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:22:57.454758 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8778cb69-2440-4961-a4dc-bd0b767bd8fe admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:22:57.456797 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-8778cb69-2440-4961-a4dc-bd0b767bd8fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:22:57.471446 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8778cb69-2440-4961-a4dc-bd0b767bd8fe admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:22:57.533590 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4329971b-688d-4c7c-a3c1-75a10531ee05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:22:57.534632 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329971b-688d-4c7c-a3c1-75a10531ee05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:57.534948 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329971b-688d-4c7c-a3c1-75a10531ee05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:57.535228 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329971b-688d-4c7c-a3c1-75a10531ee05 admin admin] PATH_INFO: `/v3/projects/15e9adbec9494e448d23264a72517faf` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:57.537710 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4329971b-688d-4c7c-a3c1-75a10531ee05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15e9adbec9494e448d23264a72517faf)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:22:57.539857 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4329971b-688d-4c7c-a3c1-75a10531ee05 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:22:57.552134 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:22:57.591504 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-4329971b-688d-4c7c-a3c1-75a10531ee05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15e9adbec9494e448d23264a72517faf', 'request_id': 'req-4329971b-688d-4c7c-a3c1-75a10531ee05'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:22:57.601011 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-4329971b-688d-4c7c-a3c1-75a10531ee05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15e9adbec9494e448d23264a72517faf', 'request_id': 'req-4329971b-688d-4c7c-a3c1-75a10531ee05'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:22:57.608616 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-4329971b-688d-4c7c-a3c1-75a10531ee05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15e9adbec9494e448d23264a72517faf', 'request_id': 'req-4329971b-688d-4c7c-a3c1-75a10531ee05'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:22:57.620322 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-4329971b-688d-4c7c-a3c1-75a10531ee05 admin admin] The token cache is being invalidate because project 15e9adbec9494e448d23264a72517faf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:22:57.620614 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-4329971b-688d-4c7c-a3c1-75a10531ee05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:22:57.621262 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-4329971b-688d-4c7c-a3c1-75a10531ee05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:22:57.622799 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1216/2400] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:22:57 2022] DELETE /identity/v3/projects/15e9adbec9494e448d23264a72517faf => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:22:57.627837 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc476e8-8f76-43d4-9bdb-12edb38f6bbd None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:57.628183 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc476e8-8f76-43d4-9bdb-12edb38f6bbd None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:57.628561 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc476e8-8f76-43d4-9bdb-12edb38f6bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:57.647964 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-8cc476e8-8f76-43d4-9bdb-12edb38f6bbd None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:22:57.649287 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-8cc476e8-8f76-43d4-9bdb-12edb38f6bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:22:57.736364 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1185/2401] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:22:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:22:57.744373 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe7879-6bfc-43d5-b87d-5f632c3e8944 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:57.744671 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe7879-6bfc-43d5-b87d-5f632c3e8944 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:57.744962 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe7879-6bfc-43d5-b87d-5f632c3e8944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:57.764162 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-5fbe7879-6bfc-43d5-b87d-5f632c3e8944 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:22:57.765403 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-5fbe7879-6bfc-43d5-b87d-5f632c3e8944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:22:57.774078 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1217/2402] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:22:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:22:57.778326 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc476e8-8f76-43d4-9bdb-12edb38f6bbd None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:22:57.789053 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc476e8-8f76-43d4-9bdb-12edb38f6bbd None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:22:57.794299 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaab6dcd-6606-4e69-9751-6e713fbee8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:22:57.794991 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaab6dcd-6606-4e69-9751-6e713fbee8f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:57.795283 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaab6dcd-6606-4e69-9751-6e713fbee8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:57.795564 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaab6dcd-6606-4e69-9751-6e713fbee8f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:57.796312 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaab6dcd-6606-4e69-9751-6e713fbee8f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:22:57.796617 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaab6dcd-6606-4e69-9751-6e713fbee8f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:22:57.798246 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaab6dcd-6606-4e69-9751-6e713fbee8f6 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:22:57.813868 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1186/2403] 10.222.0.42 () {58 vars in 1152 bytes} [Mon Jul 4 09:22:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:22:57.818324 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe7879-6bfc-43d5-b87d-5f632c3e8944 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:22:57.829723 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe7879-6bfc-43d5-b87d-5f632c3e8944 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:22:57.834801 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3722a5b2-38ec-4930-bc88-b6b86bcea71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:22:57.835463 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3722a5b2-38ec-4930-bc88-b6b86bcea71a admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:57.835747 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3722a5b2-38ec-4930-bc88-b6b86bcea71a admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:57.836056 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3722a5b2-38ec-4930-bc88-b6b86bcea71a admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:57.836771 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3722a5b2-38ec-4930-bc88-b6b86bcea71a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:22:57.838742 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3722a5b2-38ec-4930-bc88-b6b86bcea71a admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:22:57.873837 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1218/2404] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:22:57 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:22:57.875625 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaab6dcd-6606-4e69-9751-6e713fbee8f6 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:22:57.888941 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaab6dcd-6606-4e69-9751-6e713fbee8f6 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:22:57.917791 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:22:57.951086 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1431a7-3cbe-4a36-b694-fff1e0f545eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:22:57.951767 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1431a7-3cbe-4a36-b694-fff1e0f545eb admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:57.952076 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1431a7-3cbe-4a36-b694-fff1e0f545eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:57.952352 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1431a7-3cbe-4a36-b694-fff1e0f545eb admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:57.953074 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1431a7-3cbe-4a36-b694-fff1e0f545eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:22:57.955075 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1431a7-3cbe-4a36-b694-fff1e0f545eb admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:22:57.977379 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1187/2405] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:22:57 2022] POST /identity/v3/users => generated 289 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:22:57.981973 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3722a5b2-38ec-4930-bc88-b6b86bcea71a admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:22:57.992646 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3722a5b2-38ec-4930-bc88-b6b86bcea71a admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:22:57.997499 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b00520-2b90-4906-9a55-d767ea036a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:22:57.998202 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b00520-2b90-4906-9a55-d767ea036a3d admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:57.998479 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b00520-2b90-4906-9a55-d767ea036a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:57.998754 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b00520-2b90-4906-9a55-d767ea036a3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:57.999480 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b00520-2b90-4906-9a55-d767ea036a3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:22:58.001148 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b00520-2b90-4906-9a55-d767ea036a3d admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:22:58.011980 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1219/2406] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:22:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:22:58.015902 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1431a7-3cbe-4a36-b694-fff1e0f545eb admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:22:58.026543 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1431a7-3cbe-4a36-b694-fff1e0f545eb admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:22:58.032120 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf46157-3833-4b2a-b763-5d5d5cee2c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:22:58.032767 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf46157-3833-4b2a-b763-5d5d5cee2c16 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:58.033044 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf46157-3833-4b2a-b763-5d5d5cee2c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:58.033318 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf46157-3833-4b2a-b763-5d5d5cee2c16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:58.034042 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf46157-3833-4b2a-b763-5d5d5cee2c16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:22:58.035667 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf46157-3833-4b2a-b763-5d5d5cee2c16 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:22:58.046670 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1188/2407] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:22:58.050802 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b00520-2b90-4906-9a55-d767ea036a3d admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:22:58.061520 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b00520-2b90-4906-9a55-d767ea036a3d admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:22:58.067623 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abbcb79-1baa-4ae6-9ada-0eb0b20c5041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:22:58.068556 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abbcb79-1baa-4ae6-9ada-0eb0b20c5041 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:58.068977 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abbcb79-1baa-4ae6-9ada-0eb0b20c5041 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:58.069256 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abbcb79-1baa-4ae6-9ada-0eb0b20c5041 admin admin] PATH_INFO: `/v3/projects/10a386fbb0e647df92837bc9c1ae5200/users/10448ea3100d452e85edc86837b6291e/roles/81634e7812344f84afcb29b0dba2687c` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:58.086453 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abbcb79-1baa-4ae6-9ada-0eb0b20c5041 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10a386fbb0e647df92837bc9c1ae5200, user_id=10448ea3100d452e85edc86837b6291e, role_id=81634e7812344f84afcb29b0dba2687c)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:22:58.089253 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abbcb79-1baa-4ae6-9ada-0eb0b20c5041 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:22:58.105043 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1220/2408] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:22:58 2022] PUT /identity/v3/projects/10a386fbb0e647df92837bc9c1ae5200/users/10448ea3100d452e85edc86837b6291e/roles/81634e7812344f84afcb29b0dba2687c => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:22:58.115523 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127859f5-113a-47a1-b44a-842b9bb24cb0 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:58.115815 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127859f5-113a-47a1-b44a-842b9bb24cb0 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:58.116112 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127859f5-113a-47a1-b44a-842b9bb24cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:58.142751 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-127859f5-113a-47a1-b44a-842b9bb24cb0 None None] MFA Rules not processed for user `10448ea3100d452e85edc86837b6291e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:22:58.143904 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-127859f5-113a-47a1-b44a-842b9bb24cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:22:58.217857 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1189/2409] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:22:58 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:22:58.229224 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abbcb79-1baa-4ae6-9ada-0eb0b20c5041 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:22:58.231272 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-6abbcb79-1baa-4ae6-9ada-0eb0b20c5041 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:22:58.322346 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abbcb79-1baa-4ae6-9ada-0eb0b20c5041 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:22:58.326304 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e1d5bb-b4bb-45d2-86a7-7e4d0fb2ca50 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92e3804048824cde829e6273ce7c19b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:22:58.326954 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e1d5bb-b4bb-45d2-86a7-7e4d0fb2ca50 service glance] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:58.327239 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e1d5bb-b4bb-45d2-86a7-7e4d0fb2ca50 service glance] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:58.327517 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e1d5bb-b4bb-45d2-86a7-7e4d0fb2ca50 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:58.337186 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e1d5bb-b4bb-45d2-86a7-7e4d0fb2ca50 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:22:58.338682 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e1d5bb-b4bb-45d2-86a7-7e4d0fb2ca50 service glance] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:22:58.350291 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1221/2410] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:22:58 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:22:59.420782 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127859f5-113a-47a1-b44a-842b9bb24cb0 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:22:59.423199 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-127859f5-113a-47a1-b44a-842b9bb24cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:22:59.512497 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127859f5-113a-47a1-b44a-842b9bb24cb0 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:22:59.518612 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957ee28e-4551-4417-8a06-e38e5e5f3b94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3b6e252a8c434a99432bcece6493b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:22:59.519282 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ee28e-4551-4417-8a06-e38e5e5f3b94 service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:59.519539 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ee28e-4551-4417-8a06-e38e5e5f3b94 service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:59.519808 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ee28e-4551-4417-8a06-e38e5e5f3b94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:59.521867 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-957ee28e-4551-4417-8a06-e38e5e5f3b94 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:22:59.561844 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:22:59.589051 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957ee28e-4551-4417-8a06-e38e5e5f3b94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:22:59.590691 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957ee28e-4551-4417-8a06-e38e5e5f3b94 service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:22:59.600607 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1190/2411] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:22:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:23:02.756998 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e1d5bb-b4bb-45d2-86a7-7e4d0fb2ca50 service glance] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:02.758561 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-f4e1d5bb-b4bb-45d2-86a7-7e4d0fb2ca50 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:02.781205 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:02.820587 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e1d5bb-b4bb-45d2-86a7-7e4d0fb2ca50 service glance] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:02.824656 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09831717-f361-408b-a7d6-d06d425ae22e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f86373d65440da97c853fff3c1d0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:02.825334 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09831717-f361-408b-a7d6-d06d425ae22e service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:02.825619 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09831717-f361-408b-a7d6-d06d425ae22e service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:02.825905 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09831717-f361-408b-a7d6-d06d425ae22e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:02.827723 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-09831717-f361-408b-a7d6-d06d425ae22e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:02.893004 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09831717-f361-408b-a7d6-d06d425ae22e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:02.894603 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09831717-f361-408b-a7d6-d06d425ae22e service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:02.904508 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1222/2412] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:23:02 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:23:03.055803 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842789b-9c95-4fef-a6e2-55792a3d3500 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:03.056311 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842789b-9c95-4fef-a6e2-55792a3d3500 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:03.056403 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842789b-9c95-4fef-a6e2-55792a3d3500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:03.118148 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-3842789b-9c95-4fef-a6e2-55792a3d3500 None None] MFA Rules not processed for user `bd758d5b21684027b0d199021df0ad2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:23:03.119378 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3842789b-9c95-4fef-a6e2-55792a3d3500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:03.185123 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1191/2413] 10.222.0.42 () {58 vars in 1009 bytes} [Mon Jul 4 09:23:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:23:03.239126 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09831717-f361-408b-a7d6-d06d425ae22e service cinder] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:03.240678 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-09831717-f361-408b-a7d6-d06d425ae22e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:03.333619 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09831717-f361-408b-a7d6-d06d425ae22e service cinder] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:03.339739 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed658151-22d3-4168-a8a6-4bd63d9c68e4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59d8698c45fb46259765eb3c8de2297f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:03.340428 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed658151-22d3-4168-a8a6-4bd63d9c68e4 service swift] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:03.340691 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed658151-22d3-4168-a8a6-4bd63d9c68e4 service swift] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:03.341003 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed658151-22d3-4168-a8a6-4bd63d9c68e4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:03.350967 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed658151-22d3-4168-a8a6-4bd63d9c68e4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:03.352660 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed658151-22d3-4168-a8a6-4bd63d9c68e4 service swift] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:03.360992 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1223/2414] 10.222.0.42 () {60 vars in 1384 bytes} [Mon Jul 4 09:23:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 04 09:23:03.708940 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3842789b-9c95-4fef-a6e2-55792a3d3500 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:03.710425 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3842789b-9c95-4fef-a6e2-55792a3d3500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:03.741866 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3842789b-9c95-4fef-a6e2-55792a3d3500 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:03.751156 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b25aa3-56d9-4049-9c14-b257e6a635dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3b6e252a8c434a99432bcece6493b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:03.751836 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b25aa3-56d9-4049-9c14-b257e6a635dd service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:03.752152 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b25aa3-56d9-4049-9c14-b257e6a635dd service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:03.752465 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b25aa3-56d9-4049-9c14-b257e6a635dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:03.755384 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-44b25aa3-56d9-4049-9c14-b257e6a635dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:03.865977 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b25aa3-56d9-4049-9c14-b257e6a635dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:03.868544 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b25aa3-56d9-4049-9c14-b257e6a635dd service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:03.898962 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1192/2415] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:23:03 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:23:13.177364 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed658151-22d3-4168-a8a6-4bd63d9c68e4 service swift] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:13.245204 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:13.266053 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed658151-22d3-4168-a8a6-4bd63d9c68e4 service swift] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:13.271017 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a3b56-e800-4582-9e9a-167407db2ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:13.272259 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a3b56-e800-4582-9e9a-167407db2ef6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:13.272611 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a3b56-e800-4582-9e9a-167407db2ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:13.272953 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a3b56-e800-4582-9e9a-167407db2ef6 admin admin] PATH_INFO: `/v3/users/10448ea3100d452e85edc86837b6291e` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:13.274344 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156a3b56-e800-4582-9e9a-167407db2ef6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10448ea3100d452e85edc86837b6291e)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:13.276740 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156a3b56-e800-4582-9e9a-167407db2ef6 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:13.368861 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-156a3b56-e800-4582-9e9a-167407db2ef6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10448ea3100d452e85edc86837b6291e'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:13.384995 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-156a3b56-e800-4582-9e9a-167407db2ef6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10448ea3100d452e85edc86837b6291e'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:13.387290 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-156a3b56-e800-4582-9e9a-167407db2ef6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10448ea3100d452e85edc86837b6291e'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:13.389348 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-156a3b56-e800-4582-9e9a-167407db2ef6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10448ea3100d452e85edc86837b6291e'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:13.415537 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-156a3b56-e800-4582-9e9a-167407db2ef6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10448ea3100d452e85edc86837b6291e'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:13.450515 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d76e819-a38e-45a8-aca8-01c6f5d32504 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:13.451540 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d76e819-a38e-45a8-aca8-01c6f5d32504 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:13.452012 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d76e819-a38e-45a8-aca8-01c6f5d32504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:13.454551 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1224/2416] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:23:13 2022] DELETE /identity/v3/users/10448ea3100d452e85edc86837b6291e => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:23:13.493476 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-3d76e819-a38e-45a8-aca8-01c6f5d32504 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:23:13.497189 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3d76e819-a38e-45a8-aca8-01c6f5d32504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:13.559799 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:13.587154 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1193/2417] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:23:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:23:13.597115 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a3b56-e800-4582-9e9a-167407db2ef6 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:13.598559 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-156a3b56-e800-4582-9e9a-167407db2ef6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:13.675578 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a3b56-e800-4582-9e9a-167407db2ef6 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:13.681734 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676f034a-a532-4fff-b585-5e6c5589ef25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:13.682423 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676f034a-a532-4fff-b585-5e6c5589ef25 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:13.682711 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676f034a-a532-4fff-b585-5e6c5589ef25 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:13.683146 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676f034a-a532-4fff-b585-5e6c5589ef25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:13.698750 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676f034a-a532-4fff-b585-5e6c5589ef25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:13.700936 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676f034a-a532-4fff-b585-5e6c5589ef25 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:13.711551 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1225/2418] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:23:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:23:14.445148 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d76e819-a38e-45a8-aca8-01c6f5d32504 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:14.446812 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3d76e819-a38e-45a8-aca8-01c6f5d32504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:14.459985 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d76e819-a38e-45a8-aca8-01c6f5d32504 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:14.464822 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8619b0-6351-4d24-a558-0764802b3c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:14.465982 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8619b0-6351-4d24-a558-0764802b3c23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:14.466510 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8619b0-6351-4d24-a558-0764802b3c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:14.467011 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8619b0-6351-4d24-a558-0764802b3c23 admin admin] PATH_INFO: `/v3/projects/10a386fbb0e647df92837bc9c1ae5200` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:14.469023 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8619b0-6351-4d24-a558-0764802b3c23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10a386fbb0e647df92837bc9c1ae5200)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:14.471731 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8619b0-6351-4d24-a558-0764802b3c23 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:14.545100 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-2a8619b0-6351-4d24-a558-0764802b3c23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10a386fbb0e647df92837bc9c1ae5200', 'request_id': 'req-2a8619b0-6351-4d24-a558-0764802b3c23'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:14.555941 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-2a8619b0-6351-4d24-a558-0764802b3c23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10a386fbb0e647df92837bc9c1ae5200', 'request_id': 'req-2a8619b0-6351-4d24-a558-0764802b3c23'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:14.566968 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-2a8619b0-6351-4d24-a558-0764802b3c23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10a386fbb0e647df92837bc9c1ae5200', 'request_id': 'req-2a8619b0-6351-4d24-a558-0764802b3c23'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:14.578778 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-2a8619b0-6351-4d24-a558-0764802b3c23 admin admin] The token cache is being invalidate because project 10a386fbb0e647df92837bc9c1ae5200 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:23:14.579144 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-2a8619b0-6351-4d24-a558-0764802b3c23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:14.579776 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-2a8619b0-6351-4d24-a558-0764802b3c23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:14.581343 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1194/2419] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:23:14 2022] DELETE /identity/v3/projects/10a386fbb0e647df92837bc9c1ae5200 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:23:14.587075 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b3831-a0f0-42f0-9e5b-05b070fc0a03 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:14.587561 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b3831-a0f0-42f0-9e5b-05b070fc0a03 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:14.587935 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b3831-a0f0-42f0-9e5b-05b070fc0a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:14.606670 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-dd6b3831-a0f0-42f0-9e5b-05b070fc0a03 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:23:14.608236 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-dd6b3831-a0f0-42f0-9e5b-05b070fc0a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:14.621997 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8619b0-6351-4d24-a558-0764802b3c23 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:14.623592 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-2a8619b0-6351-4d24-a558-0764802b3c23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:14.677222 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1226/2420] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:23:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:23:14.686461 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d212a1-29c4-4982-b53e-dad59f1e519f None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:14.686862 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d212a1-29c4-4982-b53e-dad59f1e519f None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:14.687243 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d212a1-29c4-4982-b53e-dad59f1e519f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:14.690855 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8619b0-6351-4d24-a558-0764802b3c23 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:14.695466 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7fb92-3b60-4665-aa94-62b6555d1aa6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:14.696166 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7fb92-3b60-4665-aa94-62b6555d1aa6 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:14.696454 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7fb92-3b60-4665-aa94-62b6555d1aa6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:14.696729 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7fb92-3b60-4665-aa94-62b6555d1aa6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:14.699713 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-55f7fb92-3b60-4665-aa94-62b6555d1aa6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:14.705197 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:14.714309 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f7fb92-3b60-4665-aa94-62b6555d1aa6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:14.715836 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f7fb92-3b60-4665-aa94-62b6555d1aa6 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:14.716173 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-82d212a1-29c4-4982-b53e-dad59f1e519f None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:23:14.720813 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-82d212a1-29c4-4982-b53e-dad59f1e519f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:14.735457 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1227/2421] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:23:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:23:14.736855 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d212a1-29c4-4982-b53e-dad59f1e519f None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:14.741696 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1195/2422] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:23:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 09:23:14.747085 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d212a1-29c4-4982-b53e-dad59f1e519f None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:14.752007 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb484a2a-9ad6-4811-abfc-4313ee6fee04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:14.752720 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb484a2a-9ad6-4811-abfc-4313ee6fee04 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:14.753075 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb484a2a-9ad6-4811-abfc-4313ee6fee04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:14.753475 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb484a2a-9ad6-4811-abfc-4313ee6fee04 admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:14.754377 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb484a2a-9ad6-4811-abfc-4313ee6fee04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:23:14.755375 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb484a2a-9ad6-4811-abfc-4313ee6fee04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:14.758162 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb484a2a-9ad6-4811-abfc-4313ee6fee04 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:14.772399 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1228/2423] 10.222.0.42 () {58 vars in 1152 bytes} [Mon Jul 4 09:23:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:23:14.775517 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7fb92-3b60-4665-aa94-62b6555d1aa6 service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:14.788229 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7fb92-3b60-4665-aa94-62b6555d1aa6 service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:14.795730 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f14c6-5b11-40fd-adcb-b7bc2c39cd04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:14.796448 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f14c6-5b11-40fd-adcb-b7bc2c39cd04 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:14.796730 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f14c6-5b11-40fd-adcb-b7bc2c39cd04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:14.797000 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f14c6-5b11-40fd-adcb-b7bc2c39cd04 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:14.798074 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2f14c6-5b11-40fd-adcb-b7bc2c39cd04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:14.799713 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2f14c6-5b11-40fd-adcb-b7bc2c39cd04 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:14.831908 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1196/2424] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:23:14 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:23:14.833706 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb484a2a-9ad6-4811-abfc-4313ee6fee04 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:14.847220 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb484a2a-9ad6-4811-abfc-4313ee6fee04 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:14.926804 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1504bef-24e8-4f18-83e2-31216e93844e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:14.927967 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1504bef-24e8-4f18-83e2-31216e93844e admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:14.928299 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1504bef-24e8-4f18-83e2-31216e93844e admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:14.928702 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1504bef-24e8-4f18-83e2-31216e93844e admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:14.929478 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1504bef-24e8-4f18-83e2-31216e93844e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:14.931572 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1504bef-24e8-4f18-83e2-31216e93844e admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:14.956052 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1229/2425] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:23:14 2022] POST /identity/v3/users => generated 287 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:23:14.960204 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f14c6-5b11-40fd-adcb-b7bc2c39cd04 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:14.971421 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f14c6-5b11-40fd-adcb-b7bc2c39cd04 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:14.976755 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca5744e-3c5b-48c0-8cc6-03e1fcedbf3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:14.977455 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca5744e-3c5b-48c0-8cc6-03e1fcedbf3b admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:14.977829 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca5744e-3c5b-48c0-8cc6-03e1fcedbf3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:14.978111 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca5744e-3c5b-48c0-8cc6-03e1fcedbf3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:14.978847 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca5744e-3c5b-48c0-8cc6-03e1fcedbf3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:14.980616 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca5744e-3c5b-48c0-8cc6-03e1fcedbf3b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:14.991956 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1197/2426] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:23:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:23:14.996039 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1504bef-24e8-4f18-83e2-31216e93844e admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:15.006844 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1504bef-24e8-4f18-83e2-31216e93844e admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:15.011582 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83ceb94-df05-4234-9bee-b322ce244a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:15.012370 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ceb94-df05-4234-9bee-b322ce244a9f admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:15.012573 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ceb94-df05-4234-9bee-b322ce244a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:15.012868 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ceb94-df05-4234-9bee-b322ce244a9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:15.013600 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83ceb94-df05-4234-9bee-b322ce244a9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:15.015239 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83ceb94-df05-4234-9bee-b322ce244a9f admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:15.027207 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1230/2427] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:23:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:23:15.031375 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca5744e-3c5b-48c0-8cc6-03e1fcedbf3b admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:15.041436 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca5744e-3c5b-48c0-8cc6-03e1fcedbf3b admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:15.046193 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e68df5-a0fa-40a3-a7d7-8fd1be4b5d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:15.047159 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e68df5-a0fa-40a3-a7d7-8fd1be4b5d26 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:15.047442 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e68df5-a0fa-40a3-a7d7-8fd1be4b5d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:15.047719 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e68df5-a0fa-40a3-a7d7-8fd1be4b5d26 admin admin] PATH_INFO: `/v3/projects/376133ca95be46ba93e95fa0bef49905/users/ae9e616d746243fd90a61824b726700a/roles/81634e7812344f84afcb29b0dba2687c` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:15.065474 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e68df5-a0fa-40a3-a7d7-8fd1be4b5d26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=376133ca95be46ba93e95fa0bef49905, user_id=ae9e616d746243fd90a61824b726700a, role_id=81634e7812344f84afcb29b0dba2687c)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:15.068438 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e68df5-a0fa-40a3-a7d7-8fd1be4b5d26 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:15.084019 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1198/2428] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:23:15 2022] PUT /identity/v3/projects/376133ca95be46ba93e95fa0bef49905/users/ae9e616d746243fd90a61824b726700a/roles/81634e7812344f84afcb29b0dba2687c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:23:15.095387 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0defa032-35e7-4bcd-ae0a-56b1a148375a None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:15.095685 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0defa032-35e7-4bcd-ae0a-56b1a148375a None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:15.096006 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0defa032-35e7-4bcd-ae0a-56b1a148375a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:15.123402 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-0defa032-35e7-4bcd-ae0a-56b1a148375a None None] MFA Rules not processed for user `ae9e616d746243fd90a61824b726700a`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:23:15.124705 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-0defa032-35e7-4bcd-ae0a-56b1a148375a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:15.189777 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1231/2429] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:23:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:23:15.201272 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e68df5-a0fa-40a3-a7d7-8fd1be4b5d26 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:15.203300 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f7e68df5-a0fa-40a3-a7d7-8fd1be4b5d26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:15.217852 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:15.264825 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e68df5-a0fa-40a3-a7d7-8fd1be4b5d26 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:15.268459 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba776df3-3e7b-42e9-b280-e3684e1e2042 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f86373d65440da97c853fff3c1d0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:15.269114 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba776df3-3e7b-42e9-b280-e3684e1e2042 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:15.269405 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba776df3-3e7b-42e9-b280-e3684e1e2042 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:15.269661 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba776df3-3e7b-42e9-b280-e3684e1e2042 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:15.278225 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba776df3-3e7b-42e9-b280-e3684e1e2042 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:15.279675 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba776df3-3e7b-42e9-b280-e3684e1e2042 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:15.288423 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1199/2430] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:23:15 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:23:15.312139 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0defa032-35e7-4bcd-ae0a-56b1a148375a None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:15.373715 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:15.381741 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0defa032-35e7-4bcd-ae0a-56b1a148375a None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:15.386794 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdd006c-ea26-4530-834c-1191fb71670e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:15.387790 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd006c-ea26-4530-834c-1191fb71670e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:15.388116 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd006c-ea26-4530-834c-1191fb71670e admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:15.388398 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd006c-ea26-4530-834c-1191fb71670e admin admin] PATH_INFO: `/v3/users/ae9e616d746243fd90a61824b726700a` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:15.389719 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdd006c-ea26-4530-834c-1191fb71670e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae9e616d746243fd90a61824b726700a)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:15.391674 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdd006c-ea26-4530-834c-1191fb71670e admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:15.444827 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-6bdd006c-ea26-4530-834c-1191fb71670e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae9e616d746243fd90a61824b726700a'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:15.461091 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-6bdd006c-ea26-4530-834c-1191fb71670e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae9e616d746243fd90a61824b726700a'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:15.467679 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-6bdd006c-ea26-4530-834c-1191fb71670e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae9e616d746243fd90a61824b726700a'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:15.469515 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-6bdd006c-ea26-4530-834c-1191fb71670e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae9e616d746243fd90a61824b726700a'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:15.492569 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-6bdd006c-ea26-4530-834c-1191fb71670e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae9e616d746243fd90a61824b726700a'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:15.506159 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1232/2431] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:23:15 2022] DELETE /identity/v3/users/ae9e616d746243fd90a61824b726700a => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:23:15.510769 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ab0b9-09d5-4dbd-a496-d2c4b5d32914 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:15.511282 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ab0b9-09d5-4dbd-a496-d2c4b5d32914 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:15.511412 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ab0b9-09d5-4dbd-a496-d2c4b5d32914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:15.535185 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-5a6ab0b9-09d5-4dbd-a496-d2c4b5d32914 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:23:15.536428 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-5a6ab0b9-09d5-4dbd-a496-d2c4b5d32914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:15.611338 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1200/2432] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:23:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:23:15.619264 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdd006c-ea26-4530-834c-1191fb71670e admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:15.621107 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-6bdd006c-ea26-4530-834c-1191fb71670e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:15.682133 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdd006c-ea26-4530-834c-1191fb71670e admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:15.685795 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282965a5-cd43-46e6-af90-f4f9c19c35d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:15.686452 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282965a5-cd43-46e6-af90-f4f9c19c35d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:15.686747 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282965a5-cd43-46e6-af90-f4f9c19c35d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:15.687017 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282965a5-cd43-46e6-af90-f4f9c19c35d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:15.696282 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282965a5-cd43-46e6-af90-f4f9c19c35d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:15.697668 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282965a5-cd43-46e6-af90-f4f9c19c35d4 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:15.707113 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1233/2433] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:23:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:23:15.996986 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6ab0b9-09d5-4dbd-a496-d2c4b5d32914 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:15.998762 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-5a6ab0b9-09d5-4dbd-a496-d2c4b5d32914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:16.016845 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6ab0b9-09d5-4dbd-a496-d2c4b5d32914 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:16.028148 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae707eb2-5b79-466e-928b-fb78bc4ce475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:16.029153 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae707eb2-5b79-466e-928b-fb78bc4ce475 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:16.029431 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae707eb2-5b79-466e-928b-fb78bc4ce475 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:16.029715 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae707eb2-5b79-466e-928b-fb78bc4ce475 admin admin] PATH_INFO: `/v3/projects/376133ca95be46ba93e95fa0bef49905` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:16.031186 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae707eb2-5b79-466e-928b-fb78bc4ce475 admin admin] RBAC: Authorizing `identity:delete_project(project_id=376133ca95be46ba93e95fa0bef49905)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:16.033264 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae707eb2-5b79-466e-928b-fb78bc4ce475 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:16.089473 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ae707eb2-5b79-466e-928b-fb78bc4ce475 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '376133ca95be46ba93e95fa0bef49905', 'request_id': 'req-ae707eb2-5b79-466e-928b-fb78bc4ce475'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:16.095378 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ae707eb2-5b79-466e-928b-fb78bc4ce475 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '376133ca95be46ba93e95fa0bef49905', 'request_id': 'req-ae707eb2-5b79-466e-928b-fb78bc4ce475'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:16.104769 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ae707eb2-5b79-466e-928b-fb78bc4ce475 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '376133ca95be46ba93e95fa0bef49905', 'request_id': 'req-ae707eb2-5b79-466e-928b-fb78bc4ce475'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:16.116057 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ae707eb2-5b79-466e-928b-fb78bc4ce475 admin admin] The token cache is being invalidate because project 376133ca95be46ba93e95fa0bef49905 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:23:16.116345 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ae707eb2-5b79-466e-928b-fb78bc4ce475 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:16.116964 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ae707eb2-5b79-466e-928b-fb78bc4ce475 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:16.118523 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1201/2434] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:23:15 2022] DELETE /identity/v3/projects/376133ca95be46ba93e95fa0bef49905 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:23:16.123732 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ff533e-29cc-4553-aef0-4724c80271cb None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:16.124064 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ff533e-29cc-4553-aef0-4724c80271cb None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:16.124373 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ff533e-29cc-4553-aef0-4724c80271cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:16.142498 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-b7ff533e-29cc-4553-aef0-4724c80271cb None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:23:16.143727 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-b7ff533e-29cc-4553-aef0-4724c80271cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:16.206419 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1234/2435] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:23:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:23:16.214262 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07de13-a5e3-46bb-a3d3-70fc2936df43 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:16.214552 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07de13-a5e3-46bb-a3d3-70fc2936df43 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:16.214829 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07de13-a5e3-46bb-a3d3-70fc2936df43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:16.236927 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-dc07de13-a5e3-46bb-a3d3-70fc2936df43 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:23:16.238241 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-dc07de13-a5e3-46bb-a3d3-70fc2936df43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:16.247080 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1202/2436] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:23:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:23:16.251412 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ff533e-29cc-4553-aef0-4724c80271cb None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:16.261134 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ff533e-29cc-4553-aef0-4724c80271cb None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:16.265870 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448ee9e1-277b-40ba-90cb-9a2b8c07bdf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:16.266521 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ee9e1-277b-40ba-90cb-9a2b8c07bdf5 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:16.266815 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ee9e1-277b-40ba-90cb-9a2b8c07bdf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:16.267078 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ee9e1-277b-40ba-90cb-9a2b8c07bdf5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:16.267804 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448ee9e1-277b-40ba-90cb-9a2b8c07bdf5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:23:16.268139 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448ee9e1-277b-40ba-90cb-9a2b8c07bdf5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:16.269759 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448ee9e1-277b-40ba-90cb-9a2b8c07bdf5 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:16.281535 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1235/2437] 10.222.0.42 () {58 vars in 1152 bytes} [Mon Jul 4 09:23:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:23:16.286070 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc07de13-a5e3-46bb-a3d3-70fc2936df43 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:16.295995 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc07de13-a5e3-46bb-a3d3-70fc2936df43 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:16.301403 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326f93cc-af48-4c99-a56a-d02d67699827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:16.302044 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f93cc-af48-4c99-a56a-d02d67699827 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:16.302324 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f93cc-af48-4c99-a56a-d02d67699827 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:16.302621 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f93cc-af48-4c99-a56a-d02d67699827 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:16.303316 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326f93cc-af48-4c99-a56a-d02d67699827 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:16.305320 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326f93cc-af48-4c99-a56a-d02d67699827 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:16.336414 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1203/2438] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:23:16 2022] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:23:16.341564 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448ee9e1-277b-40ba-90cb-9a2b8c07bdf5 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:16.352832 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:16.359114 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448ee9e1-277b-40ba-90cb-9a2b8c07bdf5 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:16.423038 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec26751f-86b9-452c-8284-3e74025b048e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:16.424055 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26751f-86b9-452c-8284-3e74025b048e admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:16.424425 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26751f-86b9-452c-8284-3e74025b048e admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:16.424769 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26751f-86b9-452c-8284-3e74025b048e admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:16.425844 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec26751f-86b9-452c-8284-3e74025b048e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:16.428492 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec26751f-86b9-452c-8284-3e74025b048e admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:16.450767 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1236/2439] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:23:16 2022] POST /identity/v3/users => generated 288 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:23:16.455232 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326f93cc-af48-4c99-a56a-d02d67699827 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:16.465935 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326f93cc-af48-4c99-a56a-d02d67699827 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:16.471193 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b6bb04-0467-4349-b751-a8b6a8a6d2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:16.471846 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b6bb04-0467-4349-b751-a8b6a8a6d2bf admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:16.472158 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b6bb04-0467-4349-b751-a8b6a8a6d2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:16.472433 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b6bb04-0467-4349-b751-a8b6a8a6d2bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:16.473193 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b6bb04-0467-4349-b751-a8b6a8a6d2bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:16.474817 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b6bb04-0467-4349-b751-a8b6a8a6d2bf admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:16.480096 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:16.485714 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1204/2440] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:23:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:23:16.490337 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec26751f-86b9-452c-8284-3e74025b048e admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:16.500853 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec26751f-86b9-452c-8284-3e74025b048e admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:16.506313 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cab2e7-8074-4ab2-898f-4872c450d129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:16.506969 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cab2e7-8074-4ab2-898f-4872c450d129 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:16.507252 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cab2e7-8074-4ab2-898f-4872c450d129 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:16.507634 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cab2e7-8074-4ab2-898f-4872c450d129 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:16.508403 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cab2e7-8074-4ab2-898f-4872c450d129 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:16.510038 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cab2e7-8074-4ab2-898f-4872c450d129 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:16.520003 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1237/2441] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:23:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:23:16.524445 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b6bb04-0467-4349-b751-a8b6a8a6d2bf admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:16.535430 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b6bb04-0467-4349-b751-a8b6a8a6d2bf admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:16.541140 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d10546-4e39-4285-946d-7f18971b49cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:16.542022 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d10546-4e39-4285-946d-7f18971b49cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:16.542309 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d10546-4e39-4285-946d-7f18971b49cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:16.542584 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d10546-4e39-4285-946d-7f18971b49cf admin admin] PATH_INFO: `/v3/projects/8f6aed161af94fb4b7488f056652eb12/users/7560798fe5c44f52a4785a5a7fd7803e/roles/81634e7812344f84afcb29b0dba2687c` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:16.558352 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d10546-4e39-4285-946d-7f18971b49cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f6aed161af94fb4b7488f056652eb12, user_id=7560798fe5c44f52a4785a5a7fd7803e, role_id=81634e7812344f84afcb29b0dba2687c)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:16.561115 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d10546-4e39-4285-946d-7f18971b49cf admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:16.580759 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1205/2442] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:23:16 2022] PUT /identity/v3/projects/8f6aed161af94fb4b7488f056652eb12/users/7560798fe5c44f52a4785a5a7fd7803e/roles/81634e7812344f84afcb29b0dba2687c => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:23:16.649787 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920aab2a-a5f3-4cf8-bc37-ebc81f3c9294 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:16.650345 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920aab2a-a5f3-4cf8-bc37-ebc81f3c9294 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:16.650345 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920aab2a-a5f3-4cf8-bc37-ebc81f3c9294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:16.678869 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-920aab2a-a5f3-4cf8-bc37-ebc81f3c9294 None None] MFA Rules not processed for user `7560798fe5c44f52a4785a5a7fd7803e`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:23:16.680165 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-920aab2a-a5f3-4cf8-bc37-ebc81f3c9294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:16.792636 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1238/2443] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:23:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:23:16.801297 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d10546-4e39-4285-946d-7f18971b49cf admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:16.803076 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b4d10546-4e39-4285-946d-7f18971b49cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:16.808402 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920aab2a-a5f3-4cf8-bc37-ebc81f3c9294 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:16.810952 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-920aab2a-a5f3-4cf8-bc37-ebc81f3c9294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:16.868418 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d10546-4e39-4285-946d-7f18971b49cf admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:16.872018 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b067fd2c-dcc0-48a0-98e8-885880f272f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:16.872699 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b067fd2c-dcc0-48a0-98e8-885880f272f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:16.872973 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b067fd2c-dcc0-48a0-98e8-885880f272f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:16.873239 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b067fd2c-dcc0-48a0-98e8-885880f272f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:16.874984 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b067fd2c-dcc0-48a0-98e8-885880f272f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:16.877960 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920aab2a-a5f3-4cf8-bc37-ebc81f3c9294 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:16.881774 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bcb0d6-3286-453b-96b2-5f6fdf3f4689 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f86373d65440da97c853fff3c1d0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:16.882427 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bcb0d6-3286-453b-96b2-5f6fdf3f4689 service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:16.882711 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bcb0d6-3286-453b-96b2-5f6fdf3f4689 service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:16.882989 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bcb0d6-3286-453b-96b2-5f6fdf3f4689 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:16.894097 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bcb0d6-3286-453b-96b2-5f6fdf3f4689 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:16.895565 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bcb0d6-3286-453b-96b2-5f6fdf3f4689 service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:16.904885 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1239/2444] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:23:16 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:23:16.945282 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b067fd2c-dcc0-48a0-98e8-885880f272f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:16.946791 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b067fd2c-dcc0-48a0-98e8-885880f272f2 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:16.962122 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1206/2445] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:23:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:23:18.324315 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf323e-33e0-45d8-a0e4-d8e43f85d061 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:18.325290 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf323e-33e0-45d8-a0e4-d8e43f85d061 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:18.325576 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf323e-33e0-45d8-a0e4-d8e43f85d061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:18.355030 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-0aaf323e-33e0-45d8-a0e4-d8e43f85d061 None None] MFA Rules not processed for user `7560798fe5c44f52a4785a5a7fd7803e`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:23:18.362678 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-0aaf323e-33e0-45d8-a0e4-d8e43f85d061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:18.392900 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1240/2446] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:23:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:23:18.476345 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b067fd2c-dcc0-48a0-98e8-885880f272f2 service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:18.490942 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b067fd2c-dcc0-48a0-98e8-885880f272f2 service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:18.495623 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e8ab42-fdef-4744-9a2a-555e263d3bd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:18.497173 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8ab42-fdef-4744-9a2a-555e263d3bd1 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:18.497640 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8ab42-fdef-4744-9a2a-555e263d3bd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:18.498076 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8ab42-fdef-4744-9a2a-555e263d3bd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:18.501557 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-17e8ab42-fdef-4744-9a2a-555e263d3bd1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:18.524698 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e8ab42-fdef-4744-9a2a-555e263d3bd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:18.533376 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e8ab42-fdef-4744-9a2a-555e263d3bd1 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:18.557790 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1207/2447] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:23:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:23:18.999466 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaf323e-33e0-45d8-a0e4-d8e43f85d061 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:19.001710 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-0aaf323e-33e0-45d8-a0e4-d8e43f85d061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:19.021634 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaf323e-33e0-45d8-a0e4-d8e43f85d061 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:19.027491 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a28dda-7020-4962-8d9b-6d0f09793371 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:19.028349 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a28dda-7020-4962-8d9b-6d0f09793371 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:19.028791 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a28dda-7020-4962-8d9b-6d0f09793371 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:19.029637 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a28dda-7020-4962-8d9b-6d0f09793371 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:19.032278 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-33a28dda-7020-4962-8d9b-6d0f09793371 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:19.042293 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:19.046027 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a28dda-7020-4962-8d9b-6d0f09793371 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:19.047722 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a28dda-7020-4962-8d9b-6d0f09793371 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:19.062724 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1241/2448] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:23:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:23:19.225829 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb17602-0d8d-4fe0-af99-7c49546e492e None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:19.226118 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb17602-0d8d-4fe0-af99-7c49546e492e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:19.226396 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb17602-0d8d-4fe0-af99-7c49546e492e None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:19.228245 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1208/2449] 10.222.0.42 () {54 vars in 921 bytes} [Mon Jul 4 09:23:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:23:19.234423 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9480bb0-6fa3-4816-81e6-37ad31e3e844 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:19.234710 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9480bb0-6fa3-4816-81e6-37ad31e3e844 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:19.234985 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9480bb0-6fa3-4816-81e6-37ad31e3e844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:19.296029 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-a9480bb0-6fa3-4816-81e6-37ad31e3e844 None None] MFA Rules not processed for user `af3b6e252a8c434a99432bcece6493b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:23:19.297246 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-a9480bb0-6fa3-4816-81e6-37ad31e3e844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:19.400710 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1242/2450] 10.222.0.42 () {58 vars in 1018 bytes} [Mon Jul 4 09:23:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:23:19.403043 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb17602-0d8d-4fe0-af99-7c49546e492e None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:19.405471 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9fb17602-0d8d-4fe0-af99-7c49546e492e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:19.417516 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9480bb0-6fa3-4816-81e6-37ad31e3e844 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:19.419468 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-a9480bb0-6fa3-4816-81e6-37ad31e3e844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:19.491748 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9480bb0-6fa3-4816-81e6-37ad31e3e844 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:19.496355 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eaa7f2-9938-4197-9517-de6bbceb51f1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92e3804048824cde829e6273ce7c19b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:19.497019 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eaa7f2-9938-4197-9517-de6bbceb51f1 service glance] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:19.497345 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eaa7f2-9938-4197-9517-de6bbceb51f1 service glance] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:19.497626 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eaa7f2-9938-4197-9517-de6bbceb51f1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:19.510785 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eaa7f2-9938-4197-9517-de6bbceb51f1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:19.512463 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eaa7f2-9938-4197-9517-de6bbceb51f1 service glance] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:19.517304 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb17602-0d8d-4fe0-af99-7c49546e492e None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:19.542104 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1243/2451] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:23:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 09:23:19.543001 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce106edf-ac77-418f-a001-7519b769a3cd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46ec1a2091f1434cabc69066eb3b6725', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:19.543848 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce106edf-ac77-418f-a001-7519b769a3cd service placement] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:19.544340 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce106edf-ac77-418f-a001-7519b769a3cd service placement] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:19.544611 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce106edf-ac77-418f-a001-7519b769a3cd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:19.547486 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ce106edf-ac77-418f-a001-7519b769a3cd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:19.570176 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce106edf-ac77-418f-a001-7519b769a3cd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:19.572165 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce106edf-ac77-418f-a001-7519b769a3cd service placement] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:19.608794 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1209/2452] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:23:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 09:23:19.648860 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605dd6e5-07eb-41d4-80e0-1d7143a154ac None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:19.649515 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605dd6e5-07eb-41d4-80e0-1d7143a154ac None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:19.649952 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605dd6e5-07eb-41d4-80e0-1d7143a154ac None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:19.651598 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1244/2453] 10.222.0.42 () {54 vars in 921 bytes} [Mon Jul 4 09:23:19 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:23:19.668768 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be96f51-6835-464a-a5c1-55077baa554f None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:19.669113 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be96f51-6835-464a-a5c1-55077baa554f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:19.669393 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be96f51-6835-464a-a5c1-55077baa554f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:19.676741 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:19.699641 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-6be96f51-6835-464a-a5c1-55077baa554f None None] MFA Rules not processed for user `4db0575f076240559f64e9548b56ffeb`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:23:19.700964 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6be96f51-6835-464a-a5c1-55077baa554f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:19.708861 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1210/2454] 10.222.0.42 () {58 vars in 1018 bytes} [Mon Jul 4 09:23:19 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:23:19.729276 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605dd6e5-07eb-41d4-80e0-1d7143a154ac None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:19.749227 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605dd6e5-07eb-41d4-80e0-1d7143a154ac None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:19.758625 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a5d287-93b3-4730-a245-7c44369ac6d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:19.759747 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5d287-93b3-4730-a245-7c44369ac6d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:19.760337 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5d287-93b3-4730-a245-7c44369ac6d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:19.763986 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5d287-93b3-4730-a245-7c44369ac6d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:19.785276 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a5d287-93b3-4730-a245-7c44369ac6d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:19.787570 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a5d287-93b3-4730-a245-7c44369ac6d9 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:19.801543 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1245/2455] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:23:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 09:23:20.632919 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be96f51-6835-464a-a5c1-55077baa554f None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:20.634675 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6be96f51-6835-464a-a5c1-55077baa554f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:20.656280 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be96f51-6835-464a-a5c1-55077baa554f None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:20.661603 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa3a92-edbc-4314-8b6e-ac36a6c93a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:20.662816 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa3a92-edbc-4314-8b6e-ac36a6c93a64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:20.663239 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa3a92-edbc-4314-8b6e-ac36a6c93a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:20.663852 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa3a92-edbc-4314-8b6e-ac36a6c93a64 admin admin] PATH_INFO: `/v3/users/defd27b64b204349a191a7b50b2d4cc4` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:20.665516 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fa3a92-edbc-4314-8b6e-ac36a6c93a64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=defd27b64b204349a191a7b50b2d4cc4)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:20.668068 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fa3a92-edbc-4314-8b6e-ac36a6c93a64 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:20.755020 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e9fa3a92-edbc-4314-8b6e-ac36a6c93a64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'defd27b64b204349a191a7b50b2d4cc4'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:20.756736 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e9fa3a92-edbc-4314-8b6e-ac36a6c93a64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'defd27b64b204349a191a7b50b2d4cc4'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:20.787150 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e9fa3a92-edbc-4314-8b6e-ac36a6c93a64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'defd27b64b204349a191a7b50b2d4cc4'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:20.788061 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e9fa3a92-edbc-4314-8b6e-ac36a6c93a64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'defd27b64b204349a191a7b50b2d4cc4'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:20.815402 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e9fa3a92-edbc-4314-8b6e-ac36a6c93a64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'defd27b64b204349a191a7b50b2d4cc4'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:20.841464 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1211/2456] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:23:20 2022] DELETE /identity/v3/users/defd27b64b204349a191a7b50b2d4cc4 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:23:21.495135 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a5d287-93b3-4730-a245-7c44369ac6d9 service neutron] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:21.533173 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a5d287-93b3-4730-a245-7c44369ac6d9 service neutron] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:21.613547 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b54443-9530-465b-acd1-07d23bac4d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:21.615098 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b54443-9530-465b-acd1-07d23bac4d1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:21.615541 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b54443-9530-465b-acd1-07d23bac4d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:21.615998 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b54443-9530-465b-acd1-07d23bac4d1d admin admin] PATH_INFO: `/v3/projects/fa3b91395ec24070a3ee1c31cbf9ac63` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:21.617460 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b54443-9530-465b-acd1-07d23bac4d1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa3b91395ec24070a3ee1c31cbf9ac63)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:21.619950 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b54443-9530-465b-acd1-07d23bac4d1d admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:21.629351 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:21.696575 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-97b54443-9530-465b-acd1-07d23bac4d1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa3b91395ec24070a3ee1c31cbf9ac63', 'request_id': 'req-97b54443-9530-465b-acd1-07d23bac4d1d'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:21.711762 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-97b54443-9530-465b-acd1-07d23bac4d1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa3b91395ec24070a3ee1c31cbf9ac63', 'request_id': 'req-97b54443-9530-465b-acd1-07d23bac4d1d'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:21.719316 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-97b54443-9530-465b-acd1-07d23bac4d1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa3b91395ec24070a3ee1c31cbf9ac63', 'request_id': 'req-97b54443-9530-465b-acd1-07d23bac4d1d'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:21.735783 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-97b54443-9530-465b-acd1-07d23bac4d1d admin admin] The token cache is being invalidate because project fa3b91395ec24070a3ee1c31cbf9ac63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:23:21.736369 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-97b54443-9530-465b-acd1-07d23bac4d1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:21.737317 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-97b54443-9530-465b-acd1-07d23bac4d1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:21.739431 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1246/2457] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:23:21 2022] DELETE /identity/v3/projects/fa3b91395ec24070a3ee1c31cbf9ac63 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:23:21.746281 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ca5be-a993-49bc-9c4b-20f487362341 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:21.746884 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ca5be-a993-49bc-9c4b-20f487362341 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:21.747248 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ca5be-a993-49bc-9c4b-20f487362341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:21.769165 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-3a9ca5be-a993-49bc-9c4b-20f487362341 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:23:21.770799 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3a9ca5be-a993-49bc-9c4b-20f487362341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:21.884165 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b2747-a931-46ba-9357-77cf8114e9ed None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:21.884165 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b2747-a931-46ba-9357-77cf8114e9ed None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:21.884165 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b2747-a931-46ba-9357-77cf8114e9ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:21.890058 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1212/2458] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:23:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:23:21.906182 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-307b2747-a931-46ba-9357-77cf8114e9ed None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:23:21.907429 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-307b2747-a931-46ba-9357-77cf8114e9ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:21.919275 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1247/2459] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:23:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:23:21.920580 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9ca5be-a993-49bc-9c4b-20f487362341 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:21.936180 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9ca5be-a993-49bc-9c4b-20f487362341 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:21.946266 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c55c62-a369-45b5-aff4-e12d05cad5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:21.947071 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c55c62-a369-45b5-aff4-e12d05cad5b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:21.947424 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c55c62-a369-45b5-aff4-e12d05cad5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:21.947771 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c55c62-a369-45b5-aff4-e12d05cad5b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:21.949500 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c55c62-a369-45b5-aff4-e12d05cad5b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:23:21.949884 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c55c62-a369-45b5-aff4-e12d05cad5b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:21.952151 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c55c62-a369-45b5-aff4-e12d05cad5b0 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:21.971108 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1213/2460] 10.222.0.42 () {58 vars in 1152 bytes} [Mon Jul 4 09:23:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:23:21.972766 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307b2747-a931-46ba-9357-77cf8114e9ed None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:21.984676 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307b2747-a931-46ba-9357-77cf8114e9ed None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:21.991052 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aff6f7-1ec0-43b5-abc0-217f023a1181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:21.992307 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aff6f7-1ec0-43b5-abc0-217f023a1181 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:21.992805 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aff6f7-1ec0-43b5-abc0-217f023a1181 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:21.993227 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aff6f7-1ec0-43b5-abc0-217f023a1181 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:21.994125 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aff6f7-1ec0-43b5-abc0-217f023a1181 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:21.997047 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aff6f7-1ec0-43b5-abc0-217f023a1181 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:22.034206 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1248/2461] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:23:21 2022] POST /identity/v3/projects => generated 365 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:23:22.038681 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c55c62-a369-45b5-aff4-e12d05cad5b0 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:22.051133 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c55c62-a369-45b5-aff4-e12d05cad5b0 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:22.117535 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:22.129070 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d1b5dc-c1e8-4508-937e-f4139136c325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:22.130666 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d1b5dc-c1e8-4508-937e-f4139136c325 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:22.132411 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d1b5dc-c1e8-4508-937e-f4139136c325 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:22.132942 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d1b5dc-c1e8-4508-937e-f4139136c325 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:22.133943 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d1b5dc-c1e8-4508-937e-f4139136c325 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:22.136766 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d1b5dc-c1e8-4508-937e-f4139136c325 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:22.170345 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1214/2462] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:23:22 2022] POST /identity/v3/users => generated 283 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:23:22.171242 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aff6f7-1ec0-43b5-abc0-217f023a1181 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:22.188242 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aff6f7-1ec0-43b5-abc0-217f023a1181 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:22.196890 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5224dbc-9dfd-474f-a32f-0084c80dc14c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:22.197589 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5224dbc-9dfd-474f-a32f-0084c80dc14c admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:22.197874 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5224dbc-9dfd-474f-a32f-0084c80dc14c admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:22.198148 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5224dbc-9dfd-474f-a32f-0084c80dc14c admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:22.202521 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5224dbc-9dfd-474f-a32f-0084c80dc14c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:22.208889 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5224dbc-9dfd-474f-a32f-0084c80dc14c admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:22.239560 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1249/2463] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:23:22 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:23:22.240909 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d1b5dc-c1e8-4508-937e-f4139136c325 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:22.254017 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d1b5dc-c1e8-4508-937e-f4139136c325 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:22.262677 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70a82ef-506d-4014-b38a-a51a63d2d29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:22.263571 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a82ef-506d-4014-b38a-a51a63d2d29d admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:22.263950 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a82ef-506d-4014-b38a-a51a63d2d29d admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:22.264352 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a82ef-506d-4014-b38a-a51a63d2d29d admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:22.266126 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70a82ef-506d-4014-b38a-a51a63d2d29d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:22.269134 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70a82ef-506d-4014-b38a-a51a63d2d29d admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:22.282650 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1215/2464] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:23:22 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:23:22.287143 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5224dbc-9dfd-474f-a32f-0084c80dc14c admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:22.300090 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5224dbc-9dfd-474f-a32f-0084c80dc14c admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:22.305760 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e36e73f-f708-4ed7-81f9-7da7c835dbc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:22.306771 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36e73f-f708-4ed7-81f9-7da7c835dbc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:22.307063 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36e73f-f708-4ed7-81f9-7da7c835dbc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:22.307335 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36e73f-f708-4ed7-81f9-7da7c835dbc9 admin admin] PATH_INFO: `/v3/projects/2169eb4071f14915921da23084f5275f/users/5b0d13cbb5724abda086077ba890791c/roles/81634e7812344f84afcb29b0dba2687c` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:22.326077 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e36e73f-f708-4ed7-81f9-7da7c835dbc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2169eb4071f14915921da23084f5275f, user_id=5b0d13cbb5724abda086077ba890791c, role_id=81634e7812344f84afcb29b0dba2687c)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:22.328885 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e36e73f-f708-4ed7-81f9-7da7c835dbc9 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:22.363503 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1250/2465] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:23:22 2022] PUT /identity/v3/projects/2169eb4071f14915921da23084f5275f/users/5b0d13cbb5724abda086077ba890791c/roles/81634e7812344f84afcb29b0dba2687c => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:23:22.365872 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeec2ce-3f1d-49f6-a0f0-355521f9e8f3 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:22.366166 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeec2ce-3f1d-49f6-a0f0-355521f9e8f3 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:22.366448 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeec2ce-3f1d-49f6-a0f0-355521f9e8f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:22.398575 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-8eeec2ce-3f1d-49f6-a0f0-355521f9e8f3 None None] MFA Rules not processed for user `5b0d13cbb5724abda086077ba890791c`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:23:22.399433 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-8eeec2ce-3f1d-49f6-a0f0-355521f9e8f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:22.473445 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1216/2466] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:23:22 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:23:22.474663 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e36e73f-f708-4ed7-81f9-7da7c835dbc9 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:22.620739 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e36e73f-f708-4ed7-81f9-7da7c835dbc9 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:22.627683 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2139228-9da5-44f9-9643-1e32e9152ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:22.628655 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2139228-9da5-44f9-9643-1e32e9152ead admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:22.629092 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2139228-9da5-44f9-9643-1e32e9152ead admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:22.629554 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2139228-9da5-44f9-9643-1e32e9152ead admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:22.631071 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2139228-9da5-44f9-9643-1e32e9152ead admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:22.633963 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2139228-9da5-44f9-9643-1e32e9152ead admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:22.678216 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1251/2467] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:23:22 2022] POST /identity/v3/projects => generated 363 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:23:22.679608 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeec2ce-3f1d-49f6-a0f0-355521f9e8f3 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:22.692669 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeec2ce-3f1d-49f6-a0f0-355521f9e8f3 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:22.778063 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720fee82-a1b4-43af-acbc-5e6d9102d479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:22.778692 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720fee82-a1b4-43af-acbc-5e6d9102d479 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:22.779012 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720fee82-a1b4-43af-acbc-5e6d9102d479 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:22.779481 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720fee82-a1b4-43af-acbc-5e6d9102d479 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:22.780225 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720fee82-a1b4-43af-acbc-5e6d9102d479 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:22.782313 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720fee82-a1b4-43af-acbc-5e6d9102d479 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:22.806817 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1217/2468] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:23:22 2022] POST /identity/v3/users => generated 288 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:23:22.810747 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2139228-9da5-44f9-9643-1e32e9152ead admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:22.824224 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2139228-9da5-44f9-9643-1e32e9152ead admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:22.829516 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee3b747-9946-4f37-9978-6bf0859b0a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:22.830189 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee3b747-9946-4f37-9978-6bf0859b0a2c admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:22.830497 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee3b747-9946-4f37-9978-6bf0859b0a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:22.830745 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee3b747-9946-4f37-9978-6bf0859b0a2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:22.831484 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee3b747-9946-4f37-9978-6bf0859b0a2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:22.834560 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee3b747-9946-4f37-9978-6bf0859b0a2c admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:22.854035 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1252/2469] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:23:22 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:23:22.855493 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720fee82-a1b4-43af-acbc-5e6d9102d479 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:22.867378 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720fee82-a1b4-43af-acbc-5e6d9102d479 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:22.872283 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ade6e1-def6-4abb-889b-d63b7bee5de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:22.873334 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ade6e1-def6-4abb-889b-d63b7bee5de7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:22.873646 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ade6e1-def6-4abb-889b-d63b7bee5de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:22.874343 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ade6e1-def6-4abb-889b-d63b7bee5de7 admin admin] PATH_INFO: `/v3/projects/3cd482ae4ba74616a11ec2a64c806213/users/c1ccd79ebe9246f1970b71f921d00e23/roles/965049e7ce6144aaad23c15f3a5e37c3` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:22.906591 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ade6e1-def6-4abb-889b-d63b7bee5de7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cd482ae4ba74616a11ec2a64c806213, user_id=c1ccd79ebe9246f1970b71f921d00e23, role_id=965049e7ce6144aaad23c15f3a5e37c3)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:22.909665 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ade6e1-def6-4abb-889b-d63b7bee5de7 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:22.936395 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee3b747-9946-4f37-9978-6bf0859b0a2c admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:22.942562 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1218/2470] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:23:22 2022] PUT /identity/v3/projects/3cd482ae4ba74616a11ec2a64c806213/users/c1ccd79ebe9246f1970b71f921d00e23/roles/965049e7ce6144aaad23c15f3a5e37c3 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:23:22.948936 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:22.954972 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee3b747-9946-4f37-9978-6bf0859b0a2c admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:23.097635 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfde52b5-e6c5-4423-a360-2b9c1c404b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:23.104868 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde52b5-e6c5-4423-a360-2b9c1c404b7e admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:23.105178 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde52b5-e6c5-4423-a360-2b9c1c404b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:23.105442 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde52b5-e6c5-4423-a360-2b9c1c404b7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:23.106238 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfde52b5-e6c5-4423-a360-2b9c1c404b7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:23.107992 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfde52b5-e6c5-4423-a360-2b9c1c404b7e admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:23.142230 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1253/2471] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:23:22 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:23:23.146822 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ade6e1-def6-4abb-889b-d63b7bee5de7 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:23.175230 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ade6e1-def6-4abb-889b-d63b7bee5de7 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:23.181572 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f3b51d-d866-4378-94e5-d5675756fb81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:23.182658 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3b51d-d866-4378-94e5-d5675756fb81 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:23.183017 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3b51d-d866-4378-94e5-d5675756fb81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:23.183814 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3b51d-d866-4378-94e5-d5675756fb81 admin admin] PATH_INFO: `/v3/projects/3cd482ae4ba74616a11ec2a64c806213/users/c1ccd79ebe9246f1970b71f921d00e23/roles/965049e7ce6144aaad23c15f3a5e37c3` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:23.186256 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f3b51d-d866-4378-94e5-d5675756fb81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cd482ae4ba74616a11ec2a64c806213, user_id=c1ccd79ebe9246f1970b71f921d00e23, role_id=965049e7ce6144aaad23c15f3a5e37c3)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:23.189484 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f3b51d-d866-4378-94e5-d5675756fb81 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:23.272552 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1219/2472] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:23:23 2022] PUT /identity/v3/projects/3cd482ae4ba74616a11ec2a64c806213/users/c1ccd79ebe9246f1970b71f921d00e23/roles/965049e7ce6144aaad23c15f3a5e37c3 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:23:23.274181 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d224c06a-f2fc-4644-aef3-c0abff4155fb None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:23.274932 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d224c06a-f2fc-4644-aef3-c0abff4155fb None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:23.275292 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d224c06a-f2fc-4644-aef3-c0abff4155fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:23.328845 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-d224c06a-f2fc-4644-aef3-c0abff4155fb None None] MFA Rules not processed for user `c1ccd79ebe9246f1970b71f921d00e23`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:23:23.332122 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-d224c06a-f2fc-4644-aef3-c0abff4155fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:23.352637 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7af2ba-6f5f-4d73-bea2-070965d2e81c None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:23.352940 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7af2ba-6f5f-4d73-bea2-070965d2e81c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:23.353221 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7af2ba-6f5f-4d73-bea2-070965d2e81c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:23.398771 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-bd7af2ba-6f5f-4d73-bea2-070965d2e81c None None] MFA Rules not processed for user `bd758d5b21684027b0d199021df0ad2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:23:23.400317 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-bd7af2ba-6f5f-4d73-bea2-070965d2e81c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:23.413647 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:23.511129 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1254/2473] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:23:23 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:23:23.522145 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d224c06a-f2fc-4644-aef3-c0abff4155fb None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:23.523863 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-d224c06a-f2fc-4644-aef3-c0abff4155fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:23.533272 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1220/2474] 10.222.0.42 () {58 vars in 1009 bytes} [Mon Jul 4 09:23:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:23:23.549561 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7af2ba-6f5f-4d73-bea2-070965d2e81c None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:23.552803 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-bd7af2ba-6f5f-4d73-bea2-070965d2e81c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:23.655544 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d224c06a-f2fc-4644-aef3-c0abff4155fb None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:23.666553 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5be4fec-f52d-4830-aa40-9667adf2442c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f86373d65440da97c853fff3c1d0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:23.667479 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be4fec-f52d-4830-aa40-9667adf2442c service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:23.668379 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be4fec-f52d-4830-aa40-9667adf2442c service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:23.668852 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be4fec-f52d-4830-aa40-9667adf2442c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:23.682501 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7af2ba-6f5f-4d73-bea2-070965d2e81c None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:23.685905 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5be4fec-f52d-4830-aa40-9667adf2442c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:23.687587 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5be4fec-f52d-4830-aa40-9667adf2442c service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:23.691742 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf6843-cd94-46f7-8ac0-c840479fecbb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59d8698c45fb46259765eb3c8de2297f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:23.692387 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf6843-cd94-46f7-8ac0-c840479fecbb service swift] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:23.692672 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf6843-cd94-46f7-8ac0-c840479fecbb service swift] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:23.693138 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf6843-cd94-46f7-8ac0-c840479fecbb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:23.713048 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1255/2475] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:23:23 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:23:23.718395 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cf6843-cd94-46f7-8ac0-c840479fecbb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:23.720538 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cf6843-cd94-46f7-8ac0-c840479fecbb service swift] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:23.731153 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1221/2476] 10.222.0.42 () {60 vars in 1384 bytes} [Mon Jul 4 09:23:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 04 09:23:23.849280 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5be4fec-f52d-4830-aa40-9667adf2442c service cinder] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:23.859580 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5be4fec-f52d-4830-aa40-9667adf2442c service cinder] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:23.871504 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29388f67-e4d7-46dc-9784-cdca97560c23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f86373d65440da97c853fff3c1d0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:23.872585 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29388f67-e4d7-46dc-9784-cdca97560c23 service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:23.873022 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29388f67-e4d7-46dc-9784-cdca97560c23 service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:23.873513 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29388f67-e4d7-46dc-9784-cdca97560c23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:23.943786 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:24.008288 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29388f67-e4d7-46dc-9784-cdca97560c23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:24.010519 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29388f67-e4d7-46dc-9784-cdca97560c23 service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:24.030729 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1256/2477] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:23:23 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:23:24.366359 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf6843-cd94-46f7-8ac0-c840479fecbb service swift] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:24.368752 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-69cf6843-cd94-46f7-8ac0-c840479fecbb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:24.486814 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf6843-cd94-46f7-8ac0-c840479fecbb service swift] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:24.489789 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29388f67-e4d7-46dc-9784-cdca97560c23 service cinder] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:24.491075 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-29388f67-e4d7-46dc-9784-cdca97560c23 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:24.495007 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c4f4f-8155-48d8-8c8c-8018285c21a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:24.496892 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c4f4f-8155-48d8-8c8c-8018285c21a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:24.497245 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c4f4f-8155-48d8-8c8c-8018285c21a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:24.497942 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c4f4f-8155-48d8-8c8c-8018285c21a3 admin admin] PATH_INFO: `/v3/users/6d13b840941349d78da243f9b4c2c72e` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:24.500079 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8c4f4f-8155-48d8-8c8c-8018285c21a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d13b840941349d78da243f9b4c2c72e)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:24.503112 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8c4f4f-8155-48d8-8c8c-8018285c21a3 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:24.623333 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-df8c4f4f-8155-48d8-8c8c-8018285c21a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d13b840941349d78da243f9b4c2c72e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:24.626287 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-df8c4f4f-8155-48d8-8c8c-8018285c21a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d13b840941349d78da243f9b4c2c72e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:24.638519 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:24.648237 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-df8c4f4f-8155-48d8-8c8c-8018285c21a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d13b840941349d78da243f9b4c2c72e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:24.650554 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-df8c4f4f-8155-48d8-8c8c-8018285c21a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d13b840941349d78da243f9b4c2c72e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:24.677908 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-df8c4f4f-8155-48d8-8c8c-8018285c21a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d13b840941349d78da243f9b4c2c72e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:24.701949 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1222/2478] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:23:24 2022] DELETE /identity/v3/users/6d13b840941349d78da243f9b4c2c72e => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:23:24.709205 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29388f67-e4d7-46dc-9784-cdca97560c23 service cinder] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:24.851706 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71db739-89b0-4ac6-a10f-a6d0eadd8f6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3b6e252a8c434a99432bcece6493b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:24.852600 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71db739-89b0-4ac6-a10f-a6d0eadd8f6a service nova] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:24.852963 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71db739-89b0-4ac6-a10f-a6d0eadd8f6a service nova] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:24.853487 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71db739-89b0-4ac6-a10f-a6d0eadd8f6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:24.855517 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-f71db739-89b0-4ac6-a10f-a6d0eadd8f6a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:24.900369 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71db739-89b0-4ac6-a10f-a6d0eadd8f6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:24.905881 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71db739-89b0-4ac6-a10f-a6d0eadd8f6a service nova] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:24.921548 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1257/2479] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:23:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:23:25.143248 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c4f4f-8155-48d8-8c8c-8018285c21a3 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:25.144946 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-df8c4f4f-8155-48d8-8c8c-8018285c21a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:25.245556 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c4f4f-8155-48d8-8c8c-8018285c21a3 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:25.252230 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e75d95-c794-4b60-9156-372d895dbd32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:25.253463 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e75d95-c794-4b60-9156-372d895dbd32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:25.254003 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e75d95-c794-4b60-9156-372d895dbd32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:25.254629 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e75d95-c794-4b60-9156-372d895dbd32 admin admin] PATH_INFO: `/v3/projects/47c7ac57b6244fb19f74f62d292107c3` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:25.256366 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e75d95-c794-4b60-9156-372d895dbd32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47c7ac57b6244fb19f74f62d292107c3)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:25.258645 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e75d95-c794-4b60-9156-372d895dbd32 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:25.348050 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-16e75d95-c794-4b60-9156-372d895dbd32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47c7ac57b6244fb19f74f62d292107c3', 'request_id': 'req-16e75d95-c794-4b60-9156-372d895dbd32'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:25.356910 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-16e75d95-c794-4b60-9156-372d895dbd32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47c7ac57b6244fb19f74f62d292107c3', 'request_id': 'req-16e75d95-c794-4b60-9156-372d895dbd32'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:25.369358 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-16e75d95-c794-4b60-9156-372d895dbd32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47c7ac57b6244fb19f74f62d292107c3', 'request_id': 'req-16e75d95-c794-4b60-9156-372d895dbd32'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:25.384218 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-16e75d95-c794-4b60-9156-372d895dbd32 admin admin] The token cache is being invalidate because project 47c7ac57b6244fb19f74f62d292107c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:23:25.384509 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-16e75d95-c794-4b60-9156-372d895dbd32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:25.385228 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-16e75d95-c794-4b60-9156-372d895dbd32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:25.386862 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1223/2480] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:23:25 2022] DELETE /identity/v3/projects/47c7ac57b6244fb19f74f62d292107c3 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:23:25.393914 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f16cfc-ac62-47c7-a419-e1bf26ef7db8 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:25.395586 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f16cfc-ac62-47c7-a419-e1bf26ef7db8 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:25.396140 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f16cfc-ac62-47c7-a419-e1bf26ef7db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:25.453020 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-22f16cfc-ac62-47c7-a419-e1bf26ef7db8 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:23:25.454785 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-22f16cfc-ac62-47c7-a419-e1bf26ef7db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:25.572281 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:25.599103 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1258/2481] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:23:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:23:25.607478 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d1acf-7929-4651-8763-d6d3bee787c9 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:25.607754 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d1acf-7929-4651-8763-d6d3bee787c9 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:25.608124 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d1acf-7929-4651-8763-d6d3bee787c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:25.642882 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-dd9d1acf-7929-4651-8763-d6d3bee787c9 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:23:25.645027 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-dd9d1acf-7929-4651-8763-d6d3bee787c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:25.660459 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1224/2482] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:23:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:23:25.662058 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f16cfc-ac62-47c7-a419-e1bf26ef7db8 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:25.676039 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f16cfc-ac62-47c7-a419-e1bf26ef7db8 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:25.688323 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd145d5-349a-46a9-86d9-097490da0e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:25.689473 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd145d5-349a-46a9-86d9-097490da0e3b admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:25.689975 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd145d5-349a-46a9-86d9-097490da0e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:25.690490 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd145d5-349a-46a9-86d9-097490da0e3b admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:25.691796 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd145d5-349a-46a9-86d9-097490da0e3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:23:25.692228 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd145d5-349a-46a9-86d9-097490da0e3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:25.694895 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd145d5-349a-46a9-86d9-097490da0e3b admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:25.712669 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1259/2483] 10.222.0.42 () {58 vars in 1152 bytes} [Mon Jul 4 09:23:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:23:25.717596 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9d1acf-7929-4651-8763-d6d3bee787c9 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:25.732125 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9d1acf-7929-4651-8763-d6d3bee787c9 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:25.737653 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b681e469-ac38-4ff9-82de-d910e99fbb50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:25.738258 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b681e469-ac38-4ff9-82de-d910e99fbb50 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:25.738614 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b681e469-ac38-4ff9-82de-d910e99fbb50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:25.739018 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b681e469-ac38-4ff9-82de-d910e99fbb50 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:25.739702 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b681e469-ac38-4ff9-82de-d910e99fbb50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:25.742001 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b681e469-ac38-4ff9-82de-d910e99fbb50 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:25.788709 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1225/2484] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:23:25 2022] POST /identity/v3/projects => generated 373 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:23:25.793188 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd145d5-349a-46a9-86d9-097490da0e3b admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:25.803766 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd145d5-349a-46a9-86d9-097490da0e3b admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:25.904179 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacd63f7-2e6c-450e-b7ba-6809fbc3911b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:25.906121 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd63f7-2e6c-450e-b7ba-6809fbc3911b admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:25.906783 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd63f7-2e6c-450e-b7ba-6809fbc3911b admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:25.907652 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd63f7-2e6c-450e-b7ba-6809fbc3911b admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:25.912320 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacd63f7-2e6c-450e-b7ba-6809fbc3911b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:25.914451 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacd63f7-2e6c-450e-b7ba-6809fbc3911b admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:25.957891 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1260/2485] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:23:25 2022] POST /identity/v3/users => generated 287 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:23:25.962113 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b681e469-ac38-4ff9-82de-d910e99fbb50 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:25.979603 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b681e469-ac38-4ff9-82de-d910e99fbb50 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:25.998393 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f736493-2d92-4e32-95bb-6146f4786930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:25.999271 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f736493-2d92-4e32-95bb-6146f4786930 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:25.999671 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f736493-2d92-4e32-95bb-6146f4786930 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:26.000126 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f736493-2d92-4e32-95bb-6146f4786930 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:26.000963 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f736493-2d92-4e32-95bb-6146f4786930 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:26.002668 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f736493-2d92-4e32-95bb-6146f4786930 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:26.023267 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1226/2486] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:23:25 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:23:26.024339 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacd63f7-2e6c-450e-b7ba-6809fbc3911b admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:26.045274 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacd63f7-2e6c-450e-b7ba-6809fbc3911b admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:26.051268 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c520bb3-4490-409f-800b-1716ee26b2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:26.052450 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c520bb3-4490-409f-800b-1716ee26b2fc admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:26.052987 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c520bb3-4490-409f-800b-1716ee26b2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:26.053553 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c520bb3-4490-409f-800b-1716ee26b2fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:26.054569 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c520bb3-4490-409f-800b-1716ee26b2fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:26.056728 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c520bb3-4490-409f-800b-1716ee26b2fc admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:26.089801 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f736493-2d92-4e32-95bb-6146f4786930 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:26.107148 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1261/2487] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:23:26 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:23:26.117983 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f736493-2d92-4e32-95bb-6146f4786930 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:26.131047 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6881b975-77c7-48ed-a202-af3b49ca2205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:26.132022 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6881b975-77c7-48ed-a202-af3b49ca2205 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:26.132335 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6881b975-77c7-48ed-a202-af3b49ca2205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:26.132584 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6881b975-77c7-48ed-a202-af3b49ca2205 admin admin] PATH_INFO: `/v3/projects/e15402f6c80840d0b58ca0e96ecb8133/users/c7994cdb3d704a8da63c5f133b32b37b/roles/81634e7812344f84afcb29b0dba2687c` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:26.158017 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6881b975-77c7-48ed-a202-af3b49ca2205 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e15402f6c80840d0b58ca0e96ecb8133, user_id=c7994cdb3d704a8da63c5f133b32b37b, role_id=81634e7812344f84afcb29b0dba2687c)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:26.160936 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6881b975-77c7-48ed-a202-af3b49ca2205 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:26.164589 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:26.201431 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1227/2488] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:23:26 2022] PUT /identity/v3/projects/e15402f6c80840d0b58ca0e96ecb8133/users/c7994cdb3d704a8da63c5f133b32b37b/roles/81634e7812344f84afcb29b0dba2687c => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:23:26.216164 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d2834-060e-47a2-985b-f06550b02ee3 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:26.217257 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d2834-060e-47a2-985b-f06550b02ee3 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:26.217986 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d2834-060e-47a2-985b-f06550b02ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:26.266010 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-d97d2834-060e-47a2-985b-f06550b02ee3 None None] MFA Rules not processed for user `c7994cdb3d704a8da63c5f133b32b37b`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:23:26.267713 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-d97d2834-060e-47a2-985b-f06550b02ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:26.346173 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1262/2489] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:23:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:23:26.358598 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6881b975-77c7-48ed-a202-af3b49ca2205 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:26.360593 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6881b975-77c7-48ed-a202-af3b49ca2205 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:26.459591 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6881b975-77c7-48ed-a202-af3b49ca2205 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:26.465681 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cfa1b9-060e-48fa-83b4-2872d8fdb4e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3b6e252a8c434a99432bcece6493b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:26.466464 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cfa1b9-060e-48fa-83b4-2872d8fdb4e2 service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:26.466847 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cfa1b9-060e-48fa-83b4-2872d8fdb4e2 service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:26.467358 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cfa1b9-060e-48fa-83b4-2872d8fdb4e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:26.477043 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cfa1b9-060e-48fa-83b4-2872d8fdb4e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:26.478888 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cfa1b9-060e-48fa-83b4-2872d8fdb4e2 service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:26.509774 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1228/2490] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:23:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:23:29.467687 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97d2834-060e-47a2-985b-f06550b02ee3 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:29.539484 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:29.566385 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97d2834-060e-47a2-985b-f06550b02ee3 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:29.571367 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881dfcc1-7f79-4899-99ae-9240897b86b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:29.572330 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881dfcc1-7f79-4899-99ae-9240897b86b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:29.572673 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881dfcc1-7f79-4899-99ae-9240897b86b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:29.572896 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881dfcc1-7f79-4899-99ae-9240897b86b8 admin admin] PATH_INFO: `/v3/users/c7994cdb3d704a8da63c5f133b32b37b` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:29.574143 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881dfcc1-7f79-4899-99ae-9240897b86b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7994cdb3d704a8da63c5f133b32b37b)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:29.576311 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881dfcc1-7f79-4899-99ae-9240897b86b8 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:29.650610 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-881dfcc1-7f79-4899-99ae-9240897b86b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7994cdb3d704a8da63c5f133b32b37b'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:29.659316 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-881dfcc1-7f79-4899-99ae-9240897b86b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7994cdb3d704a8da63c5f133b32b37b'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:29.660729 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-881dfcc1-7f79-4899-99ae-9240897b86b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7994cdb3d704a8da63c5f133b32b37b'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:29.661587 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-881dfcc1-7f79-4899-99ae-9240897b86b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7994cdb3d704a8da63c5f133b32b37b'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:29.676167 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-881dfcc1-7f79-4899-99ae-9240897b86b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7994cdb3d704a8da63c5f133b32b37b'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:29.729335 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1263/2491] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:23:29 2022] DELETE /identity/v3/users/c7994cdb3d704a8da63c5f133b32b37b => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:23:29.741080 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cd4c0c-8de7-482f-a0ff-dac0e0f7ed68 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:29.742132 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cd4c0c-8de7-482f-a0ff-dac0e0f7ed68 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:29.742418 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cd4c0c-8de7-482f-a0ff-dac0e0f7ed68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:29.767531 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-91cd4c0c-8de7-482f-a0ff-dac0e0f7ed68 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:23:29.769145 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-91cd4c0c-8de7-482f-a0ff-dac0e0f7ed68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:29.892251 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1229/2492] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:23:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:23:29.903799 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881dfcc1-7f79-4899-99ae-9240897b86b8 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:29.905564 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-881dfcc1-7f79-4899-99ae-9240897b86b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:30.014412 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881dfcc1-7f79-4899-99ae-9240897b86b8 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:30.019499 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0109945-342d-44fb-9ddb-e450f1d2504e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:30.021478 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0109945-342d-44fb-9ddb-e450f1d2504e service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:30.021822 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0109945-342d-44fb-9ddb-e450f1d2504e service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:30.022122 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0109945-342d-44fb-9ddb-e450f1d2504e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:30.032417 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0109945-342d-44fb-9ddb-e450f1d2504e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:30.034281 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0109945-342d-44fb-9ddb-e450f1d2504e service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:30.051317 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1264/2493] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:23:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:23:30.445332 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cd4c0c-8de7-482f-a0ff-dac0e0f7ed68 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:30.447587 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-91cd4c0c-8de7-482f-a0ff-dac0e0f7ed68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:30.466988 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cd4c0c-8de7-482f-a0ff-dac0e0f7ed68 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:30.472698 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24835307-d345-4208-9c0b-32010e9eab89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:30.479607 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24835307-d345-4208-9c0b-32010e9eab89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:30.480013 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24835307-d345-4208-9c0b-32010e9eab89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:30.480353 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24835307-d345-4208-9c0b-32010e9eab89 admin admin] PATH_INFO: `/v3/projects/e15402f6c80840d0b58ca0e96ecb8133` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:30.482275 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24835307-d345-4208-9c0b-32010e9eab89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e15402f6c80840d0b58ca0e96ecb8133)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:30.484360 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24835307-d345-4208-9c0b-32010e9eab89 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:30.559181 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-24835307-d345-4208-9c0b-32010e9eab89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e15402f6c80840d0b58ca0e96ecb8133', 'request_id': 'req-24835307-d345-4208-9c0b-32010e9eab89'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:30.573729 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-24835307-d345-4208-9c0b-32010e9eab89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e15402f6c80840d0b58ca0e96ecb8133', 'request_id': 'req-24835307-d345-4208-9c0b-32010e9eab89'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:30.577479 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-24835307-d345-4208-9c0b-32010e9eab89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e15402f6c80840d0b58ca0e96ecb8133', 'request_id': 'req-24835307-d345-4208-9c0b-32010e9eab89'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:30.592182 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-24835307-d345-4208-9c0b-32010e9eab89 admin admin] The token cache is being invalidate because project e15402f6c80840d0b58ca0e96ecb8133 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:23:30.592529 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-24835307-d345-4208-9c0b-32010e9eab89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:30.593195 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-24835307-d345-4208-9c0b-32010e9eab89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:30.595547 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1230/2494] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:23:30 2022] DELETE /identity/v3/projects/e15402f6c80840d0b58ca0e96ecb8133 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:23:30.602079 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f47736-30fa-4561-9e7a-2d6601eeb5c4 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:30.602700 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f47736-30fa-4561-9e7a-2d6601eeb5c4 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:30.602700 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f47736-30fa-4561-9e7a-2d6601eeb5c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:30.629139 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-72f47736-30fa-4561-9e7a-2d6601eeb5c4 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:23:30.630576 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-72f47736-30fa-4561-9e7a-2d6601eeb5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:30.700201 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1265/2495] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:23:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:23:30.707931 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fefce67-8396-4f24-9773-48ef19ee3fd8 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:30.708266 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fefce67-8396-4f24-9773-48ef19ee3fd8 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:30.708574 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fefce67-8396-4f24-9773-48ef19ee3fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:30.716960 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:30.731329 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-0fefce67-8396-4f24-9773-48ef19ee3fd8 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:23:30.732620 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0fefce67-8396-4f24-9773-48ef19ee3fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:30.743952 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1231/2496] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:23:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:23:30.748153 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f47736-30fa-4561-9e7a-2d6601eeb5c4 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:30.758785 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f47736-30fa-4561-9e7a-2d6601eeb5c4 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:30.765956 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46c565f-7b19-4722-82e5-b5bb65735e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:30.766892 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c565f-7b19-4722-82e5-b5bb65735e02 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:30.767215 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c565f-7b19-4722-82e5-b5bb65735e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:30.767450 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c565f-7b19-4722-82e5-b5bb65735e02 admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:30.768236 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46c565f-7b19-4722-82e5-b5bb65735e02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:23:30.768546 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46c565f-7b19-4722-82e5-b5bb65735e02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:30.770180 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46c565f-7b19-4722-82e5-b5bb65735e02 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:30.773239 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:30.786013 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1266/2497] 10.222.0.42 () {58 vars in 1152 bytes} [Mon Jul 4 09:23:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:23:30.790921 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fefce67-8396-4f24-9773-48ef19ee3fd8 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:30.801488 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fefce67-8396-4f24-9773-48ef19ee3fd8 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:30.806634 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23681b75-30db-433c-9dc8-471ac680d19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:30.807327 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23681b75-30db-433c-9dc8-471ac680d19d admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:30.807607 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23681b75-30db-433c-9dc8-471ac680d19d admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:30.807913 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23681b75-30db-433c-9dc8-471ac680d19d admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:30.808625 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23681b75-30db-433c-9dc8-471ac680d19d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:30.810591 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23681b75-30db-433c-9dc8-471ac680d19d admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:30.840158 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1232/2498] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:23:30 2022] POST /identity/v3/projects => generated 379 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:23:30.844411 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46c565f-7b19-4722-82e5-b5bb65735e02 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:30.859247 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46c565f-7b19-4722-82e5-b5bb65735e02 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:30.969010 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe3a18c-b444-46ef-a13c-a3f5ec460b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:30.970287 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe3a18c-b444-46ef-a13c-a3f5ec460b39 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:30.970818 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe3a18c-b444-46ef-a13c-a3f5ec460b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:30.971251 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe3a18c-b444-46ef-a13c-a3f5ec460b39 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:30.972036 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe3a18c-b444-46ef-a13c-a3f5ec460b39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:30.974007 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe3a18c-b444-46ef-a13c-a3f5ec460b39 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:30.999896 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1267/2499] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:23:30 2022] POST /identity/v3/users => generated 290 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:23:31.001036 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23681b75-30db-433c-9dc8-471ac680d19d admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:31.013139 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23681b75-30db-433c-9dc8-471ac680d19d admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:31.023171 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc273999-cb53-4df8-a803-e562890f8df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:31.023951 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc273999-cb53-4df8-a803-e562890f8df3 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:31.024337 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc273999-cb53-4df8-a803-e562890f8df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:31.024681 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc273999-cb53-4df8-a803-e562890f8df3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:31.025565 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc273999-cb53-4df8-a803-e562890f8df3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:31.027414 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc273999-cb53-4df8-a803-e562890f8df3 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:31.041205 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1233/2500] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:23:30 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:23:31.045095 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe3a18c-b444-46ef-a13c-a3f5ec460b39 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:31.057695 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe3a18c-b444-46ef-a13c-a3f5ec460b39 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:31.069026 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d6ae97-9307-430c-a946-086eda04fa9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:31.070452 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d6ae97-9307-430c-a946-086eda04fa9e admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:31.071473 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d6ae97-9307-430c-a946-086eda04fa9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:31.071756 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d6ae97-9307-430c-a946-086eda04fa9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:31.074144 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d6ae97-9307-430c-a946-086eda04fa9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:31.076974 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d6ae97-9307-430c-a946-086eda04fa9e admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:31.084424 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc273999-cb53-4df8-a803-e562890f8df3 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:31.086265 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-dc273999-cb53-4df8-a803-e562890f8df3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:31.106283 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc273999-cb53-4df8-a803-e562890f8df3 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:31.111636 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f41c6f-5eb0-4bbe-a2f8-e4a0d9fbe8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:31.112781 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f41c6f-5eb0-4bbe-a2f8-e4a0d9fbe8bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:31.116379 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1268/2501] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:23:31 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:23:31.117005 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f41c6f-5eb0-4bbe-a2f8-e4a0d9fbe8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:31.117617 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d6ae97-9307-430c-a946-086eda04fa9e admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:31.117872 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f41c6f-5eb0-4bbe-a2f8-e4a0d9fbe8bc admin admin] PATH_INFO: `/v3/users/5b0d13cbb5724abda086077ba890791c` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:31.125754 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f41c6f-5eb0-4bbe-a2f8-e4a0d9fbe8bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b0d13cbb5724abda086077ba890791c)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:31.130541 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f41c6f-5eb0-4bbe-a2f8-e4a0d9fbe8bc admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:31.150300 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d6ae97-9307-430c-a946-086eda04fa9e admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:31.159076 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd7cc9c-ec26-4f20-a0ca-b263f68c2f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:31.160593 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7cc9c-ec26-4f20-a0ca-b263f68c2f9c admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:31.161112 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7cc9c-ec26-4f20-a0ca-b263f68c2f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:31.162570 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7cc9c-ec26-4f20-a0ca-b263f68c2f9c admin admin] PATH_INFO: `/v3/projects/d3bf825df23e4f51936ab9ff4abe9f55/users/d5281cc03bbc4853be3560fcfd4cda0d/roles/81634e7812344f84afcb29b0dba2687c` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:31.189276 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd7cc9c-ec26-4f20-a0ca-b263f68c2f9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3bf825df23e4f51936ab9ff4abe9f55, user_id=d5281cc03bbc4853be3560fcfd4cda0d, role_id=81634e7812344f84afcb29b0dba2687c)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:31.192960 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd7cc9c-ec26-4f20-a0ca-b263f68c2f9c admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:31.231960 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1269/2502] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:23:31 2022] PUT /identity/v3/projects/d3bf825df23e4f51936ab9ff4abe9f55/users/d5281cc03bbc4853be3560fcfd4cda0d/roles/81634e7812344f84afcb29b0dba2687c => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:23:31.241967 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec4ec4-e516-4514-ad7b-f39023909d90 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:31.242266 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec4ec4-e516-4514-ad7b-f39023909d90 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:31.242538 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec4ec4-e516-4514-ad7b-f39023909d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:31.271209 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-72f41c6f-5eb0-4bbe-a2f8-e4a0d9fbe8bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b0d13cbb5724abda086077ba890791c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:31.272091 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-72f41c6f-5eb0-4bbe-a2f8-e4a0d9fbe8bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b0d13cbb5724abda086077ba890791c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:31.286060 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-1fec4ec4-e516-4514-ad7b-f39023909d90 None None] MFA Rules not processed for user `d5281cc03bbc4853be3560fcfd4cda0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:23:31.288441 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-72f41c6f-5eb0-4bbe-a2f8-e4a0d9fbe8bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b0d13cbb5724abda086077ba890791c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:31.289246 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-72f41c6f-5eb0-4bbe-a2f8-e4a0d9fbe8bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b0d13cbb5724abda086077ba890791c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:31.293075 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-1fec4ec4-e516-4514-ad7b-f39023909d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:31.304545 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-72f41c6f-5eb0-4bbe-a2f8-e4a0d9fbe8bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b0d13cbb5724abda086077ba890791c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:31.319426 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1234/2503] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:23:31 2022] DELETE /identity/v3/users/5b0d13cbb5724abda086077ba890791c => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:23:31.324020 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c8552c-65d7-4be4-ab60-d5a9bf026dc9 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:31.324316 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c8552c-65d7-4be4-ab60-d5a9bf026dc9 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:31.324594 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c8552c-65d7-4be4-ab60-d5a9bf026dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:31.342591 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-f9c8552c-65d7-4be4-ab60-d5a9bf026dc9 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:23:31.344144 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f9c8552c-65d7-4be4-ab60-d5a9bf026dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:31.396030 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1270/2504] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:23:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:23:31.398471 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fec4ec4-e516-4514-ad7b-f39023909d90 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:31.400107 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-1fec4ec4-e516-4514-ad7b-f39023909d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:31.438831 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1235/2505] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:23:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:23:31.453289 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c8552c-65d7-4be4-ab60-d5a9bf026dc9 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:31.453289 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f9c8552c-65d7-4be4-ab60-d5a9bf026dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:31.461086 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:31.513615 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:31.528952 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fec4ec4-e516-4514-ad7b-f39023909d90 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:31.536387 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9081bb-a480-4404-b4b0-bf3992771551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:31.537025 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9081bb-a480-4404-b4b0-bf3992771551 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:31.537338 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9081bb-a480-4404-b4b0-bf3992771551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:31.537590 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9081bb-a480-4404-b4b0-bf3992771551 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:31.538300 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9081bb-a480-4404-b4b0-bf3992771551 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:31.540374 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9081bb-a480-4404-b4b0-bf3992771551 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:31.553409 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c8552c-65d7-4be4-ab60-d5a9bf026dc9 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:31.558166 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9bcc09-9c87-4980-947b-7dad67db9b69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:31.558969 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9bcc09-9c87-4980-947b-7dad67db9b69 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:31.559383 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9bcc09-9c87-4980-947b-7dad67db9b69 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:31.559914 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9bcc09-9c87-4980-947b-7dad67db9b69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:31.577464 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9bcc09-9c87-4980-947b-7dad67db9b69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:31.582447 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9bcc09-9c87-4980-947b-7dad67db9b69 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:31.584419 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1271/2506] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:23:31 2022] POST /identity/v3/projects => generated 379 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:23:31.585392 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9081bb-a480-4404-b4b0-bf3992771551 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:31.593874 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1236/2507] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:23:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:23:31.683924 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9081bb-a480-4404-b4b0-bf3992771551 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:31.692864 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd7e07-e9cd-4dee-98b2-7770cf483db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:31.693957 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd7e07-e9cd-4dee-98b2-7770cf483db6 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:31.694775 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd7e07-e9cd-4dee-98b2-7770cf483db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:31.694775 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd7e07-e9cd-4dee-98b2-7770cf483db6 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:31.699091 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befd7e07-e9cd-4dee-98b2-7770cf483db6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:31.699091 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befd7e07-e9cd-4dee-98b2-7770cf483db6 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:31.727660 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1272/2508] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:23:31 2022] POST /identity/v3/users => generated 296 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:23:31.729015 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9bcc09-9c87-4980-947b-7dad67db9b69 service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:31.747145 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9bcc09-9c87-4980-947b-7dad67db9b69 service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:31.753148 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba497bd-d52e-4bbb-918e-fe5563e006ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:31.753952 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba497bd-d52e-4bbb-918e-fe5563e006ce admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:31.754240 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba497bd-d52e-4bbb-918e-fe5563e006ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:31.754521 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba497bd-d52e-4bbb-918e-fe5563e006ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:31.755329 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba497bd-d52e-4bbb-918e-fe5563e006ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:31.757081 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba497bd-d52e-4bbb-918e-fe5563e006ce admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:31.769638 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1237/2509] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:23:31 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:23:31.773683 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd7e07-e9cd-4dee-98b2-7770cf483db6 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:31.784652 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd7e07-e9cd-4dee-98b2-7770cf483db6 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:31.790329 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78539f9f-8b8a-4a56-b36f-4ce3d67c45af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:31.791550 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78539f9f-8b8a-4a56-b36f-4ce3d67c45af admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:31.791973 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78539f9f-8b8a-4a56-b36f-4ce3d67c45af admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:31.792450 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78539f9f-8b8a-4a56-b36f-4ce3d67c45af admin admin] PATH_INFO: `/v3/projects/83ade278ebed460883a2fbfd4283c894/users/baaa1f26bb6e4f67857dd9669b60ddf9/roles/965049e7ce6144aaad23c15f3a5e37c3` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:31.807944 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78539f9f-8b8a-4a56-b36f-4ce3d67c45af admin admin] RBAC: Authorizing `identity:create_grant(project_id=83ade278ebed460883a2fbfd4283c894, user_id=baaa1f26bb6e4f67857dd9669b60ddf9, role_id=965049e7ce6144aaad23c15f3a5e37c3)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:31.810841 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78539f9f-8b8a-4a56-b36f-4ce3d67c45af admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:31.826250 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1273/2510] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:23:31 2022] PUT /identity/v3/projects/83ade278ebed460883a2fbfd4283c894/users/baaa1f26bb6e4f67857dd9669b60ddf9/roles/965049e7ce6144aaad23c15f3a5e37c3 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:23:31.830462 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba497bd-d52e-4bbb-918e-fe5563e006ce admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:31.841000 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba497bd-d52e-4bbb-918e-fe5563e006ce admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:31.908976 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30a3e66-ccc3-451d-94c0-7e31932d2e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:31.909640 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a3e66-ccc3-451d-94c0-7e31932d2e29 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:31.909936 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a3e66-ccc3-451d-94c0-7e31932d2e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:31.910219 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a3e66-ccc3-451d-94c0-7e31932d2e29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:31.911001 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30a3e66-ccc3-451d-94c0-7e31932d2e29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:31.912747 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30a3e66-ccc3-451d-94c0-7e31932d2e29 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:31.918212 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78539f9f-8b8a-4a56-b36f-4ce3d67c45af admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:31.920511 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-78539f9f-8b8a-4a56-b36f-4ce3d67c45af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:31.927963 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1238/2511] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:23:31 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:23:31.932679 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30a3e66-ccc3-451d-94c0-7e31932d2e29 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:31.943069 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30a3e66-ccc3-451d-94c0-7e31932d2e29 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:31.948518 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c8fef8-ed5b-46dc-96e2-fdaa0b099ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:31.949374 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c8fef8-ed5b-46dc-96e2-fdaa0b099ae9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:31.949543 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c8fef8-ed5b-46dc-96e2-fdaa0b099ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:31.949801 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78539f9f-8b8a-4a56-b36f-4ce3d67c45af admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:31.949928 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c8fef8-ed5b-46dc-96e2-fdaa0b099ae9 admin admin] PATH_INFO: `/v3/projects/83ade278ebed460883a2fbfd4283c894/users/baaa1f26bb6e4f67857dd9669b60ddf9/roles/965049e7ce6144aaad23c15f3a5e37c3` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:31.951835 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c8fef8-ed5b-46dc-96e2-fdaa0b099ae9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83ade278ebed460883a2fbfd4283c894, user_id=baaa1f26bb6e4f67857dd9669b60ddf9, role_id=965049e7ce6144aaad23c15f3a5e37c3)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:31.954557 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c8fef8-ed5b-46dc-96e2-fdaa0b099ae9 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:31.955364 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b24d683-82b5-4a58-a6ba-bc3c8d1fae41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:31.956404 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24d683-82b5-4a58-a6ba-bc3c8d1fae41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:31.956751 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24d683-82b5-4a58-a6ba-bc3c8d1fae41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:31.957273 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24d683-82b5-4a58-a6ba-bc3c8d1fae41 admin admin] PATH_INFO: `/v3/projects/2169eb4071f14915921da23084f5275f` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:31.958878 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b24d683-82b5-4a58-a6ba-bc3c8d1fae41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2169eb4071f14915921da23084f5275f)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:31.960925 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b24d683-82b5-4a58-a6ba-bc3c8d1fae41 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:31.966287 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1239/2512] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:23:31 2022] PUT /identity/v3/projects/83ade278ebed460883a2fbfd4283c894/users/baaa1f26bb6e4f67857dd9669b60ddf9/roles/965049e7ce6144aaad23c15f3a5e37c3 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:23:31.977600 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e5255-7e93-497c-914e-abe176821775 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:31.977898 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e5255-7e93-497c-914e-abe176821775 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:31.978178 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e5255-7e93-497c-914e-abe176821775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:32.006080 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-f24e5255-7e93-497c-914e-abe176821775 None None] MFA Rules not processed for user `baaa1f26bb6e4f67857dd9669b60ddf9`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:23:32.007315 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f24e5255-7e93-497c-914e-abe176821775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:32.012252 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-9b24d683-82b5-4a58-a6ba-bc3c8d1fae41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2169eb4071f14915921da23084f5275f', 'request_id': 'req-9b24d683-82b5-4a58-a6ba-bc3c8d1fae41'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:32.022176 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-9b24d683-82b5-4a58-a6ba-bc3c8d1fae41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2169eb4071f14915921da23084f5275f', 'request_id': 'req-9b24d683-82b5-4a58-a6ba-bc3c8d1fae41'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:32.028326 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-9b24d683-82b5-4a58-a6ba-bc3c8d1fae41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2169eb4071f14915921da23084f5275f', 'request_id': 'req-9b24d683-82b5-4a58-a6ba-bc3c8d1fae41'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:32.040436 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-9b24d683-82b5-4a58-a6ba-bc3c8d1fae41 admin admin] The token cache is being invalidate because project 2169eb4071f14915921da23084f5275f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:23:32.040800 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-9b24d683-82b5-4a58-a6ba-bc3c8d1fae41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:32.041601 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-9b24d683-82b5-4a58-a6ba-bc3c8d1fae41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:32.043303 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1274/2513] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:23:31 2022] DELETE /identity/v3/projects/2169eb4071f14915921da23084f5275f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:23:32.047424 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b24d683-82b5-4a58-a6ba-bc3c8d1fae41 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:32.049124 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-9b24d683-82b5-4a58-a6ba-bc3c8d1fae41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:32.063720 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:32.077268 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1240/2514] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:23:31 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:23:32.089082 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e5255-7e93-497c-914e-abe176821775 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:32.090496 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f24e5255-7e93-497c-914e-abe176821775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:32.119853 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b24d683-82b5-4a58-a6ba-bc3c8d1fae41 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:32.124667 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8fe2cf-9af1-49bb-9900-7c798aa29f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:32.125563 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8fe2cf-9af1-49bb-9900-7c798aa29f1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:32.125845 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8fe2cf-9af1-49bb-9900-7c798aa29f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:32.126118 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8fe2cf-9af1-49bb-9900-7c798aa29f1e admin admin] PATH_INFO: `/v3/users/c1ccd79ebe9246f1970b71f921d00e23` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:32.127324 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8fe2cf-9af1-49bb-9900-7c798aa29f1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1ccd79ebe9246f1970b71f921d00e23)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:32.129309 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8fe2cf-9af1-49bb-9900-7c798aa29f1e admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:32.134110 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:32.151165 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e5255-7e93-497c-914e-abe176821775 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:32.155406 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a93a3-3460-4951-bbde-0610960ac090 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f86373d65440da97c853fff3c1d0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:32.156201 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a93a3-3460-4951-bbde-0610960ac090 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:32.156554 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a93a3-3460-4951-bbde-0610960ac090 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:32.156834 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a93a3-3460-4951-bbde-0610960ac090 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:32.167680 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755a93a3-3460-4951-bbde-0610960ac090 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:32.169195 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755a93a3-3460-4951-bbde-0610960ac090 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:32.177835 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-1a8fe2cf-9af1-49bb-9900-7c798aa29f1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1ccd79ebe9246f1970b71f921d00e23'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:32.180892 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1241/2515] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:23:32 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 09:23:32.187366 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-1a8fe2cf-9af1-49bb-9900-7c798aa29f1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1ccd79ebe9246f1970b71f921d00e23'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:32.188035 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-1a8fe2cf-9af1-49bb-9900-7c798aa29f1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1ccd79ebe9246f1970b71f921d00e23'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:32.188641 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-1a8fe2cf-9af1-49bb-9900-7c798aa29f1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1ccd79ebe9246f1970b71f921d00e23'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:32.202285 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-1a8fe2cf-9af1-49bb-9900-7c798aa29f1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1ccd79ebe9246f1970b71f921d00e23'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:32.218601 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1275/2516] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:23:32 2022] DELETE /identity/v3/users/c1ccd79ebe9246f1970b71f921d00e23 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:23:32.264772 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a93a3-3460-4951-bbde-0610960ac090 service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:32.274027 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a93a3-3460-4951-bbde-0610960ac090 service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:32.328750 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a00180-0b9f-48b8-95fd-f8d5b7ac392f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f86373d65440da97c853fff3c1d0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:32.329435 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a00180-0b9f-48b8-95fd-f8d5b7ac392f service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:32.329850 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a00180-0b9f-48b8-95fd-f8d5b7ac392f service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:32.330069 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a00180-0b9f-48b8-95fd-f8d5b7ac392f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:32.331946 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-88a00180-0b9f-48b8-95fd-f8d5b7ac392f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:32.402080 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a00180-0b9f-48b8-95fd-f8d5b7ac392f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:32.403715 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a00180-0b9f-48b8-95fd-f8d5b7ac392f service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:32.413338 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1242/2517] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:23:32 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:23:32.588144 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8fe2cf-9af1-49bb-9900-7c798aa29f1e admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:32.589716 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-1a8fe2cf-9af1-49bb-9900-7c798aa29f1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:32.654658 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8fe2cf-9af1-49bb-9900-7c798aa29f1e admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:32.660079 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1564a89-5758-4316-9bb5-78ed9b420538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:32.660957 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1564a89-5758-4316-9bb5-78ed9b420538 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:32.661242 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1564a89-5758-4316-9bb5-78ed9b420538 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:32.661609 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1564a89-5758-4316-9bb5-78ed9b420538 admin admin] PATH_INFO: `/v3/projects/3cd482ae4ba74616a11ec2a64c806213` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:32.662895 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1564a89-5758-4316-9bb5-78ed9b420538 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cd482ae4ba74616a11ec2a64c806213)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:32.664844 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1564a89-5758-4316-9bb5-78ed9b420538 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:32.706368 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:32.718053 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-f1564a89-5758-4316-9bb5-78ed9b420538 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cd482ae4ba74616a11ec2a64c806213', 'request_id': 'req-f1564a89-5758-4316-9bb5-78ed9b420538'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:32.726715 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-f1564a89-5758-4316-9bb5-78ed9b420538 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cd482ae4ba74616a11ec2a64c806213', 'request_id': 'req-f1564a89-5758-4316-9bb5-78ed9b420538'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:32.733105 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-f1564a89-5758-4316-9bb5-78ed9b420538 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cd482ae4ba74616a11ec2a64c806213', 'request_id': 'req-f1564a89-5758-4316-9bb5-78ed9b420538'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:32.744390 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-f1564a89-5758-4316-9bb5-78ed9b420538 admin admin] The token cache is being invalidate because project 3cd482ae4ba74616a11ec2a64c806213 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:23:32.744669 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-f1564a89-5758-4316-9bb5-78ed9b420538 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:32.745293 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-f1564a89-5758-4316-9bb5-78ed9b420538 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:32.746850 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1276/2518] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:23:32 2022] DELETE /identity/v3/projects/3cd482ae4ba74616a11ec2a64c806213 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:23:32.752049 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86587fc-0b2c-41bc-a020-20ba742ec315 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:32.752555 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86587fc-0b2c-41bc-a020-20ba742ec315 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:32.752555 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86587fc-0b2c-41bc-a020-20ba742ec315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:32.771083 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-b86587fc-0b2c-41bc-a020-20ba742ec315 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:23:32.772348 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b86587fc-0b2c-41bc-a020-20ba742ec315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:32.834125 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1243/2519] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:23:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:23:32.842061 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8774e6-53fc-4990-a8ba-921c4577f88c None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:32.842349 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8774e6-53fc-4990-a8ba-921c4577f88c None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:32.842629 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8774e6-53fc-4990-a8ba-921c4577f88c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:32.861484 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-ca8774e6-53fc-4990-a8ba-921c4577f88c None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:23:32.862709 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-ca8774e6-53fc-4990-a8ba-921c4577f88c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:32.874665 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1277/2520] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:23:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:23:32.875415 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86587fc-0b2c-41bc-a020-20ba742ec315 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:32.885619 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86587fc-0b2c-41bc-a020-20ba742ec315 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:32.890724 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03504ab1-6262-42d9-93d4-3e7a3b37cc61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:32.891611 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03504ab1-6262-42d9-93d4-3e7a3b37cc61 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:32.891986 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03504ab1-6262-42d9-93d4-3e7a3b37cc61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:32.892326 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03504ab1-6262-42d9-93d4-3e7a3b37cc61 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:32.893257 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03504ab1-6262-42d9-93d4-3e7a3b37cc61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:23:32.893629 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03504ab1-6262-42d9-93d4-3e7a3b37cc61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:32.895327 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03504ab1-6262-42d9-93d4-3e7a3b37cc61 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:32.919052 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1244/2521] 10.222.0.42 () {58 vars in 1152 bytes} [Mon Jul 4 09:23:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:23:32.919186 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8774e6-53fc-4990-a8ba-921c4577f88c None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:32.925593 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8774e6-53fc-4990-a8ba-921c4577f88c None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:32.930813 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2331685-9395-48d4-8e52-cf23a9752148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:32.931478 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2331685-9395-48d4-8e52-cf23a9752148 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:32.931760 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2331685-9395-48d4-8e52-cf23a9752148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:32.932072 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2331685-9395-48d4-8e52-cf23a9752148 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:32.932791 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2331685-9395-48d4-8e52-cf23a9752148 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:32.934711 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2331685-9395-48d4-8e52-cf23a9752148 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:32.960835 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1278/2522] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:23:32 2022] POST /identity/v3/projects => generated 363 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:23:32.965089 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03504ab1-6262-42d9-93d4-3e7a3b37cc61 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:32.975740 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03504ab1-6262-42d9-93d4-3e7a3b37cc61 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:32.994940 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:33.036219 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f8216e-ff9e-42c9-9bd9-f6d80ee9ee52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:33.036892 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8216e-ff9e-42c9-9bd9-f6d80ee9ee52 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:33.037178 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8216e-ff9e-42c9-9bd9-f6d80ee9ee52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:33.037459 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8216e-ff9e-42c9-9bd9-f6d80ee9ee52 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:33.038158 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f8216e-ff9e-42c9-9bd9-f6d80ee9ee52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:33.040156 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f8216e-ff9e-42c9-9bd9-f6d80ee9ee52 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:33.061959 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1245/2523] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:23:32 2022] POST /identity/v3/users => generated 282 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:23:33.066967 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2331685-9395-48d4-8e52-cf23a9752148 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:33.082848 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2331685-9395-48d4-8e52-cf23a9752148 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:33.088480 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3249ec30-378c-418e-88d1-0b201dc38ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:33.089084 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3249ec30-378c-418e-88d1-0b201dc38ab5 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:33.089367 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3249ec30-378c-418e-88d1-0b201dc38ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:33.089641 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3249ec30-378c-418e-88d1-0b201dc38ab5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:33.090409 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3249ec30-378c-418e-88d1-0b201dc38ab5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:33.092088 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3249ec30-378c-418e-88d1-0b201dc38ab5 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:33.106538 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1279/2524] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:23:33 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:23:33.110708 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f8216e-ff9e-42c9-9bd9-f6d80ee9ee52 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:33.121354 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f8216e-ff9e-42c9-9bd9-f6d80ee9ee52 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:33.126626 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0035cd79-b1ee-454e-8b16-b9a9ce29ac6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:33.127279 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0035cd79-b1ee-454e-8b16-b9a9ce29ac6c admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:33.127561 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0035cd79-b1ee-454e-8b16-b9a9ce29ac6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:33.127834 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0035cd79-b1ee-454e-8b16-b9a9ce29ac6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:33.128593 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0035cd79-b1ee-454e-8b16-b9a9ce29ac6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:33.130214 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0035cd79-b1ee-454e-8b16-b9a9ce29ac6c admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:33.140841 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1246/2525] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:23:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:23:33.145367 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3249ec30-378c-418e-88d1-0b201dc38ab5 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:33.155709 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3249ec30-378c-418e-88d1-0b201dc38ab5 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:33.160788 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781140fa-8a01-40bf-b7d3-7c544348c112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:33.161681 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781140fa-8a01-40bf-b7d3-7c544348c112 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:33.161960 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781140fa-8a01-40bf-b7d3-7c544348c112 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:33.162236 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781140fa-8a01-40bf-b7d3-7c544348c112 admin admin] PATH_INFO: `/v3/projects/aaed8a99b7714358a5a60cdedb23fb7d/users/f95a21d7429f47ec8a05aa67b293b76b/roles/81634e7812344f84afcb29b0dba2687c` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:33.177309 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781140fa-8a01-40bf-b7d3-7c544348c112 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaed8a99b7714358a5a60cdedb23fb7d, user_id=f95a21d7429f47ec8a05aa67b293b76b, role_id=81634e7812344f84afcb29b0dba2687c)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:33.179996 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781140fa-8a01-40bf-b7d3-7c544348c112 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:33.197124 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1280/2526] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:23:33 2022] PUT /identity/v3/projects/aaed8a99b7714358a5a60cdedb23fb7d/users/f95a21d7429f47ec8a05aa67b293b76b/roles/81634e7812344f84afcb29b0dba2687c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:23:33.209027 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b24ad1-ff60-4c2a-8faa-39eb897d7d95 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:33.209318 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b24ad1-ff60-4c2a-8faa-39eb897d7d95 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:33.209620 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b24ad1-ff60-4c2a-8faa-39eb897d7d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:33.238929 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-16b24ad1-ff60-4c2a-8faa-39eb897d7d95 None None] MFA Rules not processed for user `f95a21d7429f47ec8a05aa67b293b76b`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:23:33.240174 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-16b24ad1-ff60-4c2a-8faa-39eb897d7d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:33.303327 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1247/2527] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:23:33 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:23:33.307960 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781140fa-8a01-40bf-b7d3-7c544348c112 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:33.371750 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781140fa-8a01-40bf-b7d3-7c544348c112 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:33.377166 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d66f5-29b2-4819-8345-08476e8c6bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:33.377825 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d66f5-29b2-4819-8345-08476e8c6bef admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:33.378107 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d66f5-29b2-4819-8345-08476e8c6bef admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:33.378388 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d66f5-29b2-4819-8345-08476e8c6bef admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:33.379093 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28d66f5-29b2-4819-8345-08476e8c6bef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:33.381165 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28d66f5-29b2-4819-8345-08476e8c6bef admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:33.410748 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1281/2528] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:23:33 2022] POST /identity/v3/projects => generated 363 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:23:33.416664 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b24ad1-ff60-4c2a-8faa-39eb897d7d95 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:33.428192 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b24ad1-ff60-4c2a-8faa-39eb897d7d95 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:33.488041 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aaac7e-a359-4cff-bdf8-ba5ceed7da7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:33.488686 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aaac7e-a359-4cff-bdf8-ba5ceed7da7a admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:33.488972 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aaac7e-a359-4cff-bdf8-ba5ceed7da7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:33.489248 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aaac7e-a359-4cff-bdf8-ba5ceed7da7a admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:33.489949 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aaac7e-a359-4cff-bdf8-ba5ceed7da7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:33.491910 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aaac7e-a359-4cff-bdf8-ba5ceed7da7a admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:33.514206 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1248/2529] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:23:33 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:23:33.518320 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d66f5-29b2-4819-8345-08476e8c6bef admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:33.528798 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d66f5-29b2-4819-8345-08476e8c6bef admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:33.533623 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf57e173-d3fa-432e-8325-1dd68fbac93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:33.534299 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf57e173-d3fa-432e-8325-1dd68fbac93a admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:33.534538 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf57e173-d3fa-432e-8325-1dd68fbac93a admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:33.534805 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf57e173-d3fa-432e-8325-1dd68fbac93a admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:33.535532 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf57e173-d3fa-432e-8325-1dd68fbac93a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:33.537253 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf57e173-d3fa-432e-8325-1dd68fbac93a admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:33.547907 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1282/2530] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:23:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:23:33.552179 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aaac7e-a359-4cff-bdf8-ba5ceed7da7a admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:33.563419 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aaac7e-a359-4cff-bdf8-ba5ceed7da7a admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:33.570068 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceffc549-4b34-49e6-a58a-d2a880fa62cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:33.570068 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceffc549-4b34-49e6-a58a-d2a880fa62cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:33.570068 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceffc549-4b34-49e6-a58a-d2a880fa62cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:33.570434 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceffc549-4b34-49e6-a58a-d2a880fa62cb admin admin] PATH_INFO: `/v3/projects/5a1ed7587cef439195e3b72f9ca2106a/users/1df2153a9c524e5ab7ccce09ef9af13d/roles/965049e7ce6144aaad23c15f3a5e37c3` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:33.586821 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceffc549-4b34-49e6-a58a-d2a880fa62cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a1ed7587cef439195e3b72f9ca2106a, user_id=1df2153a9c524e5ab7ccce09ef9af13d, role_id=965049e7ce6144aaad23c15f3a5e37c3)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:33.590054 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceffc549-4b34-49e6-a58a-d2a880fa62cb admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:33.593323 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:33.608114 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1249/2531] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:23:33 2022] PUT /identity/v3/projects/5a1ed7587cef439195e3b72f9ca2106a/users/1df2153a9c524e5ab7ccce09ef9af13d/roles/965049e7ce6144aaad23c15f3a5e37c3 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:23:33.611854 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf57e173-d3fa-432e-8325-1dd68fbac93a admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:33.622777 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf57e173-d3fa-432e-8325-1dd68fbac93a admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:33.653792 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:33.690778 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fda58d-e3ed-446a-9d8f-43192e4c04d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:33.691969 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fda58d-e3ed-446a-9d8f-43192e4c04d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:33.692475 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fda58d-e3ed-446a-9d8f-43192e4c04d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:33.692952 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fda58d-e3ed-446a-9d8f-43192e4c04d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:33.694106 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fda58d-e3ed-446a-9d8f-43192e4c04d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:33.697098 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fda58d-e3ed-446a-9d8f-43192e4c04d8 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:33.714218 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1283/2532] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:23:33 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:23:33.714824 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceffc549-4b34-49e6-a58a-d2a880fa62cb admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:33.725805 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceffc549-4b34-49e6-a58a-d2a880fa62cb admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:33.732787 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09428c0-6263-488d-91c4-013575665016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:33.734058 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09428c0-6263-488d-91c4-013575665016 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:33.734353 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09428c0-6263-488d-91c4-013575665016 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:33.734713 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09428c0-6263-488d-91c4-013575665016 admin admin] PATH_INFO: `/v3/projects/5a1ed7587cef439195e3b72f9ca2106a/users/1df2153a9c524e5ab7ccce09ef9af13d/roles/965049e7ce6144aaad23c15f3a5e37c3` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:33.737275 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09428c0-6263-488d-91c4-013575665016 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a1ed7587cef439195e3b72f9ca2106a, user_id=1df2153a9c524e5ab7ccce09ef9af13d, role_id=965049e7ce6144aaad23c15f3a5e37c3)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:33.741517 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09428c0-6263-488d-91c4-013575665016 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:33.756114 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1250/2533] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:23:33 2022] PUT /identity/v3/projects/5a1ed7587cef439195e3b72f9ca2106a/users/1df2153a9c524e5ab7ccce09ef9af13d/roles/965049e7ce6144aaad23c15f3a5e37c3 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:23:33.765212 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8651a57-a7be-4708-a952-e75ddca5bb4c None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:33.765477 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8651a57-a7be-4708-a952-e75ddca5bb4c None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:33.765782 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8651a57-a7be-4708-a952-e75ddca5bb4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:33.798710 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-d8651a57-a7be-4708-a952-e75ddca5bb4c None None] MFA Rules not processed for user `1df2153a9c524e5ab7ccce09ef9af13d`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:23:33.800050 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-d8651a57-a7be-4708-a952-e75ddca5bb4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:33.888473 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1284/2534] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:23:33 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:23:33.901728 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09428c0-6263-488d-91c4-013575665016 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:33.903646 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a09428c0-6263-488d-91c4-013575665016 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:33.998602 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09428c0-6263-488d-91c4-013575665016 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:34.009842 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec338c87-b1b4-4555-af0f-f5668384258b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f86373d65440da97c853fff3c1d0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:34.010550 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec338c87-b1b4-4555-af0f-f5668384258b service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:34.010842 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec338c87-b1b4-4555-af0f-f5668384258b service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:34.011118 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec338c87-b1b4-4555-af0f-f5668384258b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:34.024821 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec338c87-b1b4-4555-af0f-f5668384258b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:34.026724 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec338c87-b1b4-4555-af0f-f5668384258b service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:34.041480 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1251/2535] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:23:33 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:23:34.148365 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8651a57-a7be-4708-a952-e75ddca5bb4c None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:34.150011 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-d8651a57-a7be-4708-a952-e75ddca5bb4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:34.163554 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8651a57-a7be-4708-a952-e75ddca5bb4c None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:34.167470 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7e85d8-a6d7-49cf-b217-a5309885746f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f86373d65440da97c853fff3c1d0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:34.168152 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e85d8-a6d7-49cf-b217-a5309885746f service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:34.168434 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e85d8-a6d7-49cf-b217-a5309885746f service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:34.168709 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e85d8-a6d7-49cf-b217-a5309885746f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:34.232060 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7e85d8-a6d7-49cf-b217-a5309885746f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:34.233593 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7e85d8-a6d7-49cf-b217-a5309885746f service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:34.243124 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1285/2536] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:23:34 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:23:36.913992 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec338c87-b1b4-4555-af0f-f5668384258b service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:36.917338 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ec338c87-b1b4-4555-af0f-f5668384258b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:37.021822 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7e85d8-a6d7-49cf-b217-a5309885746f service cinder] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:37.058290 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec338c87-b1b4-4555-af0f-f5668384258b service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:37.065397 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b76c1b-4781-45e0-aa6e-6acaeccfb98e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3b6e252a8c434a99432bcece6493b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:37.066105 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b76c1b-4781-45e0-aa6e-6acaeccfb98e service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:37.066427 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b76c1b-4781-45e0-aa6e-6acaeccfb98e service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:37.066895 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b76c1b-4781-45e0-aa6e-6acaeccfb98e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:37.069021 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-51b76c1b-4781-45e0-aa6e-6acaeccfb98e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:37.085459 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b76c1b-4781-45e0-aa6e-6acaeccfb98e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:37.087281 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b76c1b-4781-45e0-aa6e-6acaeccfb98e service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:37.089452 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:37.101126 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1252/2537] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:23:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:23:37.103761 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7e85d8-a6d7-49cf-b217-a5309885746f service cinder] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:37.108751 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b134b5cb-cd8f-426b-859e-52e86ce327cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:37.109856 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134b5cb-cd8f-426b-859e-52e86ce327cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:37.110201 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134b5cb-cd8f-426b-859e-52e86ce327cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:37.110811 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134b5cb-cd8f-426b-859e-52e86ce327cb admin admin] PATH_INFO: `/v3/users/f95a21d7429f47ec8a05aa67b293b76b` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:37.112108 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b134b5cb-cd8f-426b-859e-52e86ce327cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f95a21d7429f47ec8a05aa67b293b76b)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:37.114440 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b134b5cb-cd8f-426b-859e-52e86ce327cb admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:37.182341 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-b134b5cb-cd8f-426b-859e-52e86ce327cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f95a21d7429f47ec8a05aa67b293b76b'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:37.191144 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-b134b5cb-cd8f-426b-859e-52e86ce327cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f95a21d7429f47ec8a05aa67b293b76b'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:37.191939 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-b134b5cb-cd8f-426b-859e-52e86ce327cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f95a21d7429f47ec8a05aa67b293b76b'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:37.192558 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-b134b5cb-cd8f-426b-859e-52e86ce327cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f95a21d7429f47ec8a05aa67b293b76b'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:37.208722 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-b134b5cb-cd8f-426b-859e-52e86ce327cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f95a21d7429f47ec8a05aa67b293b76b'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:37.231487 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1286/2538] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:23:37 2022] DELETE /identity/v3/users/f95a21d7429f47ec8a05aa67b293b76b => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:23:37.236320 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1fec4d-83aa-479d-b092-33ee5a8dca3d None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:37.236678 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1fec4d-83aa-479d-b092-33ee5a8dca3d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:37.236959 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1fec4d-83aa-479d-b092-33ee5a8dca3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:37.256026 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-1a1fec4d-83aa-479d-b092-33ee5a8dca3d None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:23:37.257633 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-1a1fec4d-83aa-479d-b092-33ee5a8dca3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:37.323715 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1253/2539] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:23:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:23:37.333836 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b134b5cb-cd8f-426b-859e-52e86ce327cb admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:37.335373 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-b134b5cb-cd8f-426b-859e-52e86ce327cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:37.398955 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b134b5cb-cd8f-426b-859e-52e86ce327cb admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:37.402745 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352105af-51f3-4c2e-bf4a-a6d84a8a26f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:37.403499 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352105af-51f3-4c2e-bf4a-a6d84a8a26f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:37.403844 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352105af-51f3-4c2e-bf4a-a6d84a8a26f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:37.404152 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352105af-51f3-4c2e-bf4a-a6d84a8a26f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:37.413500 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352105af-51f3-4c2e-bf4a-a6d84a8a26f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:37.414964 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352105af-51f3-4c2e-bf4a-a6d84a8a26f7 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:37.424641 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1287/2540] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:23:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:23:37.701977 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1fec4d-83aa-479d-b092-33ee5a8dca3d None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:37.703463 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-1a1fec4d-83aa-479d-b092-33ee5a8dca3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:37.716665 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1fec4d-83aa-479d-b092-33ee5a8dca3d None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:37.722986 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04189c0-e13a-4914-8dc2-8196fd6dfe3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:37.724024 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04189c0-e13a-4914-8dc2-8196fd6dfe3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:37.724374 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04189c0-e13a-4914-8dc2-8196fd6dfe3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:37.724707 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04189c0-e13a-4914-8dc2-8196fd6dfe3f admin admin] PATH_INFO: `/v3/projects/aaed8a99b7714358a5a60cdedb23fb7d` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:37.726294 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04189c0-e13a-4914-8dc2-8196fd6dfe3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=aaed8a99b7714358a5a60cdedb23fb7d)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:37.730117 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04189c0-e13a-4914-8dc2-8196fd6dfe3f admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:37.739381 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:37.785487 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a04189c0-e13a-4914-8dc2-8196fd6dfe3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aaed8a99b7714358a5a60cdedb23fb7d', 'request_id': 'req-a04189c0-e13a-4914-8dc2-8196fd6dfe3f'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:37.790979 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a04189c0-e13a-4914-8dc2-8196fd6dfe3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aaed8a99b7714358a5a60cdedb23fb7d', 'request_id': 'req-a04189c0-e13a-4914-8dc2-8196fd6dfe3f'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:37.799455 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a04189c0-e13a-4914-8dc2-8196fd6dfe3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aaed8a99b7714358a5a60cdedb23fb7d', 'request_id': 'req-a04189c0-e13a-4914-8dc2-8196fd6dfe3f'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:37.810658 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a04189c0-e13a-4914-8dc2-8196fd6dfe3f admin admin] The token cache is being invalidate because project aaed8a99b7714358a5a60cdedb23fb7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:23:37.810944 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a04189c0-e13a-4914-8dc2-8196fd6dfe3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:37.811565 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a04189c0-e13a-4914-8dc2-8196fd6dfe3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:37.813147 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1254/2541] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:23:37 2022] DELETE /identity/v3/projects/aaed8a99b7714358a5a60cdedb23fb7d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:23:37.817344 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352105af-51f3-4c2e-bf4a-a6d84a8a26f7 service neutron] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:37.827340 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352105af-51f3-4c2e-bf4a-a6d84a8a26f7 service neutron] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:37.892888 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599f9501-38ff-4d60-a589-5217b54dc516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:37.894005 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f9501-38ff-4d60-a589-5217b54dc516 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:37.894530 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f9501-38ff-4d60-a589-5217b54dc516 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:37.895026 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f9501-38ff-4d60-a589-5217b54dc516 admin admin] PATH_INFO: `/v3/users/1df2153a9c524e5ab7ccce09ef9af13d` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:37.898469 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599f9501-38ff-4d60-a589-5217b54dc516 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1df2153a9c524e5ab7ccce09ef9af13d)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:37.900903 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599f9501-38ff-4d60-a589-5217b54dc516 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:37.919240 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:37.952419 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-599f9501-38ff-4d60-a589-5217b54dc516 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1df2153a9c524e5ab7ccce09ef9af13d'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:37.961030 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-599f9501-38ff-4d60-a589-5217b54dc516 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1df2153a9c524e5ab7ccce09ef9af13d'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:37.961652 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-599f9501-38ff-4d60-a589-5217b54dc516 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1df2153a9c524e5ab7ccce09ef9af13d'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:37.962257 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-599f9501-38ff-4d60-a589-5217b54dc516 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1df2153a9c524e5ab7ccce09ef9af13d'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:37.975206 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-599f9501-38ff-4d60-a589-5217b54dc516 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1df2153a9c524e5ab7ccce09ef9af13d'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:37.988684 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1288/2542] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:23:37 2022] DELETE /identity/v3/users/1df2153a9c524e5ab7ccce09ef9af13d => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:23:38.274099 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04189c0-e13a-4914-8dc2-8196fd6dfe3f admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:38.275700 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a04189c0-e13a-4914-8dc2-8196fd6dfe3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:38.301602 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04189c0-e13a-4914-8dc2-8196fd6dfe3f admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:38.363427 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e93245d-0352-4941-83f0-19c025ac6039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:38.364437 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e93245d-0352-4941-83f0-19c025ac6039 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:38.364719 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e93245d-0352-4941-83f0-19c025ac6039 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:38.365020 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e93245d-0352-4941-83f0-19c025ac6039 admin admin] PATH_INFO: `/v3/projects/5a1ed7587cef439195e3b72f9ca2106a` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:38.366320 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e93245d-0352-4941-83f0-19c025ac6039 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a1ed7587cef439195e3b72f9ca2106a)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:38.368373 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e93245d-0352-4941-83f0-19c025ac6039 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:38.420369 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5e93245d-0352-4941-83f0-19c025ac6039 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a1ed7587cef439195e3b72f9ca2106a', 'request_id': 'req-5e93245d-0352-4941-83f0-19c025ac6039'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:38.427617 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5e93245d-0352-4941-83f0-19c025ac6039 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a1ed7587cef439195e3b72f9ca2106a', 'request_id': 'req-5e93245d-0352-4941-83f0-19c025ac6039'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:38.435760 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec72ad27-3793-4411-8634-3516961b910f None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:38.436346 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec72ad27-3793-4411-8634-3516961b910f None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:38.436346 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec72ad27-3793-4411-8634-3516961b910f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:38.437611 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5e93245d-0352-4941-83f0-19c025ac6039 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a1ed7587cef439195e3b72f9ca2106a', 'request_id': 'req-5e93245d-0352-4941-83f0-19c025ac6039'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:38.450745 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5e93245d-0352-4941-83f0-19c025ac6039 admin admin] The token cache is being invalidate because project 5a1ed7587cef439195e3b72f9ca2106a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:23:38.451153 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5e93245d-0352-4941-83f0-19c025ac6039 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:38.451779 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5e93245d-0352-4941-83f0-19c025ac6039 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:38.453743 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1255/2543] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:23:38 2022] DELETE /identity/v3/projects/5a1ed7587cef439195e3b72f9ca2106a => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:23:38.455756 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-ec72ad27-3793-4411-8634-3516961b910f None None] MFA Rules not processed for user `bd758d5b21684027b0d199021df0ad2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:23:38.459121 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-ec72ad27-3793-4411-8634-3516961b910f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:38.460951 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444ed4c-cbdc-49f1-8dd5-2ddce9e54240 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:38.461328 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444ed4c-cbdc-49f1-8dd5-2ddce9e54240 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:38.461635 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444ed4c-cbdc-49f1-8dd5-2ddce9e54240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:38.487195 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-c444ed4c-cbdc-49f1-8dd5-2ddce9e54240 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:23:38.488716 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c444ed4c-cbdc-49f1-8dd5-2ddce9e54240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:38.515603 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:38.540794 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1289/2544] 10.222.0.42 () {58 vars in 967 bytes} [Mon Jul 4 09:23:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:23:38.557120 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec72ad27-3793-4411-8634-3516961b910f None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:38.559493 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-ec72ad27-3793-4411-8634-3516961b910f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:38.570867 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1256/2545] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:23:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:23:38.578658 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de84bf86-e588-4bf4-8343-55ac662c3137 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:38.578956 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de84bf86-e588-4bf4-8343-55ac662c3137 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:38.579380 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de84bf86-e588-4bf4-8343-55ac662c3137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:38.600558 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-de84bf86-e588-4bf4-8343-55ac662c3137 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:23:38.601886 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-de84bf86-e588-4bf4-8343-55ac662c3137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:38.610042 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1257/2546] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:23:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:23:38.614269 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de84bf86-e588-4bf4-8343-55ac662c3137 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:38.623437 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de84bf86-e588-4bf4-8343-55ac662c3137 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:38.628122 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73156b1b-0249-4c63-8069-1780ce87fdc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:38.628776 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73156b1b-0249-4c63-8069-1780ce87fdc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:38.629056 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73156b1b-0249-4c63-8069-1780ce87fdc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:38.629338 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73156b1b-0249-4c63-8069-1780ce87fdc3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:38.630073 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73156b1b-0249-4c63-8069-1780ce87fdc3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:23:38.630381 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73156b1b-0249-4c63-8069-1780ce87fdc3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:38.632118 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73156b1b-0249-4c63-8069-1780ce87fdc3 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:38.642126 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec72ad27-3793-4411-8634-3516961b910f None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:38.644100 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1258/2547] 10.222.0.42 () {58 vars in 1152 bytes} [Mon Jul 4 09:23:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:23:38.647212 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6898b72e-4568-4d57-9468-473e74e0d148 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59d8698c45fb46259765eb3c8de2297f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:38.647954 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6898b72e-4568-4d57-9468-473e74e0d148 service swift] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:38.648268 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6898b72e-4568-4d57-9468-473e74e0d148 service swift] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:38.648451 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73156b1b-0249-4c63-8069-1780ce87fdc3 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:38.648562 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6898b72e-4568-4d57-9468-473e74e0d148 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:38.657179 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6898b72e-4568-4d57-9468-473e74e0d148 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:38.658245 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73156b1b-0249-4c63-8069-1780ce87fdc3 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:38.658743 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6898b72e-4568-4d57-9468-473e74e0d148 service swift] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:38.663264 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56933cb-7dd1-4aa7-9cf1-ee1652fd79c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:38.663929 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56933cb-7dd1-4aa7-9cf1-ee1652fd79c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:38.664217 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56933cb-7dd1-4aa7-9cf1-ee1652fd79c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:38.664492 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56933cb-7dd1-4aa7-9cf1-ee1652fd79c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:38.665197 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56933cb-7dd1-4aa7-9cf1-ee1652fd79c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:38.667129 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56933cb-7dd1-4aa7-9cf1-ee1652fd79c0 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:38.667576 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1290/2548] 10.222.0.42 () {60 vars in 1384 bytes} [Mon Jul 4 09:23:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 04 09:23:38.695259 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1259/2549] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:23:38 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:23:38.699071 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6898b72e-4568-4d57-9468-473e74e0d148 service swift] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:38.709469 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6898b72e-4568-4d57-9468-473e74e0d148 service swift] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:38.740151 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:38.783266 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea022f6-551c-4abd-9e7b-fb6aabb827d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:38.784163 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea022f6-551c-4abd-9e7b-fb6aabb827d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:38.784587 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea022f6-551c-4abd-9e7b-fb6aabb827d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:38.784978 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea022f6-551c-4abd-9e7b-fb6aabb827d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:38.785854 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea022f6-551c-4abd-9e7b-fb6aabb827d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:38.789763 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea022f6-551c-4abd-9e7b-fb6aabb827d7 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:38.816035 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1291/2550] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:23:38 2022] POST /identity/v3/users => generated 287 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:23:38.822840 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56933cb-7dd1-4aa7-9cf1-ee1652fd79c0 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:38.837110 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56933cb-7dd1-4aa7-9cf1-ee1652fd79c0 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:38.841975 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d032a3b-f670-4041-9e3d-90cc6d13d51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:38.842633 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d032a3b-f670-4041-9e3d-90cc6d13d51e admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:38.842883 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d032a3b-f670-4041-9e3d-90cc6d13d51e admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:38.843154 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d032a3b-f670-4041-9e3d-90cc6d13d51e admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:38.843894 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d032a3b-f670-4041-9e3d-90cc6d13d51e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:38.845878 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d032a3b-f670-4041-9e3d-90cc6d13d51e admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:38.858146 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1260/2551] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:23:38.862565 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea022f6-551c-4abd-9e7b-fb6aabb827d7 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:38.873962 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea022f6-551c-4abd-9e7b-fb6aabb827d7 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:38.878914 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ffb9a5-7e08-456d-8fc6-0d02ac6740f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:38.879605 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ffb9a5-7e08-456d-8fc6-0d02ac6740f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:38.879977 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ffb9a5-7e08-456d-8fc6-0d02ac6740f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:38.880191 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ffb9a5-7e08-456d-8fc6-0d02ac6740f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:38.880931 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ffb9a5-7e08-456d-8fc6-0d02ac6740f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:38.882683 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ffb9a5-7e08-456d-8fc6-0d02ac6740f4 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:38.894429 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1292/2552] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:23:38.899062 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d032a3b-f670-4041-9e3d-90cc6d13d51e admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:38.909633 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d032a3b-f670-4041-9e3d-90cc6d13d51e admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:38.914682 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3e054b-5ac8-4d61-8706-285c42a4b3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:38.915742 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e054b-5ac8-4d61-8706-285c42a4b3c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:38.916081 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e054b-5ac8-4d61-8706-285c42a4b3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:38.916356 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e054b-5ac8-4d61-8706-285c42a4b3c4 admin admin] PATH_INFO: `/v3/projects/ebec3ad5e88d4c6bb814bfd4a44e527b/users/5d4e0981342c478b82bd837ff20f9fa2/roles/81634e7812344f84afcb29b0dba2687c` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:38.932250 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3e054b-5ac8-4d61-8706-285c42a4b3c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebec3ad5e88d4c6bb814bfd4a44e527b, user_id=5d4e0981342c478b82bd837ff20f9fa2, role_id=81634e7812344f84afcb29b0dba2687c)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:38.934969 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3e054b-5ac8-4d61-8706-285c42a4b3c4 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:38.949958 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1261/2553] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:23:38 2022] PUT /identity/v3/projects/ebec3ad5e88d4c6bb814bfd4a44e527b/users/5d4e0981342c478b82bd837ff20f9fa2/roles/81634e7812344f84afcb29b0dba2687c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:23:38.962490 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46f7bd-8064-4406-a1e1-b01dc5f9e58c None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:38.962913 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46f7bd-8064-4406-a1e1-b01dc5f9e58c None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:38.963272 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46f7bd-8064-4406-a1e1-b01dc5f9e58c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:38.991897 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-bf46f7bd-8064-4406-a1e1-b01dc5f9e58c None None] MFA Rules not processed for user `5d4e0981342c478b82bd837ff20f9fa2`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:23:38.993215 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-bf46f7bd-8064-4406-a1e1-b01dc5f9e58c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:39.057574 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1293/2554] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:23:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:23:39.062190 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3e054b-5ac8-4d61-8706-285c42a4b3c4 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:39.126582 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3e054b-5ac8-4d61-8706-285c42a4b3c4 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:39.131428 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c200130-a696-4af6-b33d-e13d30976f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:39.133156 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c200130-a696-4af6-b33d-e13d30976f2f admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:39.133437 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c200130-a696-4af6-b33d-e13d30976f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:39.133708 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c200130-a696-4af6-b33d-e13d30976f2f admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:39.134426 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c200130-a696-4af6-b33d-e13d30976f2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:39.136435 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c200130-a696-4af6-b33d-e13d30976f2f admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:39.171915 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1262/2555] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:23:39 2022] POST /identity/v3/projects => generated 371 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:23:39.173901 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf46f7bd-8064-4406-a1e1-b01dc5f9e58c None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:39.189505 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf46f7bd-8064-4406-a1e1-b01dc5f9e58c None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:39.253489 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2881795-3531-4b2f-a974-a28fb09e0ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:39.254167 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2881795-3531-4b2f-a974-a28fb09e0ac1 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:39.254451 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2881795-3531-4b2f-a974-a28fb09e0ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:39.254731 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2881795-3531-4b2f-a974-a28fb09e0ac1 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:39.255428 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2881795-3531-4b2f-a974-a28fb09e0ac1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:39.257654 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2881795-3531-4b2f-a974-a28fb09e0ac1 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:39.288608 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1294/2556] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:23:39 2022] POST /identity/v3/users => generated 292 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:23:39.289987 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c200130-a696-4af6-b33d-e13d30976f2f admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:39.303542 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c200130-a696-4af6-b33d-e13d30976f2f admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:39.308848 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025703e4-daa3-4244-bbdd-62be961d62f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:39.309627 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025703e4-daa3-4244-bbdd-62be961d62f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:39.309960 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025703e4-daa3-4244-bbdd-62be961d62f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:39.310677 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025703e4-daa3-4244-bbdd-62be961d62f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:39.311040 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025703e4-daa3-4244-bbdd-62be961d62f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:39.312998 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025703e4-daa3-4244-bbdd-62be961d62f9 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:39.325214 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1263/2557] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:23:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:23:39.329713 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2881795-3531-4b2f-a974-a28fb09e0ac1 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:39.342290 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2881795-3531-4b2f-a974-a28fb09e0ac1 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:39.347992 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6698c368-133f-4c2c-baf6-fabb79f962d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:39.348909 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6698c368-133f-4c2c-baf6-fabb79f962d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:39.349195 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6698c368-133f-4c2c-baf6-fabb79f962d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:39.349478 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6698c368-133f-4c2c-baf6-fabb79f962d5 admin admin] PATH_INFO: `/v3/projects/4b7ac812981d4c1caf2801d9a1f35914/users/fedff9f31aa24433901c9d99774549cc/roles/965049e7ce6144aaad23c15f3a5e37c3` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:39.369399 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6698c368-133f-4c2c-baf6-fabb79f962d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b7ac812981d4c1caf2801d9a1f35914, user_id=fedff9f31aa24433901c9d99774549cc, role_id=965049e7ce6144aaad23c15f3a5e37c3)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:39.372376 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6698c368-133f-4c2c-baf6-fabb79f962d5 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:39.388244 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1295/2558] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:23:39 2022] PUT /identity/v3/projects/4b7ac812981d4c1caf2801d9a1f35914/users/fedff9f31aa24433901c9d99774549cc/roles/965049e7ce6144aaad23c15f3a5e37c3 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:23:39.392136 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025703e4-daa3-4244-bbdd-62be961d62f9 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:39.402817 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025703e4-daa3-4244-bbdd-62be961d62f9 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:39.432359 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:39.489879 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e27df6d-6680-4876-935c-51cdebb755f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:39.490625 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27df6d-6680-4876-935c-51cdebb755f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:39.490918 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27df6d-6680-4876-935c-51cdebb755f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:39.491235 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27df6d-6680-4876-935c-51cdebb755f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:39.492022 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e27df6d-6680-4876-935c-51cdebb755f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:39.493681 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e27df6d-6680-4876-935c-51cdebb755f8 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:39.507913 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1264/2559] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:23:39 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:23:39.510860 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6698c368-133f-4c2c-baf6-fabb79f962d5 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:39.517755 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:39.518803 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e27df6d-6680-4876-935c-51cdebb755f8 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:39.520631 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6e27df6d-6680-4876-935c-51cdebb755f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:39.524591 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6698c368-133f-4c2c-baf6-fabb79f962d5 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:39.533498 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e27df6d-6680-4876-935c-51cdebb755f8 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:39.536622 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06185a2f-235b-4423-8419-62f75aac1c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:39.536622 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06185a2f-235b-4423-8419-62f75aac1c69 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:39.536622 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06185a2f-235b-4423-8419-62f75aac1c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:39.537706 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06185a2f-235b-4423-8419-62f75aac1c69 admin admin] PATH_INFO: `/v3/projects/4b7ac812981d4c1caf2801d9a1f35914/users/fedff9f31aa24433901c9d99774549cc/roles/965049e7ce6144aaad23c15f3a5e37c3` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:39.539314 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06185a2f-235b-4423-8419-62f75aac1c69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b7ac812981d4c1caf2801d9a1f35914, user_id=fedff9f31aa24433901c9d99774549cc, role_id=965049e7ce6144aaad23c15f3a5e37c3)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:39.540993 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1399a35d-156b-402e-8a11-9e5b9cba5fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:39.541861 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1399a35d-156b-402e-8a11-9e5b9cba5fcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:39.542025 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06185a2f-235b-4423-8419-62f75aac1c69 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:39.542126 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1399a35d-156b-402e-8a11-9e5b9cba5fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:39.542403 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1399a35d-156b-402e-8a11-9e5b9cba5fcf admin admin] PATH_INFO: `/v3/users/d5281cc03bbc4853be3560fcfd4cda0d` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:39.543596 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1399a35d-156b-402e-8a11-9e5b9cba5fcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5281cc03bbc4853be3560fcfd4cda0d)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:39.545576 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1399a35d-156b-402e-8a11-9e5b9cba5fcf admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:39.552880 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1296/2560] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:23:39 2022] PUT /identity/v3/projects/4b7ac812981d4c1caf2801d9a1f35914/users/fedff9f31aa24433901c9d99774549cc/roles/965049e7ce6144aaad23c15f3a5e37c3 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:23:39.563447 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5472d5ec-425f-4ceb-8cc8-67dd42f68687 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:39.563824 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5472d5ec-425f-4ceb-8cc8-67dd42f68687 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:39.564204 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5472d5ec-425f-4ceb-8cc8-67dd42f68687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:39.604874 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-1399a35d-156b-402e-8a11-9e5b9cba5fcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5281cc03bbc4853be3560fcfd4cda0d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:39.605565 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-1399a35d-156b-402e-8a11-9e5b9cba5fcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5281cc03bbc4853be3560fcfd4cda0d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:39.610374 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-5472d5ec-425f-4ceb-8cc8-67dd42f68687 None None] MFA Rules not processed for user `fedff9f31aa24433901c9d99774549cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:23:39.611665 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-5472d5ec-425f-4ceb-8cc8-67dd42f68687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:39.616466 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-1399a35d-156b-402e-8a11-9e5b9cba5fcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5281cc03bbc4853be3560fcfd4cda0d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:39.617620 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-1399a35d-156b-402e-8a11-9e5b9cba5fcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5281cc03bbc4853be3560fcfd4cda0d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:39.632022 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-1399a35d-156b-402e-8a11-9e5b9cba5fcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5281cc03bbc4853be3560fcfd4cda0d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:39.648554 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1265/2561] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:23:39 2022] DELETE /identity/v3/users/d5281cc03bbc4853be3560fcfd4cda0d => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:23:39.653100 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6057d65e-d475-4dfa-b565-70a5871547c3 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:39.653794 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6057d65e-d475-4dfa-b565-70a5871547c3 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:39.654089 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6057d65e-d475-4dfa-b565-70a5871547c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:39.672861 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-6057d65e-d475-4dfa-b565-70a5871547c3 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:23:39.673994 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6057d65e-d475-4dfa-b565-70a5871547c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:39.694736 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1297/2562] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:23:39 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:23:39.702061 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5472d5ec-425f-4ceb-8cc8-67dd42f68687 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:39.703617 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-5472d5ec-425f-4ceb-8cc8-67dd42f68687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:39.740231 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1266/2563] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:23:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:23:39.752383 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6057d65e-d475-4dfa-b565-70a5871547c3 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:39.754271 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6057d65e-d475-4dfa-b565-70a5871547c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:39.779504 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5472d5ec-425f-4ceb-8cc8-67dd42f68687 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:39.791196 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:39.817582 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6057d65e-d475-4dfa-b565-70a5871547c3 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:39.821354 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a2b8e5-b0fc-4133-88f8-399d2bd9822b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:39.822005 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a2b8e5-b0fc-4133-88f8-399d2bd9822b service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:39.822298 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a2b8e5-b0fc-4133-88f8-399d2bd9822b service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:39.822578 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a2b8e5-b0fc-4133-88f8-399d2bd9822b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:39.830459 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6df65b-087d-4dee-9e43-c0190a584f91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f86373d65440da97c853fff3c1d0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:39.831159 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6df65b-087d-4dee-9e43-c0190a584f91 service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:39.831453 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6df65b-087d-4dee-9e43-c0190a584f91 service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:39.831730 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6df65b-087d-4dee-9e43-c0190a584f91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:39.832037 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a2b8e5-b0fc-4133-88f8-399d2bd9822b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:39.833525 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a2b8e5-b0fc-4133-88f8-399d2bd9822b service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:39.833628 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-0a6df65b-087d-4dee-9e43-c0190a584f91 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:39.844282 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1267/2564] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:23:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 09:23:39.878908 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:39.896946 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6df65b-087d-4dee-9e43-c0190a584f91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:39.898733 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6df65b-087d-4dee-9e43-c0190a584f91 service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:39.908338 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1298/2565] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:23:39 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 09:23:40.155194 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a2b8e5-b0fc-4133-88f8-399d2bd9822b service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:40.156499 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-78a2b8e5-b0fc-4133-88f8-399d2bd9822b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:40.183430 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a2b8e5-b0fc-4133-88f8-399d2bd9822b service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:40.184947 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b3be62-51bd-4997-b750-6ecc799d9dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:40.186011 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b3be62-51bd-4997-b750-6ecc799d9dd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:40.186423 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b3be62-51bd-4997-b750-6ecc799d9dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:40.186707 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b3be62-51bd-4997-b750-6ecc799d9dd8 admin admin] PATH_INFO: `/v3/projects/d3bf825df23e4f51936ab9ff4abe9f55` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:40.187941 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b3be62-51bd-4997-b750-6ecc799d9dd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3bf825df23e4f51936ab9ff4abe9f55)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:40.189883 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b3be62-51bd-4997-b750-6ecc799d9dd8 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:40.254297 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-f6b3be62-51bd-4997-b750-6ecc799d9dd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3bf825df23e4f51936ab9ff4abe9f55', 'request_id': 'req-f6b3be62-51bd-4997-b750-6ecc799d9dd8'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:40.260970 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-f6b3be62-51bd-4997-b750-6ecc799d9dd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3bf825df23e4f51936ab9ff4abe9f55', 'request_id': 'req-f6b3be62-51bd-4997-b750-6ecc799d9dd8'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:40.268931 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-f6b3be62-51bd-4997-b750-6ecc799d9dd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3bf825df23e4f51936ab9ff4abe9f55', 'request_id': 'req-f6b3be62-51bd-4997-b750-6ecc799d9dd8'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:40.281386 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-f6b3be62-51bd-4997-b750-6ecc799d9dd8 admin admin] The token cache is being invalidate because project d3bf825df23e4f51936ab9ff4abe9f55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:23:40.281674 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-f6b3be62-51bd-4997-b750-6ecc799d9dd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:40.282310 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-f6b3be62-51bd-4997-b750-6ecc799d9dd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:40.284036 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1268/2566] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:23:40 2022] DELETE /identity/v3/projects/d3bf825df23e4f51936ab9ff4abe9f55 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:23:40.288259 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6df65b-087d-4dee-9e43-c0190a584f91 service cinder] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:40.302311 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6df65b-087d-4dee-9e43-c0190a584f91 service cinder] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:40.364062 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c3b297-394f-4a7c-b3c4-d02f0b2b3d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:40.364953 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c3b297-394f-4a7c-b3c4-d02f0b2b3d25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:40.365233 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c3b297-394f-4a7c-b3c4-d02f0b2b3d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:40.365505 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c3b297-394f-4a7c-b3c4-d02f0b2b3d25 admin admin] PATH_INFO: `/v3/users/baaa1f26bb6e4f67857dd9669b60ddf9` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:40.366835 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c3b297-394f-4a7c-b3c4-d02f0b2b3d25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=baaa1f26bb6e4f67857dd9669b60ddf9)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:40.368845 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c3b297-394f-4a7c-b3c4-d02f0b2b3d25 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:40.423534 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-26c3b297-394f-4a7c-b3c4-d02f0b2b3d25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'baaa1f26bb6e4f67857dd9669b60ddf9'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:40.433850 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-26c3b297-394f-4a7c-b3c4-d02f0b2b3d25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'baaa1f26bb6e4f67857dd9669b60ddf9'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:40.434441 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-26c3b297-394f-4a7c-b3c4-d02f0b2b3d25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'baaa1f26bb6e4f67857dd9669b60ddf9'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:40.435207 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-26c3b297-394f-4a7c-b3c4-d02f0b2b3d25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'baaa1f26bb6e4f67857dd9669b60ddf9'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:40.448525 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-26c3b297-394f-4a7c-b3c4-d02f0b2b3d25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'baaa1f26bb6e4f67857dd9669b60ddf9'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:40.463155 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1299/2567] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:23:40 2022] DELETE /identity/v3/users/baaa1f26bb6e4f67857dd9669b60ddf9 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:23:40.745289 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b3be62-51bd-4997-b750-6ecc799d9dd8 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:40.746903 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f6b3be62-51bd-4997-b750-6ecc799d9dd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:40.762728 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b3be62-51bd-4997-b750-6ecc799d9dd8 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:40.832022 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5f752b-aaf3-4f44-9b2d-99b2cb907925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:40.832897 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5f752b-aaf3-4f44-9b2d-99b2cb907925 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:40.833175 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5f752b-aaf3-4f44-9b2d-99b2cb907925 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:40.833450 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5f752b-aaf3-4f44-9b2d-99b2cb907925 admin admin] PATH_INFO: `/v3/projects/83ade278ebed460883a2fbfd4283c894` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:40.834630 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5f752b-aaf3-4f44-9b2d-99b2cb907925 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83ade278ebed460883a2fbfd4283c894)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:40.836683 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5f752b-aaf3-4f44-9b2d-99b2cb907925 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:40.887686 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7b5f752b-aaf3-4f44-9b2d-99b2cb907925 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83ade278ebed460883a2fbfd4283c894', 'request_id': 'req-7b5f752b-aaf3-4f44-9b2d-99b2cb907925'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:40.894715 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7b5f752b-aaf3-4f44-9b2d-99b2cb907925 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83ade278ebed460883a2fbfd4283c894', 'request_id': 'req-7b5f752b-aaf3-4f44-9b2d-99b2cb907925'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:40.896562 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:40.905849 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7b5f752b-aaf3-4f44-9b2d-99b2cb907925 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83ade278ebed460883a2fbfd4283c894', 'request_id': 'req-7b5f752b-aaf3-4f44-9b2d-99b2cb907925'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:40.918933 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7b5f752b-aaf3-4f44-9b2d-99b2cb907925 admin admin] The token cache is being invalidate because project 83ade278ebed460883a2fbfd4283c894 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:23:40.919226 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7b5f752b-aaf3-4f44-9b2d-99b2cb907925 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:40.919894 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7b5f752b-aaf3-4f44-9b2d-99b2cb907925 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:40.921458 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1269/2568] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:23:40 2022] DELETE /identity/v3/projects/83ade278ebed460883a2fbfd4283c894 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:23:40.926495 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa71e9d-9799-4c84-b7d1-2ffd3762184a None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:40.927048 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa71e9d-9799-4c84-b7d1-2ffd3762184a None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:40.927048 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa71e9d-9799-4c84-b7d1-2ffd3762184a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:40.944697 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-0aa71e9d-9799-4c84-b7d1-2ffd3762184a None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:23:40.946015 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-0aa71e9d-9799-4c84-b7d1-2ffd3762184a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:41.012389 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1300/2569] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:23:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:23:41.020506 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaab830f-e993-4ff8-89ce-74a6b8e337b1 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:41.020797 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaab830f-e993-4ff8-89ce-74a6b8e337b1 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:41.021077 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaab830f-e993-4ff8-89ce-74a6b8e337b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:41.039329 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-aaab830f-e993-4ff8-89ce-74a6b8e337b1 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:23:41.040549 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-aaab830f-e993-4ff8-89ce-74a6b8e337b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:41.048678 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1270/2570] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:23:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:23:41.052793 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa71e9d-9799-4c84-b7d1-2ffd3762184a None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:41.059586 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:41.063214 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa71e9d-9799-4c84-b7d1-2ffd3762184a None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:41.069375 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8532831-b4ca-4d80-aa63-6d766c06d01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:41.070140 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8532831-b4ca-4d80-aa63-6d766c06d01d admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:41.070436 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8532831-b4ca-4d80-aa63-6d766c06d01d admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:41.071017 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8532831-b4ca-4d80-aa63-6d766c06d01d admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:41.071828 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8532831-b4ca-4d80-aa63-6d766c06d01d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:23:41.072223 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8532831-b4ca-4d80-aa63-6d766c06d01d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:41.074204 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8532831-b4ca-4d80-aa63-6d766c06d01d admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:41.086393 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1301/2571] 10.222.0.42 () {58 vars in 1152 bytes} [Mon Jul 4 09:23:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:23:41.092146 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaab830f-e993-4ff8-89ce-74a6b8e337b1 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:41.104939 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaab830f-e993-4ff8-89ce-74a6b8e337b1 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:41.112092 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd36f89-d699-40f5-97ca-2f27746ce096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:41.112849 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd36f89-d699-40f5-97ca-2f27746ce096 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:41.113136 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd36f89-d699-40f5-97ca-2f27746ce096 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:41.113406 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd36f89-d699-40f5-97ca-2f27746ce096 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:41.114169 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd36f89-d699-40f5-97ca-2f27746ce096 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:41.116380 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd36f89-d699-40f5-97ca-2f27746ce096 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:41.142802 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1271/2572] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:23:41 2022] POST /identity/v3/projects => generated 367 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:23:41.147319 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8532831-b4ca-4d80-aa63-6d766c06d01d admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:41.157626 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8532831-b4ca-4d80-aa63-6d766c06d01d admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:41.215191 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd801b-e0a6-4084-a6b0-f56eb9a89e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:41.215895 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd801b-e0a6-4084-a6b0-f56eb9a89e7c admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:41.216204 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd801b-e0a6-4084-a6b0-f56eb9a89e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:41.216482 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd801b-e0a6-4084-a6b0-f56eb9a89e7c admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:41.217190 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdd801b-e0a6-4084-a6b0-f56eb9a89e7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:41.219140 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdd801b-e0a6-4084-a6b0-f56eb9a89e7c admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:41.242738 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1302/2573] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:23:41 2022] POST /identity/v3/users => generated 284 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:23:41.246655 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd36f89-d699-40f5-97ca-2f27746ce096 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:41.257566 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd36f89-d699-40f5-97ca-2f27746ce096 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:41.262696 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8672e776-21e5-4ec3-8824-a79bfacdc231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:41.263396 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672e776-21e5-4ec3-8824-a79bfacdc231 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:41.263699 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672e776-21e5-4ec3-8824-a79bfacdc231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:41.263975 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672e776-21e5-4ec3-8824-a79bfacdc231 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:41.264709 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8672e776-21e5-4ec3-8824-a79bfacdc231 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:41.266352 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8672e776-21e5-4ec3-8824-a79bfacdc231 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:41.277765 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1272/2574] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:23:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:23:41.281814 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd801b-e0a6-4084-a6b0-f56eb9a89e7c admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:41.295337 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd801b-e0a6-4084-a6b0-f56eb9a89e7c admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:41.300714 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad290f5-6d8c-4272-8598-498e5fffe07d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:41.301391 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad290f5-6d8c-4272-8598-498e5fffe07d admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:41.301678 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad290f5-6d8c-4272-8598-498e5fffe07d admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:41.301957 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad290f5-6d8c-4272-8598-498e5fffe07d admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:41.302692 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad290f5-6d8c-4272-8598-498e5fffe07d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:41.304451 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad290f5-6d8c-4272-8598-498e5fffe07d admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:41.315826 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1303/2575] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:23:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:23:41.320073 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8672e776-21e5-4ec3-8824-a79bfacdc231 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:41.329976 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8672e776-21e5-4ec3-8824-a79bfacdc231 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:41.334718 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6afcb96-a50f-4e55-9e97-ee30e4355851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:41.335660 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6afcb96-a50f-4e55-9e97-ee30e4355851 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:41.335979 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6afcb96-a50f-4e55-9e97-ee30e4355851 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:41.336290 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6afcb96-a50f-4e55-9e97-ee30e4355851 admin admin] PATH_INFO: `/v3/projects/6710356083a3418b93e235f22da361b0/users/ad5f383d5afb46618c589842afc12271/roles/81634e7812344f84afcb29b0dba2687c` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:41.353033 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6afcb96-a50f-4e55-9e97-ee30e4355851 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6710356083a3418b93e235f22da361b0, user_id=ad5f383d5afb46618c589842afc12271, role_id=81634e7812344f84afcb29b0dba2687c)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:41.356039 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6afcb96-a50f-4e55-9e97-ee30e4355851 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:41.369401 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1273/2576] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:23:41 2022] PUT /identity/v3/projects/6710356083a3418b93e235f22da361b0/users/ad5f383d5afb46618c589842afc12271/roles/81634e7812344f84afcb29b0dba2687c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:23:41.380892 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d46c5f-dbee-42be-8f56-155b286bc281 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:41.381187 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d46c5f-dbee-42be-8f56-155b286bc281 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:41.381472 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d46c5f-dbee-42be-8f56-155b286bc281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:41.409491 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-e8d46c5f-dbee-42be-8f56-155b286bc281 None None] MFA Rules not processed for user `ad5f383d5afb46618c589842afc12271`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:23:41.410707 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-e8d46c5f-dbee-42be-8f56-155b286bc281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:41.480614 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1304/2577] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:23:41 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:23:41.485104 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6afcb96-a50f-4e55-9e97-ee30e4355851 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:41.549945 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6afcb96-a50f-4e55-9e97-ee30e4355851 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:41.555781 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6a1ee1-f52d-4e85-b9e4-c3b6df09117c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:41.556502 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a1ee1-f52d-4e85-b9e4-c3b6df09117c admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:41.556787 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a1ee1-f52d-4e85-b9e4-c3b6df09117c admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:41.557066 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a1ee1-f52d-4e85-b9e4-c3b6df09117c admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:41.557792 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6a1ee1-f52d-4e85-b9e4-c3b6df09117c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:41.559863 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6a1ee1-f52d-4e85-b9e4-c3b6df09117c admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:41.586572 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1274/2578] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:23:41 2022] POST /identity/v3/projects => generated 367 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:23:41.590995 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d46c5f-dbee-42be-8f56-155b286bc281 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:41.602710 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d46c5f-dbee-42be-8f56-155b286bc281 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:41.665169 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9931d5a2-1ce4-4a4f-91a8-75f42e74c97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:41.665849 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931d5a2-1ce4-4a4f-91a8-75f42e74c97a admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:41.666131 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931d5a2-1ce4-4a4f-91a8-75f42e74c97a admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:41.666406 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931d5a2-1ce4-4a4f-91a8-75f42e74c97a admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:41.667094 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9931d5a2-1ce4-4a4f-91a8-75f42e74c97a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:41.669107 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9931d5a2-1ce4-4a4f-91a8-75f42e74c97a admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:41.675700 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:41.690421 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1305/2579] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:23:41 2022] POST /identity/v3/users => generated 290 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:23:41.694430 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6a1ee1-f52d-4e85-b9e4-c3b6df09117c admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:41.705300 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6a1ee1-f52d-4e85-b9e4-c3b6df09117c admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:41.710851 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605a2bb3-7c53-4554-9d94-4a7d1f54d1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:41.711493 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a2bb3-7c53-4554-9d94-4a7d1f54d1b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:41.711788 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a2bb3-7c53-4554-9d94-4a7d1f54d1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:41.712090 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a2bb3-7c53-4554-9d94-4a7d1f54d1b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:41.712808 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605a2bb3-7c53-4554-9d94-4a7d1f54d1b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:41.714471 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605a2bb3-7c53-4554-9d94-4a7d1f54d1b9 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:41.725975 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1275/2580] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:23:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:23:41.730776 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9931d5a2-1ce4-4a4f-91a8-75f42e74c97a admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:41.743051 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9931d5a2-1ce4-4a4f-91a8-75f42e74c97a admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:41.748806 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039e80d4-cf18-45bc-a748-f0a98734dd19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:41.749698 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e80d4-cf18-45bc-a748-f0a98734dd19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:41.749981 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e80d4-cf18-45bc-a748-f0a98734dd19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:41.750255 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e80d4-cf18-45bc-a748-f0a98734dd19 admin admin] PATH_INFO: `/v3/projects/2aa3e428f4fd4419b370788a32a8c4a7/users/a1a76ed7c72940ff9f006d467a479d67/roles/965049e7ce6144aaad23c15f3a5e37c3` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:41.768642 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039e80d4-cf18-45bc-a748-f0a98734dd19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2aa3e428f4fd4419b370788a32a8c4a7, user_id=a1a76ed7c72940ff9f006d467a479d67, role_id=965049e7ce6144aaad23c15f3a5e37c3)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:41.771363 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039e80d4-cf18-45bc-a748-f0a98734dd19 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:41.785917 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1306/2581] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:23:41 2022] PUT /identity/v3/projects/2aa3e428f4fd4419b370788a32a8c4a7/users/a1a76ed7c72940ff9f006d467a479d67/roles/965049e7ce6144aaad23c15f3a5e37c3 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:23:41.790183 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605a2bb3-7c53-4554-9d94-4a7d1f54d1b9 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:41.801280 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605a2bb3-7c53-4554-9d94-4a7d1f54d1b9 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:41.855597 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:41.862873 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f240490a-076e-4453-ab32-1e960420e05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:41.863786 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f240490a-076e-4453-ab32-1e960420e05c admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:41.864362 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f240490a-076e-4453-ab32-1e960420e05c admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:41.864653 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f240490a-076e-4453-ab32-1e960420e05c admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:41.865699 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f240490a-076e-4453-ab32-1e960420e05c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:41.867568 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f240490a-076e-4453-ab32-1e960420e05c admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:41.877886 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1276/2582] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:23:41 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:23:41.882275 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039e80d4-cf18-45bc-a748-f0a98734dd19 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:41.893670 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039e80d4-cf18-45bc-a748-f0a98734dd19 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:41.898293 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64e908e-ba00-4a9d-b17b-d14a4a4b7578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:41.899254 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e908e-ba00-4a9d-b17b-d14a4a4b7578 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:41.899539 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e908e-ba00-4a9d-b17b-d14a4a4b7578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:41.899815 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e908e-ba00-4a9d-b17b-d14a4a4b7578 admin admin] PATH_INFO: `/v3/projects/2aa3e428f4fd4419b370788a32a8c4a7/users/a1a76ed7c72940ff9f006d467a479d67/roles/965049e7ce6144aaad23c15f3a5e37c3` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:41.901795 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64e908e-ba00-4a9d-b17b-d14a4a4b7578 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2aa3e428f4fd4419b370788a32a8c4a7, user_id=a1a76ed7c72940ff9f006d467a479d67, role_id=965049e7ce6144aaad23c15f3a5e37c3)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:41.904491 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64e908e-ba00-4a9d-b17b-d14a4a4b7578 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:41.915124 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1307/2583] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:23:41 2022] PUT /identity/v3/projects/2aa3e428f4fd4419b370788a32a8c4a7/users/a1a76ed7c72940ff9f006d467a479d67/roles/965049e7ce6144aaad23c15f3a5e37c3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:23:41.925536 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec3301-b820-49f3-883e-817f84e888f3 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:41.925807 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec3301-b820-49f3-883e-817f84e888f3 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:41.926078 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec3301-b820-49f3-883e-817f84e888f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:41.954697 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-4bec3301-b820-49f3-883e-817f84e888f3 None None] MFA Rules not processed for user `a1a76ed7c72940ff9f006d467a479d67`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:23:41.956052 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-4bec3301-b820-49f3-883e-817f84e888f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:42.031804 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1277/2584] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:23:41 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:23:42.042957 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64e908e-ba00-4a9d-b17b-d14a4a4b7578 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:42.045077 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-b64e908e-ba00-4a9d-b17b-d14a4a4b7578 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:42.109049 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64e908e-ba00-4a9d-b17b-d14a4a4b7578 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:42.113106 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec866cf7-b0ce-4361-9868-086fcc1e5cb8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f86373d65440da97c853fff3c1d0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:42.113750 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec866cf7-b0ce-4361-9868-086fcc1e5cb8 service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:42.114035 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec866cf7-b0ce-4361-9868-086fcc1e5cb8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:42.114314 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec866cf7-b0ce-4361-9868-086fcc1e5cb8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:42.123786 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec866cf7-b0ce-4361-9868-086fcc1e5cb8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:42.125289 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec866cf7-b0ce-4361-9868-086fcc1e5cb8 service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:42.135045 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1308/2585] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:23:42 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:23:42.492250 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bec3301-b820-49f3-883e-817f84e888f3 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:42.493873 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-4bec3301-b820-49f3-883e-817f84e888f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:42.574077 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bec3301-b820-49f3-883e-817f84e888f3 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:42.583231 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26de06bf-2d5f-4cc3-9486-e286d390ebd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:42.584353 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26de06bf-2d5f-4cc3-9486-e286d390ebd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:42.584694 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26de06bf-2d5f-4cc3-9486-e286d390ebd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:42.585744 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26de06bf-2d5f-4cc3-9486-e286d390ebd9 admin admin] PATH_INFO: `/v3/users/5d4e0981342c478b82bd837ff20f9fa2` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:42.586374 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26de06bf-2d5f-4cc3-9486-e286d390ebd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d4e0981342c478b82bd837ff20f9fa2)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:42.589008 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26de06bf-2d5f-4cc3-9486-e286d390ebd9 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:42.646061 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-26de06bf-2d5f-4cc3-9486-e286d390ebd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d4e0981342c478b82bd837ff20f9fa2'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:42.647037 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-26de06bf-2d5f-4cc3-9486-e286d390ebd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d4e0981342c478b82bd837ff20f9fa2'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:42.657138 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-26de06bf-2d5f-4cc3-9486-e286d390ebd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d4e0981342c478b82bd837ff20f9fa2'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:42.658047 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-26de06bf-2d5f-4cc3-9486-e286d390ebd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d4e0981342c478b82bd837ff20f9fa2'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:42.675169 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-26de06bf-2d5f-4cc3-9486-e286d390ebd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d4e0981342c478b82bd837ff20f9fa2'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:42.683642 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:42.690003 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1278/2586] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:23:42 2022] DELETE /identity/v3/users/5d4e0981342c478b82bd837ff20f9fa2 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:23:42.695254 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b2d8b5-1ecc-417d-ad67-1d8bb358804d None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:42.695644 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b2d8b5-1ecc-417d-ad67-1d8bb358804d None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:42.696048 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b2d8b5-1ecc-417d-ad67-1d8bb358804d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:42.720401 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-33b2d8b5-1ecc-417d-ad67-1d8bb358804d None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:23:42.721548 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-33b2d8b5-1ecc-417d-ad67-1d8bb358804d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:42.808756 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1309/2587] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:23:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:23:42.818336 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26de06bf-2d5f-4cc3-9486-e286d390ebd9 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:42.819747 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-26de06bf-2d5f-4cc3-9486-e286d390ebd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:42.948263 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26de06bf-2d5f-4cc3-9486-e286d390ebd9 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:42.956898 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de40e58-43f4-4d99-93a0-0355144cae89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:42.957613 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de40e58-43f4-4d99-93a0-0355144cae89 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:42.957855 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de40e58-43f4-4d99-93a0-0355144cae89 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:42.958129 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de40e58-43f4-4d99-93a0-0355144cae89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:42.983518 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de40e58-43f4-4d99-93a0-0355144cae89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:42.985827 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de40e58-43f4-4d99-93a0-0355144cae89 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:43.018272 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1279/2588] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:23:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 09:23:43.354906 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b2d8b5-1ecc-417d-ad67-1d8bb358804d None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:43.357225 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-33b2d8b5-1ecc-417d-ad67-1d8bb358804d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:43.379513 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b2d8b5-1ecc-417d-ad67-1d8bb358804d None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:43.386975 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81375b0a-cbd7-4451-bbe3-7c581d0fb65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:43.388099 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81375b0a-cbd7-4451-bbe3-7c581d0fb65a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:43.388591 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81375b0a-cbd7-4451-bbe3-7c581d0fb65a admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:43.389167 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81375b0a-cbd7-4451-bbe3-7c581d0fb65a admin admin] PATH_INFO: `/v3/projects/ebec3ad5e88d4c6bb814bfd4a44e527b` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:43.391349 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81375b0a-cbd7-4451-bbe3-7c581d0fb65a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebec3ad5e88d4c6bb814bfd4a44e527b)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:43.393392 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81375b0a-cbd7-4451-bbe3-7c581d0fb65a admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:43.446930 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-81375b0a-cbd7-4451-bbe3-7c581d0fb65a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebec3ad5e88d4c6bb814bfd4a44e527b', 'request_id': 'req-81375b0a-cbd7-4451-bbe3-7c581d0fb65a'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:43.448981 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:INSERT=5,keystone:SELECT=91,keystone:DELETE=4 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:43.456802 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-81375b0a-cbd7-4451-bbe3-7c581d0fb65a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebec3ad5e88d4c6bb814bfd4a44e527b', 'request_id': 'req-81375b0a-cbd7-4451-bbe3-7c581d0fb65a'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:43.464937 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-81375b0a-cbd7-4451-bbe3-7c581d0fb65a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebec3ad5e88d4c6bb814bfd4a44e527b', 'request_id': 'req-81375b0a-cbd7-4451-bbe3-7c581d0fb65a'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:43.486152 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-81375b0a-cbd7-4451-bbe3-7c581d0fb65a admin admin] The token cache is being invalidate because project ebec3ad5e88d4c6bb814bfd4a44e527b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:23:43.486445 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-81375b0a-cbd7-4451-bbe3-7c581d0fb65a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:43.487110 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-81375b0a-cbd7-4451-bbe3-7c581d0fb65a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:43.488693 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1310/2589] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:23:43 2022] DELETE /identity/v3/projects/ebec3ad5e88d4c6bb814bfd4a44e527b => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:23:43.492904 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de40e58-43f4-4d99-93a0-0355144cae89 service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:43.514114 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de40e58-43f4-4d99-93a0-0355144cae89 service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:43.577007 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff39c1-a89b-4be3-a278-2aa4c4b080ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:43.577898 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff39c1-a89b-4be3-a278-2aa4c4b080ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:43.578179 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff39c1-a89b-4be3-a278-2aa4c4b080ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:43.578454 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff39c1-a89b-4be3-a278-2aa4c4b080ca admin admin] PATH_INFO: `/v3/users/fedff9f31aa24433901c9d99774549cc` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:43.579644 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ff39c1-a89b-4be3-a278-2aa4c4b080ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=fedff9f31aa24433901c9d99774549cc)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:43.581617 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ff39c1-a89b-4be3-a278-2aa4c4b080ca admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:43.624382 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4749f0-ab40-4155-89f7-0bf433e7623b None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:43.624707 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4749f0-ab40-4155-89f7-0bf433e7623b None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:43.624958 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4749f0-ab40-4155-89f7-0bf433e7623b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:43.644032 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c5ff39c1-a89b-4be3-a278-2aa4c4b080ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fedff9f31aa24433901c9d99774549cc'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:43.644254 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-bc4749f0-ab40-4155-89f7-0bf433e7623b None None] MFA Rules not processed for user `bd758d5b21684027b0d199021df0ad2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:23:43.644693 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c5ff39c1-a89b-4be3-a278-2aa4c4b080ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fedff9f31aa24433901c9d99774549cc'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:43.645599 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-bc4749f0-ab40-4155-89f7-0bf433e7623b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:43.653995 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c5ff39c1-a89b-4be3-a278-2aa4c4b080ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fedff9f31aa24433901c9d99774549cc'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:43.654535 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c5ff39c1-a89b-4be3-a278-2aa4c4b080ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fedff9f31aa24433901c9d99774549cc'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:43.670078 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c5ff39c1-a89b-4be3-a278-2aa4c4b080ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fedff9f31aa24433901c9d99774549cc'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:43.684174 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1280/2590] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:23:43 2022] DELETE /identity/v3/users/fedff9f31aa24433901c9d99774549cc => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:23:43.712142 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff39c1-a89b-4be3-a278-2aa4c4b080ca admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:43.713598 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c5ff39c1-a89b-4be3-a278-2aa4c4b080ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:43.714580 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1311/2591] 10.222.0.42 () {58 vars in 1009 bytes} [Mon Jul 4 09:23:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:23:43.728530 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4749f0-ab40-4155-89f7-0bf433e7623b None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:43.730576 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-bc4749f0-ab40-4155-89f7-0bf433e7623b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:43.745521 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:43.806884 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff39c1-a89b-4be3-a278-2aa4c4b080ca admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:43.813826 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743677b2-c531-4784-9fce-1a52c3ee38a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:43.814749 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743677b2-c531-4784-9fce-1a52c3ee38a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:43.815040 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743677b2-c531-4784-9fce-1a52c3ee38a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:43.815323 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743677b2-c531-4784-9fce-1a52c3ee38a0 admin admin] PATH_INFO: `/v3/users/ad5f383d5afb46618c589842afc12271` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:43.816600 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743677b2-c531-4784-9fce-1a52c3ee38a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad5f383d5afb46618c589842afc12271)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:43.818628 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743677b2-c531-4784-9fce-1a52c3ee38a0 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:43.822966 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4749f0-ab40-4155-89f7-0bf433e7623b None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:43.889533 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-743677b2-c531-4784-9fce-1a52c3ee38a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad5f383d5afb46618c589842afc12271'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:43.890330 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-743677b2-c531-4784-9fce-1a52c3ee38a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad5f383d5afb46618c589842afc12271'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:43.899373 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee3005-22f8-4fe4-9087-00e8475699fc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59d8698c45fb46259765eb3c8de2297f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:43.900305 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee3005-22f8-4fe4-9087-00e8475699fc service swift] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:43.900441 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee3005-22f8-4fe4-9087-00e8475699fc service swift] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:43.900630 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee3005-22f8-4fe4-9087-00e8475699fc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:43.902268 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-743677b2-c531-4784-9fce-1a52c3ee38a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad5f383d5afb46618c589842afc12271'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:43.902505 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-e9ee3005-22f8-4fe4-9087-00e8475699fc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:43.903210 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-743677b2-c531-4784-9fce-1a52c3ee38a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad5f383d5afb46618c589842afc12271'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:43.919675 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-743677b2-c531-4784-9fce-1a52c3ee38a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad5f383d5afb46618c589842afc12271'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:43.930757 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:43.939817 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1281/2592] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:23:43 2022] DELETE /identity/v3/users/ad5f383d5afb46618c589842afc12271 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:23:43.941605 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026c4c4-ff57-4f32-b68c-fc1e115eae54 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:43.941727 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026c4c4-ff57-4f32-b68c-fc1e115eae54 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:43.942018 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026c4c4-ff57-4f32-b68c-fc1e115eae54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:43.961368 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-e026c4c4-ff57-4f32-b68c-fc1e115eae54 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:23:43.962932 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e026c4c4-ff57-4f32-b68c-fc1e115eae54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:43.971444 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ee3005-22f8-4fe4-9087-00e8475699fc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:43.973194 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ee3005-22f8-4fe4-9087-00e8475699fc service swift] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:43.981881 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1312/2593] 10.222.0.42 () {60 vars in 1384 bytes} [Mon Jul 4 09:23:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 04 09:23:43.997928 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee3005-22f8-4fe4-9087-00e8475699fc service swift] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:44.000133 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-e9ee3005-22f8-4fe4-9087-00e8475699fc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:44.016113 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee3005-22f8-4fe4-9087-00e8475699fc service swift] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:44.060034 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1282/2594] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:23:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:23:44.069995 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e026c4c4-ff57-4f32-b68c-fc1e115eae54 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:44.071780 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e026c4c4-ff57-4f32-b68c-fc1e115eae54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:44.084891 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1dd156-7f56-4ba6-b4e0-79540d6650c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:44.086025 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1dd156-7f56-4ba6-b4e0-79540d6650c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:44.086488 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1dd156-7f56-4ba6-b4e0-79540d6650c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:44.086926 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1dd156-7f56-4ba6-b4e0-79540d6650c3 admin admin] PATH_INFO: `/v3/projects/4b7ac812981d4c1caf2801d9a1f35914` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:44.088154 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1dd156-7f56-4ba6-b4e0-79540d6650c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b7ac812981d4c1caf2801d9a1f35914)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:44.090220 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1dd156-7f56-4ba6-b4e0-79540d6650c3 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:44.123892 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:44.142669 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e026c4c4-ff57-4f32-b68c-fc1e115eae54 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:44.146207 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-5d1dd156-7f56-4ba6-b4e0-79540d6650c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b7ac812981d4c1caf2801d9a1f35914', 'request_id': 'req-5d1dd156-7f56-4ba6-b4e0-79540d6650c3'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:44.156266 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-5d1dd156-7f56-4ba6-b4e0-79540d6650c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b7ac812981d4c1caf2801d9a1f35914', 'request_id': 'req-5d1dd156-7f56-4ba6-b4e0-79540d6650c3'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:44.168124 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-5d1dd156-7f56-4ba6-b4e0-79540d6650c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b7ac812981d4c1caf2801d9a1f35914', 'request_id': 'req-5d1dd156-7f56-4ba6-b4e0-79540d6650c3'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:44.180115 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-5d1dd156-7f56-4ba6-b4e0-79540d6650c3 admin admin] The token cache is being invalidate because project 4b7ac812981d4c1caf2801d9a1f35914 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:23:44.180351 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-5d1dd156-7f56-4ba6-b4e0-79540d6650c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:44.181293 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-5d1dd156-7f56-4ba6-b4e0-79540d6650c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:44.183595 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1313/2595] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:23:43 2022] DELETE /identity/v3/projects/4b7ac812981d4c1caf2801d9a1f35914 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:23:44.188287 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a921565d-55a9-4d7b-b017-021e95a38ff7 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:44.188579 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a921565d-55a9-4d7b-b017-021e95a38ff7 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:44.188867 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a921565d-55a9-4d7b-b017-021e95a38ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:44.197538 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467a7e53-bbb3-4f90-bf1c-62de3739f12a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:44.198391 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a7e53-bbb3-4f90-bf1c-62de3739f12a service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:44.198543 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a7e53-bbb3-4f90-bf1c-62de3739f12a service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:44.198854 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a7e53-bbb3-4f90-bf1c-62de3739f12a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:44.200712 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-467a7e53-bbb3-4f90-bf1c-62de3739f12a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:44.210331 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-a921565d-55a9-4d7b-b017-021e95a38ff7 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:23:44.211776 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-a921565d-55a9-4d7b-b017-021e95a38ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:44.272607 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:44.288494 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1314/2596] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:23:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:23:44.290256 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467a7e53-bbb3-4f90-bf1c-62de3739f12a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:44.291977 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467a7e53-bbb3-4f90-bf1c-62de3739f12a service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:44.293105 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06167ec0-8bc2-4700-8612-69c89785e1c2 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:44.293401 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06167ec0-8bc2-4700-8612-69c89785e1c2 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:44.294024 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06167ec0-8bc2-4700-8612-69c89785e1c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:44.302861 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1283/2597] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:23:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 09:23:44.317612 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-06167ec0-8bc2-4700-8612-69c89785e1c2 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:23:44.318906 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-06167ec0-8bc2-4700-8612-69c89785e1c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:44.329571 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1315/2598] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:23:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:23:44.334282 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467a7e53-bbb3-4f90-bf1c-62de3739f12a service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:44.347337 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467a7e53-bbb3-4f90-bf1c-62de3739f12a service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:44.352900 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6edea61-cda9-4a8f-a088-6d157ac99123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:44.353722 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6edea61-cda9-4a8f-a088-6d157ac99123 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:44.354072 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6edea61-cda9-4a8f-a088-6d157ac99123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:44.354416 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6edea61-cda9-4a8f-a088-6d157ac99123 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:44.355253 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6edea61-cda9-4a8f-a088-6d157ac99123 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:23:44.355666 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6edea61-cda9-4a8f-a088-6d157ac99123 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:44.357754 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6edea61-cda9-4a8f-a088-6d157ac99123 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:44.375326 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1284/2599] 10.222.0.42 () {58 vars in 1152 bytes} [Mon Jul 4 09:23:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:23:44.379894 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06167ec0-8bc2-4700-8612-69c89785e1c2 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:44.391470 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06167ec0-8bc2-4700-8612-69c89785e1c2 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:44.396486 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ae65ef-b5b4-402b-a344-5f8db4949df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:44.397158 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae65ef-b5b4-402b-a344-5f8db4949df6 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:44.397572 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae65ef-b5b4-402b-a344-5f8db4949df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:44.397851 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae65ef-b5b4-402b-a344-5f8db4949df6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:44.398930 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ae65ef-b5b4-402b-a344-5f8db4949df6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:44.400782 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ae65ef-b5b4-402b-a344-5f8db4949df6 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:44.432641 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1316/2600] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:23:44 2022] POST /identity/v3/projects => generated 369 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:23:44.436980 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6edea61-cda9-4a8f-a088-6d157ac99123 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:44.448121 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6edea61-cda9-4a8f-a088-6d157ac99123 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:44.519693 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb83c8d-1aa5-4b82-b909-3d6525a5357c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:44.520406 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb83c8d-1aa5-4b82-b909-3d6525a5357c admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:44.520689 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb83c8d-1aa5-4b82-b909-3d6525a5357c admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:44.520970 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb83c8d-1aa5-4b82-b909-3d6525a5357c admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:44.521665 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb83c8d-1aa5-4b82-b909-3d6525a5357c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:44.523992 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb83c8d-1aa5-4b82-b909-3d6525a5357c admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:44.548281 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1285/2601] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:23:44 2022] POST /identity/v3/users => generated 285 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:23:44.552904 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ae65ef-b5b4-402b-a344-5f8db4949df6 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:44.565122 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ae65ef-b5b4-402b-a344-5f8db4949df6 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:44.583340 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d0f944-d95a-4f72-86ce-754e2c7556bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:44.585546 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d0f944-d95a-4f72-86ce-754e2c7556bc admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:44.585848 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d0f944-d95a-4f72-86ce-754e2c7556bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:44.586501 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d0f944-d95a-4f72-86ce-754e2c7556bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:44.586930 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d0f944-d95a-4f72-86ce-754e2c7556bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:44.588685 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d0f944-d95a-4f72-86ce-754e2c7556bc admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:44.603947 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1317/2602] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:23:44 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:23:44.605657 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb83c8d-1aa5-4b82-b909-3d6525a5357c admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:44.612022 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed25f1ad-04b7-40ec-98ec-c174045e6e63 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:44.612326 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed25f1ad-04b7-40ec-98ec-c174045e6e63 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:44.612607 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed25f1ad-04b7-40ec-98ec-c174045e6e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:44.618757 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb83c8d-1aa5-4b82-b909-3d6525a5357c admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:44.624819 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daad8e1-fc7e-4428-ba4e-ab61b4d70fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:44.625709 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daad8e1-fc7e-4428-ba4e-ab61b4d70fdd admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:44.626615 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daad8e1-fc7e-4428-ba4e-ab61b4d70fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:44.626921 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daad8e1-fc7e-4428-ba4e-ab61b4d70fdd admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:44.627664 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daad8e1-fc7e-4428-ba4e-ab61b4d70fdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:44.629358 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daad8e1-fc7e-4428-ba4e-ab61b4d70fdd admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:44.632646 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-ed25f1ad-04b7-40ec-98ec-c174045e6e63 None None] MFA Rules not processed for user `bd758d5b21684027b0d199021df0ad2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:23:44.634038 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-ed25f1ad-04b7-40ec-98ec-c174045e6e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:44.640599 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1286/2603] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:23:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:23:44.641565 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daad8e1-fc7e-4428-ba4e-ab61b4d70fdd admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:44.643452 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-2daad8e1-fc7e-4428-ba4e-ab61b4d70fdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:44.657136 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daad8e1-fc7e-4428-ba4e-ab61b4d70fdd admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:44.661854 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a85ded1-9c60-4ed3-8e8b-09dd106a6462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:44.662725 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85ded1-9c60-4ed3-8e8b-09dd106a6462 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:44.663011 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85ded1-9c60-4ed3-8e8b-09dd106a6462 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:44.663393 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85ded1-9c60-4ed3-8e8b-09dd106a6462 admin admin] PATH_INFO: `/v3/projects/6710356083a3418b93e235f22da361b0` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:44.664859 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a85ded1-9c60-4ed3-8e8b-09dd106a6462 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6710356083a3418b93e235f22da361b0)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:44.666807 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a85ded1-9c60-4ed3-8e8b-09dd106a6462 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:44.674381 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:44.702333 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1318/2604] 10.222.0.42 () {58 vars in 967 bytes} [Mon Jul 4 09:23:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:23:44.703164 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed25f1ad-04b7-40ec-98ec-c174045e6e63 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:44.714350 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed25f1ad-04b7-40ec-98ec-c174045e6e63 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:44.719000 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9a85ded1-9c60-4ed3-8e8b-09dd106a6462 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6710356083a3418b93e235f22da361b0', 'request_id': 'req-9a85ded1-9c60-4ed3-8e8b-09dd106a6462'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:44.724976 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9a85ded1-9c60-4ed3-8e8b-09dd106a6462 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6710356083a3418b93e235f22da361b0', 'request_id': 'req-9a85ded1-9c60-4ed3-8e8b-09dd106a6462'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:44.734443 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9a85ded1-9c60-4ed3-8e8b-09dd106a6462 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6710356083a3418b93e235f22da361b0', 'request_id': 'req-9a85ded1-9c60-4ed3-8e8b-09dd106a6462'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:44.750368 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9a85ded1-9c60-4ed3-8e8b-09dd106a6462 admin admin] The token cache is being invalidate because project 6710356083a3418b93e235f22da361b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:23:44.750574 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9a85ded1-9c60-4ed3-8e8b-09dd106a6462 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:44.751214 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9a85ded1-9c60-4ed3-8e8b-09dd106a6462 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:44.752835 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1287/2605] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:23:44 2022] DELETE /identity/v3/projects/6710356083a3418b93e235f22da361b0 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:23:44.753609 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a85ded1-9c60-4ed3-8e8b-09dd106a6462 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:44.754907 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9a85ded1-9c60-4ed3-8e8b-09dd106a6462 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:44.778647 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf4bf5-356b-43fd-b822-c654685daa33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:44.779554 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf4bf5-356b-43fd-b822-c654685daa33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:44.779840 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf4bf5-356b-43fd-b822-c654685daa33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:44.780143 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf4bf5-356b-43fd-b822-c654685daa33 admin admin] PATH_INFO: `/v3/projects/877c3a1fc9d542f4979463c6937f0fa7/users/690c83a9da7c4707b5e34e8ad9155a44/roles/81634e7812344f84afcb29b0dba2687c` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:44.794317 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcf4bf5-356b-43fd-b822-c654685daa33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=877c3a1fc9d542f4979463c6937f0fa7, user_id=690c83a9da7c4707b5e34e8ad9155a44, role_id=81634e7812344f84afcb29b0dba2687c)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:44.797120 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcf4bf5-356b-43fd-b822-c654685daa33 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:44.810673 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1319/2606] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:23:44 2022] PUT /identity/v3/projects/877c3a1fc9d542f4979463c6937f0fa7/users/690c83a9da7c4707b5e34e8ad9155a44/roles/81634e7812344f84afcb29b0dba2687c => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:23:44.811548 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf4bf5-356b-43fd-b822-c654685daa33 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:44.813111 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-abcf4bf5-356b-43fd-b822-c654685daa33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:44.825837 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a85ded1-9c60-4ed3-8e8b-09dd106a6462 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:44.862324 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:44.879347 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf4bf5-356b-43fd-b822-c654685daa33 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:44.884488 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34450ed-f119-4647-a961-eaa35606d751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:44.884900 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34450ed-f119-4647-a961-eaa35606d751 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:44.885178 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34450ed-f119-4647-a961-eaa35606d751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:44.885456 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34450ed-f119-4647-a961-eaa35606d751 admin admin] PATH_INFO: `/v3/users/a1a76ed7c72940ff9f006d467a479d67` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:44.885585 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f260968-5fb2-4dc5-966a-095a57e9c9d3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59d8698c45fb46259765eb3c8de2297f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:44.886242 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f260968-5fb2-4dc5-966a-095a57e9c9d3 service swift] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:44.886677 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34450ed-f119-4647-a961-eaa35606d751 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1a76ed7c72940ff9f006d467a479d67)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:44.887670 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f260968-5fb2-4dc5-966a-095a57e9c9d3 service swift] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:44.887670 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f260968-5fb2-4dc5-966a-095a57e9c9d3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:44.888675 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34450ed-f119-4647-a961-eaa35606d751 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:44.889526 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0f260968-5fb2-4dc5-966a-095a57e9c9d3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:44.931917 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:44.938444 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-e34450ed-f119-4647-a961-eaa35606d751 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1a76ed7c72940ff9f006d467a479d67'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:44.946872 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-e34450ed-f119-4647-a961-eaa35606d751 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1a76ed7c72940ff9f006d467a479d67'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:44.947704 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-e34450ed-f119-4647-a961-eaa35606d751 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1a76ed7c72940ff9f006d467a479d67'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:44.948486 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-e34450ed-f119-4647-a961-eaa35606d751 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1a76ed7c72940ff9f006d467a479d67'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:44.953017 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f260968-5fb2-4dc5-966a-095a57e9c9d3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:44.954652 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f260968-5fb2-4dc5-966a-095a57e9c9d3 service swift] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:44.960624 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-e34450ed-f119-4647-a961-eaa35606d751 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1a76ed7c72940ff9f006d467a479d67'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:44.963044 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1288/2607] 10.222.0.42 () {60 vars in 1384 bytes} [Mon Jul 4 09:23:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 04 09:23:44.964349 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cea5ea-5b8b-4a25-b491-d71956946d74 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:44.964659 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cea5ea-5b8b-4a25-b491-d71956946d74 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:44.964916 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cea5ea-5b8b-4a25-b491-d71956946d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:44.974502 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1320/2608] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:23:44 2022] DELETE /identity/v3/users/a1a76ed7c72940ff9f006d467a479d67 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:23:44.993493 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-64cea5ea-5b8b-4a25-b491-d71956946d74 None None] MFA Rules not processed for user `690c83a9da7c4707b5e34e8ad9155a44`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:23:44.994693 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-64cea5ea-5b8b-4a25-b491-d71956946d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:45.081478 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1289/2609] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:23:44 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:23:45.094496 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34450ed-f119-4647-a961-eaa35606d751 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:45.096675 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-e34450ed-f119-4647-a961-eaa35606d751 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:45.176119 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34450ed-f119-4647-a961-eaa35606d751 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:45.180330 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5641bccc-016b-4000-89bb-af302b1d45e7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92e3804048824cde829e6273ce7c19b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:45.180996 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5641bccc-016b-4000-89bb-af302b1d45e7 service glance] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:45.181542 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5641bccc-016b-4000-89bb-af302b1d45e7 service glance] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:45.181832 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5641bccc-016b-4000-89bb-af302b1d45e7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:45.191128 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5641bccc-016b-4000-89bb-af302b1d45e7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:45.192890 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5641bccc-016b-4000-89bb-af302b1d45e7 service glance] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:45.193527 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248001f-ae73-404e-9dd0-eb9f89ce3f92 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:45.193970 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248001f-ae73-404e-9dd0-eb9f89ce3f92 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:45.194412 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248001f-ae73-404e-9dd0-eb9f89ce3f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:45.202900 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1321/2610] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:23:45 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:23:45.214470 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-c248001f-ae73-404e-9dd0-eb9f89ce3f92 None None] MFA Rules not processed for user `bd758d5b21684027b0d199021df0ad2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:23:45.215908 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c248001f-ae73-404e-9dd0-eb9f89ce3f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:45.281222 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5641bccc-016b-4000-89bb-af302b1d45e7 service glance] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:45.283738 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-5641bccc-016b-4000-89bb-af302b1d45e7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:45.294253 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1290/2611] 10.222.0.42 () {58 vars in 1009 bytes} [Mon Jul 4 09:23:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:23:45.309208 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c248001f-ae73-404e-9dd0-eb9f89ce3f92 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:45.311455 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c248001f-ae73-404e-9dd0-eb9f89ce3f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:45.370148 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5641bccc-016b-4000-89bb-af302b1d45e7 service glance] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:45.375649 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c9b8ae-63cc-4e9b-bc96-4f114beefe68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:45.376582 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9b8ae-63cc-4e9b-bc96-4f114beefe68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:45.376868 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9b8ae-63cc-4e9b-bc96-4f114beefe68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:45.377395 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9b8ae-63cc-4e9b-bc96-4f114beefe68 admin admin] PATH_INFO: `/v3/projects/2aa3e428f4fd4419b370788a32a8c4a7` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:45.378948 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c9b8ae-63cc-4e9b-bc96-4f114beefe68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2aa3e428f4fd4419b370788a32a8c4a7)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:45.381025 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c9b8ae-63cc-4e9b-bc96-4f114beefe68 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:45.390737 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c248001f-ae73-404e-9dd0-eb9f89ce3f92 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:45.392218 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:45.396263 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54880069-c985-4ccc-84a5-52e58721443d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59d8698c45fb46259765eb3c8de2297f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:45.396924 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54880069-c985-4ccc-84a5-52e58721443d service swift] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:45.397209 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54880069-c985-4ccc-84a5-52e58721443d service swift] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:45.397485 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54880069-c985-4ccc-84a5-52e58721443d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:45.406433 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54880069-c985-4ccc-84a5-52e58721443d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:45.408082 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54880069-c985-4ccc-84a5-52e58721443d service swift] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:45.418946 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1291/2612] 10.222.0.42 () {60 vars in 1384 bytes} [Mon Jul 4 09:23:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 04 09:23:45.446902 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-e5c9b8ae-63cc-4e9b-bc96-4f114beefe68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2aa3e428f4fd4419b370788a32a8c4a7', 'request_id': 'req-e5c9b8ae-63cc-4e9b-bc96-4f114beefe68'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:45.457083 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-e5c9b8ae-63cc-4e9b-bc96-4f114beefe68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2aa3e428f4fd4419b370788a32a8c4a7', 'request_id': 'req-e5c9b8ae-63cc-4e9b-bc96-4f114beefe68'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:45.463613 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-e5c9b8ae-63cc-4e9b-bc96-4f114beefe68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2aa3e428f4fd4419b370788a32a8c4a7', 'request_id': 'req-e5c9b8ae-63cc-4e9b-bc96-4f114beefe68'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:45.479044 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-e5c9b8ae-63cc-4e9b-bc96-4f114beefe68 admin admin] The token cache is being invalidate because project 2aa3e428f4fd4419b370788a32a8c4a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:23:45.479417 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-e5c9b8ae-63cc-4e9b-bc96-4f114beefe68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:45.480185 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-e5c9b8ae-63cc-4e9b-bc96-4f114beefe68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:45.481872 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1322/2613] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:23:45 2022] DELETE /identity/v3/projects/2aa3e428f4fd4419b370788a32a8c4a7 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:23:45.487962 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903fcda0-becb-43eb-b196-77cb96acbedf None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:45.488333 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903fcda0-becb-43eb-b196-77cb96acbedf None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:45.488611 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903fcda0-becb-43eb-b196-77cb96acbedf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:45.496947 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:45.511819 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-903fcda0-becb-43eb-b196-77cb96acbedf None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:23:45.513022 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-903fcda0-becb-43eb-b196-77cb96acbedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:45.593886 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1292/2614] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:23:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:23:45.603692 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb542a-ee3f-4dd8-bcda-f3d1bf4068c6 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:45.604023 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb542a-ee3f-4dd8-bcda-f3d1bf4068c6 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:45.604313 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb542a-ee3f-4dd8-bcda-f3d1bf4068c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:45.626232 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-d2bb542a-ee3f-4dd8-bcda-f3d1bf4068c6 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:23:45.627580 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-d2bb542a-ee3f-4dd8-bcda-f3d1bf4068c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:45.639717 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1323/2615] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:23:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:23:45.641471 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903fcda0-becb-43eb-b196-77cb96acbedf None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:45.656629 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903fcda0-becb-43eb-b196-77cb96acbedf None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:45.673975 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd89d460-3c68-46d9-b835-ac2b9b24419b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:45.675540 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd89d460-3c68-46d9-b835-ac2b9b24419b admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:45.675903 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd89d460-3c68-46d9-b835-ac2b9b24419b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:45.676424 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd89d460-3c68-46d9-b835-ac2b9b24419b admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:45.677169 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd89d460-3c68-46d9-b835-ac2b9b24419b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:23:45.677457 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd89d460-3c68-46d9-b835-ac2b9b24419b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:45.684358 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd89d460-3c68-46d9-b835-ac2b9b24419b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:45.700708 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1293/2616] 10.222.0.42 () {58 vars in 1152 bytes} [Mon Jul 4 09:23:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:23:45.705255 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bb542a-ee3f-4dd8-bcda-f3d1bf4068c6 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:45.718141 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bb542a-ee3f-4dd8-bcda-f3d1bf4068c6 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:45.723362 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a8ad72-bc83-4e85-845b-869f204f766b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:45.724067 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8ad72-bc83-4e85-845b-869f204f766b admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:45.724353 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8ad72-bc83-4e85-845b-869f204f766b admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:45.724628 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8ad72-bc83-4e85-845b-869f204f766b admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:45.725326 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a8ad72-bc83-4e85-845b-869f204f766b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:45.727282 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a8ad72-bc83-4e85-845b-869f204f766b admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:45.769458 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1324/2617] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:23:45 2022] POST /identity/v3/projects => generated 367 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:23:45.770450 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd89d460-3c68-46d9-b835-ac2b9b24419b admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:45.781322 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd89d460-3c68-46d9-b835-ac2b9b24419b admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:45.801001 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a35fd37-449d-4d22-a925-3414ec14e2bb None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:45.801355 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a35fd37-449d-4d22-a925-3414ec14e2bb None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:45.801627 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a35fd37-449d-4d22-a925-3414ec14e2bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:45.820071 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-7a35fd37-449d-4d22-a925-3414ec14e2bb None None] MFA Rules not processed for user `bd758d5b21684027b0d199021df0ad2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:23:45.821555 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-7a35fd37-449d-4d22-a925-3414ec14e2bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:45.841552 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7821cd5f-20d6-45b3-9faf-28be8b6f75ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:45.842232 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7821cd5f-20d6-45b3-9faf-28be8b6f75ae admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:45.842516 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7821cd5f-20d6-45b3-9faf-28be8b6f75ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:45.842844 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7821cd5f-20d6-45b3-9faf-28be8b6f75ae admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:45.843582 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7821cd5f-20d6-45b3-9faf-28be8b6f75ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:45.845923 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7821cd5f-20d6-45b3-9faf-28be8b6f75ae admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:45.866444 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1294/2618] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:23:45 2022] POST /identity/v3/users => generated 284 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:23:45.870748 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7821cd5f-20d6-45b3-9faf-28be8b6f75ae admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:45.882752 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7821cd5f-20d6-45b3-9faf-28be8b6f75ae admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:45.885876 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1325/2619] 10.222.0.42 () {58 vars in 967 bytes} [Mon Jul 4 09:23:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:23:45.891122 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2bc895-5c84-4b66-b545-321e83ab0d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:45.891991 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2bc895-5c84-4b66-b545-321e83ab0d6a admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:45.892280 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2bc895-5c84-4b66-b545-321e83ab0d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:45.892851 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2bc895-5c84-4b66-b545-321e83ab0d6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:45.893429 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2bc895-5c84-4b66-b545-321e83ab0d6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:45.895297 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2bc895-5c84-4b66-b545-321e83ab0d6a admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:45.898490 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a35fd37-449d-4d22-a925-3414ec14e2bb None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:45.899950 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-7a35fd37-449d-4d22-a925-3414ec14e2bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:45.908458 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1295/2620] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:23:45 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:23:45.912362 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2bc895-5c84-4b66-b545-321e83ab0d6a admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:45.925281 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2bc895-5c84-4b66-b545-321e83ab0d6a admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:45.930469 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b58150f-7aee-4d5a-b85b-7688a5123382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:45.931167 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b58150f-7aee-4d5a-b85b-7688a5123382 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:45.931452 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b58150f-7aee-4d5a-b85b-7688a5123382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:45.931727 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b58150f-7aee-4d5a-b85b-7688a5123382 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:45.932503 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b58150f-7aee-4d5a-b85b-7688a5123382 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:45.934135 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b58150f-7aee-4d5a-b85b-7688a5123382 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:45.947463 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1296/2621] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:23:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:23:45.948999 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b58150f-7aee-4d5a-b85b-7688a5123382 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:45.960753 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b58150f-7aee-4d5a-b85b-7688a5123382 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:45.965501 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c4af45-0505-4785-9590-492999d3ccf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:45.966389 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c4af45-0505-4785-9590-492999d3ccf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:45.966669 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c4af45-0505-4785-9590-492999d3ccf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:45.966942 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c4af45-0505-4785-9590-492999d3ccf6 admin admin] PATH_INFO: `/v3/projects/739d4d93d2a844c5bbbd7b8b663052e0/users/15fdbdace7f947efbfc4ec83dc5fcc3e/roles/81634e7812344f84afcb29b0dba2687c` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:45.972655 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a35fd37-449d-4d22-a925-3414ec14e2bb None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:45.977703 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86953f4-17bf-4809-9792-cfc583f6da08 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59d8698c45fb46259765eb3c8de2297f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:45.978356 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86953f4-17bf-4809-9792-cfc583f6da08 service swift] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:45.978842 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86953f4-17bf-4809-9792-cfc583f6da08 service swift] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:45.979094 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86953f4-17bf-4809-9792-cfc583f6da08 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:45.984041 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c4af45-0505-4785-9590-492999d3ccf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=739d4d93d2a844c5bbbd7b8b663052e0, user_id=15fdbdace7f947efbfc4ec83dc5fcc3e, role_id=81634e7812344f84afcb29b0dba2687c)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:45.986868 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c4af45-0505-4785-9590-492999d3ccf6 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:45.988082 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86953f4-17bf-4809-9792-cfc583f6da08 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:45.989683 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86953f4-17bf-4809-9792-cfc583f6da08 service swift] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:46.000035 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1326/2622] 10.222.0.42 () {60 vars in 1384 bytes} [Mon Jul 4 09:23:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 04 09:23:46.002652 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1297/2623] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:23:45 2022] PUT /identity/v3/projects/739d4d93d2a844c5bbbd7b8b663052e0/users/15fdbdace7f947efbfc4ec83dc5fcc3e/roles/81634e7812344f84afcb29b0dba2687c => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:23:46.013145 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a58e0-6cdf-4849-be47-f653d9a2aaef None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:46.013445 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a58e0-6cdf-4849-be47-f653d9a2aaef None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:46.013722 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a58e0-6cdf-4849-be47-f653d9a2aaef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:46.024181 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:46.050456 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-7b7a58e0-6cdf-4849-be47-f653d9a2aaef None None] MFA Rules not processed for user `15fdbdace7f947efbfc4ec83dc5fcc3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:23:46.051670 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-7b7a58e0-6cdf-4849-be47-f653d9a2aaef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:46.132162 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1327/2624] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:23:46 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:23:46.136868 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c4af45-0505-4785-9590-492999d3ccf6 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:46.182112 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:46.215199 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c4af45-0505-4785-9590-492999d3ccf6 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:46.221550 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e59d88-643f-491f-b39e-f9d36b0fd1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:46.222100 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e59d88-643f-491f-b39e-f9d36b0fd1e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:46.222385 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e59d88-643f-491f-b39e-f9d36b0fd1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:46.222666 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e59d88-643f-491f-b39e-f9d36b0fd1e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:46.225440 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e59d88-643f-491f-b39e-f9d36b0fd1e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:46.225440 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e59d88-643f-491f-b39e-f9d36b0fd1e0 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:46.258352 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1298/2625] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:23:46 2022] POST /identity/v3/projects => generated 365 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:23:46.263358 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a58e0-6cdf-4849-be47-f653d9a2aaef None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:46.277737 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a58e0-6cdf-4849-be47-f653d9a2aaef None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:46.346762 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc946da2-c07d-475e-ab3d-bc47252178fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:46.347461 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc946da2-c07d-475e-ab3d-bc47252178fc admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:46.347744 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc946da2-c07d-475e-ab3d-bc47252178fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:46.348053 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc946da2-c07d-475e-ab3d-bc47252178fc admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:46.348767 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc946da2-c07d-475e-ab3d-bc47252178fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:46.350696 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc946da2-c07d-475e-ab3d-bc47252178fc admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:46.377633 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1328/2626] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:23:46 2022] POST /identity/v3/users => generated 289 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:23:46.381702 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e59d88-643f-491f-b39e-f9d36b0fd1e0 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:46.392607 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e59d88-643f-491f-b39e-f9d36b0fd1e0 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:46.400045 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2243dc2-52e4-4b70-9c20-8405634ed1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:46.400045 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2243dc2-52e4-4b70-9c20-8405634ed1b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:46.400045 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2243dc2-52e4-4b70-9c20-8405634ed1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:46.400045 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2243dc2-52e4-4b70-9c20-8405634ed1b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:46.400431 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2243dc2-52e4-4b70-9c20-8405634ed1b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:46.401605 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2243dc2-52e4-4b70-9c20-8405634ed1b7 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:46.414828 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1299/2627] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:23:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:23:46.419031 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc946da2-c07d-475e-ab3d-bc47252178fc admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:46.429690 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc946da2-c07d-475e-ab3d-bc47252178fc admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:46.435110 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddb3b28-56b3-4e9d-a2eb-0e5ea28b8b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:46.436044 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddb3b28-56b3-4e9d-a2eb-0e5ea28b8b3b admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:46.436328 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddb3b28-56b3-4e9d-a2eb-0e5ea28b8b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:46.436604 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddb3b28-56b3-4e9d-a2eb-0e5ea28b8b3b admin admin] PATH_INFO: `/v3/projects/bf77f826e04c46dcb543e55487f99265/users/9ed4bb6dba17439cbc8d93e020e88b0d/roles/965049e7ce6144aaad23c15f3a5e37c3` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:46.455729 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddb3b28-56b3-4e9d-a2eb-0e5ea28b8b3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf77f826e04c46dcb543e55487f99265, user_id=9ed4bb6dba17439cbc8d93e020e88b0d, role_id=965049e7ce6144aaad23c15f3a5e37c3)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:46.458506 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddb3b28-56b3-4e9d-a2eb-0e5ea28b8b3b admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:46.473515 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1329/2628] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:23:46 2022] PUT /identity/v3/projects/bf77f826e04c46dcb543e55487f99265/users/9ed4bb6dba17439cbc8d93e020e88b0d/roles/965049e7ce6144aaad23c15f3a5e37c3 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:23:46.477479 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2243dc2-52e4-4b70-9c20-8405634ed1b7 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:46.488364 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2243dc2-52e4-4b70-9c20-8405634ed1b7 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:46.554217 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b188f3-4e7c-4f21-8132-08ea1e29f933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:46.554912 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b188f3-4e7c-4f21-8132-08ea1e29f933 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:46.555201 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b188f3-4e7c-4f21-8132-08ea1e29f933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:46.555476 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b188f3-4e7c-4f21-8132-08ea1e29f933 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:46.556241 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b188f3-4e7c-4f21-8132-08ea1e29f933 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:46.557867 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b188f3-4e7c-4f21-8132-08ea1e29f933 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:46.567938 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1300/2629] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:23:46 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:23:46.572266 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddb3b28-56b3-4e9d-a2eb-0e5ea28b8b3b admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:46.583900 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddb3b28-56b3-4e9d-a2eb-0e5ea28b8b3b admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:46.589847 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdebef1d-3908-4d0e-8166-9cd89516a4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:46.590848 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdebef1d-3908-4d0e-8166-9cd89516a4e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:46.591194 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdebef1d-3908-4d0e-8166-9cd89516a4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:46.591535 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdebef1d-3908-4d0e-8166-9cd89516a4e0 admin admin] PATH_INFO: `/v3/projects/bf77f826e04c46dcb543e55487f99265/users/9ed4bb6dba17439cbc8d93e020e88b0d/roles/965049e7ce6144aaad23c15f3a5e37c3` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:46.593671 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdebef1d-3908-4d0e-8166-9cd89516a4e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf77f826e04c46dcb543e55487f99265, user_id=9ed4bb6dba17439cbc8d93e020e88b0d, role_id=965049e7ce6144aaad23c15f3a5e37c3)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:46.596825 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdebef1d-3908-4d0e-8166-9cd89516a4e0 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:46.613941 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1330/2630] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:23:46 2022] PUT /identity/v3/projects/bf77f826e04c46dcb543e55487f99265/users/9ed4bb6dba17439cbc8d93e020e88b0d/roles/965049e7ce6144aaad23c15f3a5e37c3 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:23:46.624664 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a58da-57d9-4ef1-b576-823745349f43 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:46.624953 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a58da-57d9-4ef1-b576-823745349f43 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:46.625229 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a58da-57d9-4ef1-b576-823745349f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:46.658281 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-7c4a58da-57d9-4ef1-b576-823745349f43 None None] MFA Rules not processed for user `9ed4bb6dba17439cbc8d93e020e88b0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:23:46.659508 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-7c4a58da-57d9-4ef1-b576-823745349f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:46.743911 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1301/2631] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:23:46 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:23:46.773467 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdebef1d-3908-4d0e-8166-9cd89516a4e0 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:46.775529 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-bdebef1d-3908-4d0e-8166-9cd89516a4e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:46.837278 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:46.843290 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdebef1d-3908-4d0e-8166-9cd89516a4e0 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:46.848514 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790762aa-a861-421d-b02a-fbd619a74473 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f86373d65440da97c853fff3c1d0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:46.849626 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790762aa-a861-421d-b02a-fbd619a74473 service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:46.850002 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790762aa-a861-421d-b02a-fbd619a74473 service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:46.850420 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790762aa-a861-421d-b02a-fbd619a74473 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:46.861966 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790762aa-a861-421d-b02a-fbd619a74473 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:46.863510 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790762aa-a861-421d-b02a-fbd619a74473 service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:46.874068 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1331/2632] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:23:46 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:23:46.927291 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4a58da-57d9-4ef1-b576-823745349f43 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:46.939090 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4a58da-57d9-4ef1-b576-823745349f43 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:46.942882 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870e8498-22e4-4cb1-bbd0-5eb0616e7338 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f86373d65440da97c853fff3c1d0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:46.943551 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870e8498-22e4-4cb1-bbd0-5eb0616e7338 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:46.943835 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870e8498-22e4-4cb1-bbd0-5eb0616e7338 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:46.944147 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870e8498-22e4-4cb1-bbd0-5eb0616e7338 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:46.978463 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:47.026021 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870e8498-22e4-4cb1-bbd0-5eb0616e7338 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:47.027539 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870e8498-22e4-4cb1-bbd0-5eb0616e7338 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:47.037672 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1302/2633] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:23:46 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:23:48.179911 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790762aa-a861-421d-b02a-fbd619a74473 service cinder] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:48.181552 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-790762aa-a861-421d-b02a-fbd619a74473 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:48.253858 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790762aa-a861-421d-b02a-fbd619a74473 service cinder] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:48.258777 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee04204-68e7-434e-9d09-1008334f8004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:48.259662 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee04204-68e7-434e-9d09-1008334f8004 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:48.259973 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee04204-68e7-434e-9d09-1008334f8004 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:48.260246 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee04204-68e7-434e-9d09-1008334f8004 admin admin] PATH_INFO: `/v3/users/7560798fe5c44f52a4785a5a7fd7803e` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:48.261481 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee04204-68e7-434e-9d09-1008334f8004 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7560798fe5c44f52a4785a5a7fd7803e)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:48.263661 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee04204-68e7-434e-9d09-1008334f8004 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:48.314702 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-9ee04204-68e7-434e-9d09-1008334f8004 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7560798fe5c44f52a4785a5a7fd7803e'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:48.322665 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-9ee04204-68e7-434e-9d09-1008334f8004 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7560798fe5c44f52a4785a5a7fd7803e'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:48.323282 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-9ee04204-68e7-434e-9d09-1008334f8004 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7560798fe5c44f52a4785a5a7fd7803e'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:48.323930 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-9ee04204-68e7-434e-9d09-1008334f8004 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7560798fe5c44f52a4785a5a7fd7803e'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:48.339056 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-9ee04204-68e7-434e-9d09-1008334f8004 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7560798fe5c44f52a4785a5a7fd7803e'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:48.359936 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1332/2634] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:23:48 2022] DELETE /identity/v3/users/7560798fe5c44f52a4785a5a7fd7803e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:23:48.364522 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fa0c02-efd3-453d-b6ea-665add2ed948 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:48.365005 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fa0c02-efd3-453d-b6ea-665add2ed948 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:48.365126 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fa0c02-efd3-453d-b6ea-665add2ed948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:48.384411 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-69fa0c02-efd3-453d-b6ea-665add2ed948 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:23:48.385639 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-69fa0c02-efd3-453d-b6ea-665add2ed948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:48.455516 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1303/2635] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:23:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:23:48.465260 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee04204-68e7-434e-9d09-1008334f8004 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:48.466942 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-9ee04204-68e7-434e-9d09-1008334f8004 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:48.532113 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee04204-68e7-434e-9d09-1008334f8004 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:48.535845 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37b6895-608e-47eb-b27d-6726ba7f41ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:48.536532 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b6895-608e-47eb-b27d-6726ba7f41ce service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:48.536826 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b6895-608e-47eb-b27d-6726ba7f41ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:48.537104 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b6895-608e-47eb-b27d-6726ba7f41ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:48.546456 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37b6895-608e-47eb-b27d-6726ba7f41ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:48.547936 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37b6895-608e-47eb-b27d-6726ba7f41ce service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:48.557682 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1333/2636] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:23:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:23:48.748511 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fa0c02-efd3-453d-b6ea-665add2ed948 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:48.752761 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-69fa0c02-efd3-453d-b6ea-665add2ed948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:48.787740 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fa0c02-efd3-453d-b6ea-665add2ed948 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:48.800547 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddfc084-00b5-4446-b9c9-6773157b8896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:48.801624 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddfc084-00b5-4446-b9c9-6773157b8896 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:48.801905 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddfc084-00b5-4446-b9c9-6773157b8896 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:48.802178 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddfc084-00b5-4446-b9c9-6773157b8896 admin admin] PATH_INFO: `/v3/projects/8f6aed161af94fb4b7488f056652eb12` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:48.803388 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddfc084-00b5-4446-b9c9-6773157b8896 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f6aed161af94fb4b7488f056652eb12)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:48.805333 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddfc084-00b5-4446-b9c9-6773157b8896 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:48.867252 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-1ddfc084-00b5-4446-b9c9-6773157b8896 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f6aed161af94fb4b7488f056652eb12', 'request_id': 'req-1ddfc084-00b5-4446-b9c9-6773157b8896'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:48.873339 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-1ddfc084-00b5-4446-b9c9-6773157b8896 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f6aed161af94fb4b7488f056652eb12', 'request_id': 'req-1ddfc084-00b5-4446-b9c9-6773157b8896'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:48.882273 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-1ddfc084-00b5-4446-b9c9-6773157b8896 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f6aed161af94fb4b7488f056652eb12', 'request_id': 'req-1ddfc084-00b5-4446-b9c9-6773157b8896'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:48.896312 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-1ddfc084-00b5-4446-b9c9-6773157b8896 admin admin] The token cache is being invalidate because project 8f6aed161af94fb4b7488f056652eb12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:23:48.896681 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-1ddfc084-00b5-4446-b9c9-6773157b8896 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:48.897391 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-1ddfc084-00b5-4446-b9c9-6773157b8896 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:48.899517 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1304/2637] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:23:48 2022] DELETE /identity/v3/projects/8f6aed161af94fb4b7488f056652eb12 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:23:48.904814 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2572cc-95dc-4ddb-8c09-8fb8e223225b None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:48.905105 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2572cc-95dc-4ddb-8c09-8fb8e223225b None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:48.905385 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2572cc-95dc-4ddb-8c09-8fb8e223225b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:48.923738 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-8c2572cc-95dc-4ddb-8c09-8fb8e223225b None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:23:48.925049 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-8c2572cc-95dc-4ddb-8c09-8fb8e223225b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:48.930385 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:48.988482 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1334/2638] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:23:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:23:49.001658 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e524e8-6239-4976-b486-d9a2744825c0 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:49.001997 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e524e8-6239-4976-b486-d9a2744825c0 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:49.002398 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e524e8-6239-4976-b486-d9a2744825c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:49.024866 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-a6e524e8-6239-4976-b486-d9a2744825c0 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:23:49.026096 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a6e524e8-6239-4976-b486-d9a2744825c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:49.034911 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1305/2639] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:23:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:23:49.039468 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2572cc-95dc-4ddb-8c09-8fb8e223225b None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:49.050275 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2572cc-95dc-4ddb-8c09-8fb8e223225b None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:49.056124 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb28f27-3078-4365-bfb1-9c6914b4f128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:49.056840 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb28f27-3078-4365-bfb1-9c6914b4f128 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:49.057124 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb28f27-3078-4365-bfb1-9c6914b4f128 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:49.057413 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb28f27-3078-4365-bfb1-9c6914b4f128 admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:49.058278 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb28f27-3078-4365-bfb1-9c6914b4f128 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:23:49.058584 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb28f27-3078-4365-bfb1-9c6914b4f128 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:49.060234 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb28f27-3078-4365-bfb1-9c6914b4f128 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:49.072824 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1335/2640] 10.222.0.42 () {58 vars in 1152 bytes} [Mon Jul 4 09:23:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:23:49.077637 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e524e8-6239-4976-b486-d9a2744825c0 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:49.088035 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e524e8-6239-4976-b486-d9a2744825c0 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:49.094068 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de10255-0d92-44fa-8471-6a6176df67ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:49.095103 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de10255-0d92-44fa-8471-6a6176df67ca admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:49.095377 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de10255-0d92-44fa-8471-6a6176df67ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:49.095648 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de10255-0d92-44fa-8471-6a6176df67ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:49.096393 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de10255-0d92-44fa-8471-6a6176df67ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:49.098358 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de10255-0d92-44fa-8471-6a6176df67ca admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:49.129477 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1306/2641] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:23:49 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:23:49.133970 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb28f27-3078-4365-bfb1-9c6914b4f128 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:49.144632 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb28f27-3078-4365-bfb1-9c6914b4f128 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:49.205495 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b04bb4-cdca-40b6-8e5e-ec82e6b7cb90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:49.206307 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b04bb4-cdca-40b6-8e5e-ec82e6b7cb90 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:49.206409 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b04bb4-cdca-40b6-8e5e-ec82e6b7cb90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:49.206635 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b04bb4-cdca-40b6-8e5e-ec82e6b7cb90 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:49.207377 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b04bb4-cdca-40b6-8e5e-ec82e6b7cb90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:49.209435 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b04bb4-cdca-40b6-8e5e-ec82e6b7cb90 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:49.232546 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1336/2642] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:23:49 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:23:49.237237 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de10255-0d92-44fa-8471-6a6176df67ca admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:49.249901 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de10255-0d92-44fa-8471-6a6176df67ca admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:49.255418 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348e6fc3-9334-4f31-9de0-d0b9f92a6aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:49.256131 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e6fc3-9334-4f31-9de0-d0b9f92a6aee admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:49.256415 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e6fc3-9334-4f31-9de0-d0b9f92a6aee admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:49.256702 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e6fc3-9334-4f31-9de0-d0b9f92a6aee admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:49.257476 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348e6fc3-9334-4f31-9de0-d0b9f92a6aee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:49.259130 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348e6fc3-9334-4f31-9de0-d0b9f92a6aee admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:49.270897 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1307/2643] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:23:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:23:49.275819 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b04bb4-cdca-40b6-8e5e-ec82e6b7cb90 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:49.286710 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b04bb4-cdca-40b6-8e5e-ec82e6b7cb90 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:49.291799 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca3314f-f35b-4002-aca9-3dfb2c411a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:49.292482 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca3314f-f35b-4002-aca9-3dfb2c411a9f admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:49.292773 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca3314f-f35b-4002-aca9-3dfb2c411a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:49.293157 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca3314f-f35b-4002-aca9-3dfb2c411a9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:49.298202 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca3314f-f35b-4002-aca9-3dfb2c411a9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:49.299887 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca3314f-f35b-4002-aca9-3dfb2c411a9f admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:49.315842 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1337/2644] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:23:49 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:23:49.320469 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348e6fc3-9334-4f31-9de0-d0b9f92a6aee admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:49.330951 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348e6fc3-9334-4f31-9de0-d0b9f92a6aee admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:49.336266 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91bc1e2-69b3-44c8-b760-6f3e365d265b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:49.337167 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91bc1e2-69b3-44c8-b760-6f3e365d265b admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:49.337474 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91bc1e2-69b3-44c8-b760-6f3e365d265b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:49.337748 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91bc1e2-69b3-44c8-b760-6f3e365d265b admin admin] PATH_INFO: `/v3/projects/38da9300b49a48668f9c8815c2c9a715/users/54de34583d5544d28f52c5fdb08e1e38/roles/81634e7812344f84afcb29b0dba2687c` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:49.346740 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:49.356684 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91bc1e2-69b3-44c8-b760-6f3e365d265b admin admin] RBAC: Authorizing `identity:create_grant(project_id=38da9300b49a48668f9c8815c2c9a715, user_id=54de34583d5544d28f52c5fdb08e1e38, role_id=81634e7812344f84afcb29b0dba2687c)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:49.360683 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91bc1e2-69b3-44c8-b760-6f3e365d265b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:49.375328 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1308/2645] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:23:49 2022] PUT /identity/v3/projects/38da9300b49a48668f9c8815c2c9a715/users/54de34583d5544d28f52c5fdb08e1e38/roles/81634e7812344f84afcb29b0dba2687c => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:23:49.380664 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab170d-afcc-4191-900b-e0f54abe7623 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:49.380952 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab170d-afcc-4191-900b-e0f54abe7623 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:49.381236 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab170d-afcc-4191-900b-e0f54abe7623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:49.403105 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-9eab170d-afcc-4191-900b-e0f54abe7623 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:23:49.404413 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-9eab170d-afcc-4191-900b-e0f54abe7623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:49.471106 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1338/2646] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:23:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:23:49.481344 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91bc1e2-69b3-44c8-b760-6f3e365d265b admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:49.484124 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f91bc1e2-69b3-44c8-b760-6f3e365d265b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:49.543774 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91bc1e2-69b3-44c8-b760-6f3e365d265b admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:49.548028 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa4c99a-0dc9-4013-997e-7ce86f878af6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:49.548683 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4c99a-0dc9-4013-997e-7ce86f878af6 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:49.548958 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4c99a-0dc9-4013-997e-7ce86f878af6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:49.549219 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4c99a-0dc9-4013-997e-7ce86f878af6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:49.559266 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa4c99a-0dc9-4013-997e-7ce86f878af6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:49.560771 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa4c99a-0dc9-4013-997e-7ce86f878af6 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:49.571308 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1309/2647] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:23:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:23:50.505762 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eab170d-afcc-4191-900b-e0f54abe7623 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:50.510249 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-9eab170d-afcc-4191-900b-e0f54abe7623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:50.523319 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eab170d-afcc-4191-900b-e0f54abe7623 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:50.528475 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6084d1-8af5-44fe-b8d6-026c00caa5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:50.529574 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6084d1-8af5-44fe-b8d6-026c00caa5a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:50.530040 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6084d1-8af5-44fe-b8d6-026c00caa5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:50.530474 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6084d1-8af5-44fe-b8d6-026c00caa5a5 admin admin] PATH_INFO: `/v3/users/15fdbdace7f947efbfc4ec83dc5fcc3e` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:50.532468 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6084d1-8af5-44fe-b8d6-026c00caa5a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15fdbdace7f947efbfc4ec83dc5fcc3e)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:50.534932 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6084d1-8af5-44fe-b8d6-026c00caa5a5 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:50.552755 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:50.598591 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-1d6084d1-8af5-44fe-b8d6-026c00caa5a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15fdbdace7f947efbfc4ec83dc5fcc3e'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:50.609683 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-1d6084d1-8af5-44fe-b8d6-026c00caa5a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15fdbdace7f947efbfc4ec83dc5fcc3e'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:50.610591 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-1d6084d1-8af5-44fe-b8d6-026c00caa5a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15fdbdace7f947efbfc4ec83dc5fcc3e'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:50.611765 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-1d6084d1-8af5-44fe-b8d6-026c00caa5a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15fdbdace7f947efbfc4ec83dc5fcc3e'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:50.631625 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-1d6084d1-8af5-44fe-b8d6-026c00caa5a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15fdbdace7f947efbfc4ec83dc5fcc3e'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:50.646645 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1339/2648] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:23:50 2022] DELETE /identity/v3/users/15fdbdace7f947efbfc4ec83dc5fcc3e => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:23:50.651343 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc503ed-0f8f-4780-bcfc-aaaeec2cae83 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:50.651852 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc503ed-0f8f-4780-bcfc-aaaeec2cae83 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:50.652008 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc503ed-0f8f-4780-bcfc-aaaeec2cae83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:50.670411 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-8bc503ed-0f8f-4780-bcfc-aaaeec2cae83 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:23:50.672317 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-8bc503ed-0f8f-4780-bcfc-aaaeec2cae83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:50.764920 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1310/2649] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:23:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:23:50.778438 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6084d1-8af5-44fe-b8d6-026c00caa5a5 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:50.780178 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-1d6084d1-8af5-44fe-b8d6-026c00caa5a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:50.850746 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6084d1-8af5-44fe-b8d6-026c00caa5a5 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:50.854087 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e935d916-2d34-4415-9d07-f3db0528146b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:50.854778 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e935d916-2d34-4415-9d07-f3db0528146b service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:50.855064 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e935d916-2d34-4415-9d07-f3db0528146b service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:50.855391 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e935d916-2d34-4415-9d07-f3db0528146b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:50.867470 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e935d916-2d34-4415-9d07-f3db0528146b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:50.869736 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e935d916-2d34-4415-9d07-f3db0528146b service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:50.884427 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1340/2650] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:23:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:23:51.284977 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc503ed-0f8f-4780-bcfc-aaaeec2cae83 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:51.286717 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-8bc503ed-0f8f-4780-bcfc-aaaeec2cae83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:51.309233 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc503ed-0f8f-4780-bcfc-aaaeec2cae83 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:51.316453 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53afcd4a-b1d7-4c23-97d0-aeeb782cf71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:51.317647 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53afcd4a-b1d7-4c23-97d0-aeeb782cf71a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:51.317930 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53afcd4a-b1d7-4c23-97d0-aeeb782cf71a admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:51.318199 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53afcd4a-b1d7-4c23-97d0-aeeb782cf71a admin admin] PATH_INFO: `/v3/projects/739d4d93d2a844c5bbbd7b8b663052e0` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:51.322497 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53afcd4a-b1d7-4c23-97d0-aeeb782cf71a admin admin] RBAC: Authorizing `identity:delete_project(project_id=739d4d93d2a844c5bbbd7b8b663052e0)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:51.327064 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53afcd4a-b1d7-4c23-97d0-aeeb782cf71a admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:51.392849 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-53afcd4a-b1d7-4c23-97d0-aeeb782cf71a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '739d4d93d2a844c5bbbd7b8b663052e0', 'request_id': 'req-53afcd4a-b1d7-4c23-97d0-aeeb782cf71a'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:51.398716 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-53afcd4a-b1d7-4c23-97d0-aeeb782cf71a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '739d4d93d2a844c5bbbd7b8b663052e0', 'request_id': 'req-53afcd4a-b1d7-4c23-97d0-aeeb782cf71a'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:51.409707 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-53afcd4a-b1d7-4c23-97d0-aeeb782cf71a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '739d4d93d2a844c5bbbd7b8b663052e0', 'request_id': 'req-53afcd4a-b1d7-4c23-97d0-aeeb782cf71a'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:51.424211 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-53afcd4a-b1d7-4c23-97d0-aeeb782cf71a admin admin] The token cache is being invalidate because project 739d4d93d2a844c5bbbd7b8b663052e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:23:51.424611 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-53afcd4a-b1d7-4c23-97d0-aeeb782cf71a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:51.425228 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-53afcd4a-b1d7-4c23-97d0-aeeb782cf71a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:51.427212 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1311/2651] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:23:51 2022] DELETE /identity/v3/projects/739d4d93d2a844c5bbbd7b8b663052e0 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:23:51.431282 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e935d916-2d34-4415-9d07-f3db0528146b service neutron] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:51.441707 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e935d916-2d34-4415-9d07-f3db0528146b service neutron] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:51.516158 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94ddffa-a509-469d-a559-d6a77c1ab54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:51.516971 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ddffa-a509-469d-a559-d6a77c1ab54d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:51.517249 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ddffa-a509-469d-a559-d6a77c1ab54d admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:51.517522 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ddffa-a509-469d-a559-d6a77c1ab54d admin admin] PATH_INFO: `/v3/users/9ed4bb6dba17439cbc8d93e020e88b0d` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:51.518728 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94ddffa-a509-469d-a559-d6a77c1ab54d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ed4bb6dba17439cbc8d93e020e88b0d)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:51.520747 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94ddffa-a509-469d-a559-d6a77c1ab54d admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:51.568900 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:51.579471 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-e94ddffa-a509-469d-a559-d6a77c1ab54d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ed4bb6dba17439cbc8d93e020e88b0d'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:51.593259 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-e94ddffa-a509-469d-a559-d6a77c1ab54d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ed4bb6dba17439cbc8d93e020e88b0d'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:51.593882 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-e94ddffa-a509-469d-a559-d6a77c1ab54d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ed4bb6dba17439cbc8d93e020e88b0d'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:51.594498 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-e94ddffa-a509-469d-a559-d6a77c1ab54d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ed4bb6dba17439cbc8d93e020e88b0d'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:51.607448 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-e94ddffa-a509-469d-a559-d6a77c1ab54d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ed4bb6dba17439cbc8d93e020e88b0d'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:51.619700 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1341/2652] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:23:51 2022] DELETE /identity/v3/users/9ed4bb6dba17439cbc8d93e020e88b0d => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:23:51.961886 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53afcd4a-b1d7-4c23-97d0-aeeb782cf71a admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:51.964366 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-53afcd4a-b1d7-4c23-97d0-aeeb782cf71a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:51.992492 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53afcd4a-b1d7-4c23-97d0-aeeb782cf71a admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:52.018417 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:52.092161 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b349c199-a794-4e2e-a334-77e65c223768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:52.093290 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b349c199-a794-4e2e-a334-77e65c223768 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:52.093813 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b349c199-a794-4e2e-a334-77e65c223768 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:52.094175 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b349c199-a794-4e2e-a334-77e65c223768 admin admin] PATH_INFO: `/v3/projects/bf77f826e04c46dcb543e55487f99265` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:52.096496 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b349c199-a794-4e2e-a334-77e65c223768 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf77f826e04c46dcb543e55487f99265)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:52.098795 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b349c199-a794-4e2e-a334-77e65c223768 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:52.168753 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b349c199-a794-4e2e-a334-77e65c223768 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf77f826e04c46dcb543e55487f99265', 'request_id': 'req-b349c199-a794-4e2e-a334-77e65c223768'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:52.177213 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b349c199-a794-4e2e-a334-77e65c223768 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf77f826e04c46dcb543e55487f99265', 'request_id': 'req-b349c199-a794-4e2e-a334-77e65c223768'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:52.190459 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b349c199-a794-4e2e-a334-77e65c223768 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf77f826e04c46dcb543e55487f99265', 'request_id': 'req-b349c199-a794-4e2e-a334-77e65c223768'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:52.204772 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b349c199-a794-4e2e-a334-77e65c223768 admin admin] The token cache is being invalidate because project bf77f826e04c46dcb543e55487f99265 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:23:52.205298 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b349c199-a794-4e2e-a334-77e65c223768 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:52.206104 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b349c199-a794-4e2e-a334-77e65c223768 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:52.207990 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1312/2653] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:23:51 2022] DELETE /identity/v3/projects/bf77f826e04c46dcb543e55487f99265 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:23:52.213058 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed555c7-91a5-47af-8b6e-13280450fbdc None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:52.214125 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed555c7-91a5-47af-8b6e-13280450fbdc None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:52.214653 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed555c7-91a5-47af-8b6e-13280450fbdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:52.239527 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-5ed555c7-91a5-47af-8b6e-13280450fbdc None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:23:52.240804 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-5ed555c7-91a5-47af-8b6e-13280450fbdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:52.315647 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1342/2654] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:23:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:23:52.324812 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c31d9-e8c8-4b9c-8612-74e9fcd5b882 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:52.325515 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c31d9-e8c8-4b9c-8612-74e9fcd5b882 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:52.325977 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c31d9-e8c8-4b9c-8612-74e9fcd5b882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:52.354391 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-c72c31d9-e8c8-4b9c-8612-74e9fcd5b882 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:23:52.355769 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c72c31d9-e8c8-4b9c-8612-74e9fcd5b882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:52.367748 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1313/2655] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:23:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:23:52.368920 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed555c7-91a5-47af-8b6e-13280450fbdc None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:52.382380 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed555c7-91a5-47af-8b6e-13280450fbdc None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:52.387540 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c85e1-c8f3-4087-a0d1-7fc092711a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:52.388562 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c85e1-c8f3-4087-a0d1-7fc092711a2b admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:52.388843 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c85e1-c8f3-4087-a0d1-7fc092711a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:52.389113 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c85e1-c8f3-4087-a0d1-7fc092711a2b admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:52.389856 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60c85e1-c8f3-4087-a0d1-7fc092711a2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:23:52.390201 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60c85e1-c8f3-4087-a0d1-7fc092711a2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:52.391861 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60c85e1-c8f3-4087-a0d1-7fc092711a2b admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:52.413368 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1343/2656] 10.222.0.42 () {58 vars in 1152 bytes} [Mon Jul 4 09:23:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:23:52.418491 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72c31d9-e8c8-4b9c-8612-74e9fcd5b882 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:52.429332 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72c31d9-e8c8-4b9c-8612-74e9fcd5b882 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:52.434134 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3380a0cc-2c3d-4186-8b47-99e47dde9326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:52.434719 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3380a0cc-2c3d-4186-8b47-99e47dde9326 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:52.435000 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3380a0cc-2c3d-4186-8b47-99e47dde9326 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:52.435270 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3380a0cc-2c3d-4186-8b47-99e47dde9326 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:52.435993 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3380a0cc-2c3d-4186-8b47-99e47dde9326 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:52.438130 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3380a0cc-2c3d-4186-8b47-99e47dde9326 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:52.496362 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c85e1-c8f3-4087-a0d1-7fc092711a2b admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:52.497456 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1314/2657] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:23:52 2022] POST /identity/v3/projects => generated 393 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:23:52.509586 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c85e1-c8f3-4087-a0d1-7fc092711a2b admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:52.581466 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0014a144-eb5f-419c-bb86-22660baa5222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:52.582037 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0014a144-eb5f-419c-bb86-22660baa5222 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:52.582272 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0014a144-eb5f-419c-bb86-22660baa5222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:52.583557 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0014a144-eb5f-419c-bb86-22660baa5222 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:52.583557 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0014a144-eb5f-419c-bb86-22660baa5222 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:52.585623 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0014a144-eb5f-419c-bb86-22660baa5222 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:52.621782 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3380a0cc-2c3d-4186-8b47-99e47dde9326 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:52.628610 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1344/2658] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:23:52 2022] POST /identity/v3/users => generated 297 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:23:52.634220 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3380a0cc-2c3d-4186-8b47-99e47dde9326 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:52.639299 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e896e6ad-6bd6-4ee5-b7d7-744076911d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:52.640117 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896e6ad-6bd6-4ee5-b7d7-744076911d29 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:52.640401 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896e6ad-6bd6-4ee5-b7d7-744076911d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:52.640690 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896e6ad-6bd6-4ee5-b7d7-744076911d29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:52.641452 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e896e6ad-6bd6-4ee5-b7d7-744076911d29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:52.643203 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e896e6ad-6bd6-4ee5-b7d7-744076911d29 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:52.664301 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1315/2659] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:23:52 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:23:52.665356 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0014a144-eb5f-419c-bb86-22660baa5222 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:52.680398 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0014a144-eb5f-419c-bb86-22660baa5222 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:52.688359 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253da011-15e3-4983-acc2-1f0b0d9a6872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:52.689370 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253da011-15e3-4983-acc2-1f0b0d9a6872 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:52.690836 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253da011-15e3-4983-acc2-1f0b0d9a6872 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:52.690992 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253da011-15e3-4983-acc2-1f0b0d9a6872 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:52.692105 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253da011-15e3-4983-acc2-1f0b0d9a6872 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:52.698791 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253da011-15e3-4983-acc2-1f0b0d9a6872 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:52.715968 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e896e6ad-6bd6-4ee5-b7d7-744076911d29 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:52.724915 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1345/2660] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:23:52 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:23:52.731684 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e896e6ad-6bd6-4ee5-b7d7-744076911d29 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:52.741608 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f714e111-36ac-4a78-b11b-90463cb27f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:52.743273 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f714e111-36ac-4a78-b11b-90463cb27f37 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:52.743650 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f714e111-36ac-4a78-b11b-90463cb27f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:52.744163 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f714e111-36ac-4a78-b11b-90463cb27f37 admin admin] PATH_INFO: `/v3/projects/95e834fb931244d28dddc0fa4ec333f7/users/183772299d6c42fb90b748bbb6579361/roles/81634e7812344f84afcb29b0dba2687c` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:52.774030 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f714e111-36ac-4a78-b11b-90463cb27f37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95e834fb931244d28dddc0fa4ec333f7, user_id=183772299d6c42fb90b748bbb6579361, role_id=81634e7812344f84afcb29b0dba2687c)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:52.778187 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f714e111-36ac-4a78-b11b-90463cb27f37 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:52.803144 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1316/2661] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:23:52 2022] PUT /identity/v3/projects/95e834fb931244d28dddc0fa4ec333f7/users/183772299d6c42fb90b748bbb6579361/roles/81634e7812344f84afcb29b0dba2687c => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:23:52.814529 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974bca6-2422-4047-ae88-acd0491b5f4f None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:52.815197 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974bca6-2422-4047-ae88-acd0491b5f4f None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:52.816293 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974bca6-2422-4047-ae88-acd0491b5f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:52.867435 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-2974bca6-2422-4047-ae88-acd0491b5f4f None None] MFA Rules not processed for user `183772299d6c42fb90b748bbb6579361`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:23:52.868874 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-2974bca6-2422-4047-ae88-acd0491b5f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:52.876237 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:53.005471 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1346/2662] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:23:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:23:53.010607 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f714e111-36ac-4a78-b11b-90463cb27f37 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:53.064256 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:53.112509 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f714e111-36ac-4a78-b11b-90463cb27f37 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:53.119930 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f26cbf-6ece-493f-b361-36d9043ba7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:53.120863 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f26cbf-6ece-493f-b361-36d9043ba7e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:53.121303 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f26cbf-6ece-493f-b361-36d9043ba7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:53.121721 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f26cbf-6ece-493f-b361-36d9043ba7e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:53.123449 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f26cbf-6ece-493f-b361-36d9043ba7e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:53.125283 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f26cbf-6ece-493f-b361-36d9043ba7e0 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:53.178190 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2974bca6-2422-4047-ae88-acd0491b5f4f None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:53.180114 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1317/2663] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:23:53 2022] POST /identity/v3/projects => generated 393 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:23:53.198408 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2974bca6-2422-4047-ae88-acd0491b5f4f None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:53.280786 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd86389d-eeb6-4014-b37b-040ad440505b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:53.282097 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86389d-eeb6-4014-b37b-040ad440505b admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:53.282394 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86389d-eeb6-4014-b37b-040ad440505b admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:53.282675 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86389d-eeb6-4014-b37b-040ad440505b admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:53.283897 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd86389d-eeb6-4014-b37b-040ad440505b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:53.286584 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd86389d-eeb6-4014-b37b-040ad440505b admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:53.319186 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1347/2664] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:23:53 2022] POST /identity/v3/users => generated 303 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:23:53.323685 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f26cbf-6ece-493f-b361-36d9043ba7e0 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:53.345246 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f26cbf-6ece-493f-b361-36d9043ba7e0 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:53.352167 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba36a17-bb6f-440b-9dd5-45d66d1755c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:53.352851 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba36a17-bb6f-440b-9dd5-45d66d1755c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:53.353271 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba36a17-bb6f-440b-9dd5-45d66d1755c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:53.353546 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba36a17-bb6f-440b-9dd5-45d66d1755c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:53.354299 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba36a17-bb6f-440b-9dd5-45d66d1755c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:53.356297 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba36a17-bb6f-440b-9dd5-45d66d1755c6 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:53.371084 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1318/2665] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:23:53 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:23:53.379440 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd86389d-eeb6-4014-b37b-040ad440505b admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:53.392913 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd86389d-eeb6-4014-b37b-040ad440505b admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:53.399616 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d98b1fb-c75d-40ad-ab09-c2008d96ac7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:53.400635 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d98b1fb-c75d-40ad-ab09-c2008d96ac7d admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:53.401008 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d98b1fb-c75d-40ad-ab09-c2008d96ac7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:53.402115 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d98b1fb-c75d-40ad-ab09-c2008d96ac7d admin admin] PATH_INFO: `/v3/projects/2fc8e80475d04d25aa50aec369122555/users/f3fa23c6e7ed4840ac0f9b78c1db347c/roles/965049e7ce6144aaad23c15f3a5e37c3` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:53.423102 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d98b1fb-c75d-40ad-ab09-c2008d96ac7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fc8e80475d04d25aa50aec369122555, user_id=f3fa23c6e7ed4840ac0f9b78c1db347c, role_id=965049e7ce6144aaad23c15f3a5e37c3)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:53.436439 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d98b1fb-c75d-40ad-ab09-c2008d96ac7d admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:53.462911 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1348/2666] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:23:53 2022] PUT /identity/v3/projects/2fc8e80475d04d25aa50aec369122555/users/f3fa23c6e7ed4840ac0f9b78c1db347c/roles/965049e7ce6144aaad23c15f3a5e37c3 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:23:53.466780 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba36a17-bb6f-440b-9dd5-45d66d1755c6 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:53.478323 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba36a17-bb6f-440b-9dd5-45d66d1755c6 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:53.577083 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902f4479-a5f4-464e-84ac-818a0d4548f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:53.577083 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902f4479-a5f4-464e-84ac-818a0d4548f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:53.577420 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902f4479-a5f4-464e-84ac-818a0d4548f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:53.577710 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902f4479-a5f4-464e-84ac-818a0d4548f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:53.578520 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902f4479-a5f4-464e-84ac-818a0d4548f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:53.581807 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902f4479-a5f4-464e-84ac-818a0d4548f9 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:53.600145 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1319/2667] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:23:53 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:23:53.602569 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d98b1fb-c75d-40ad-ab09-c2008d96ac7d admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:53.615631 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d98b1fb-c75d-40ad-ab09-c2008d96ac7d admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:53.621391 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed552135-0fbf-4a79-a372-426a8e5336fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:53.622223 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed552135-0fbf-4a79-a372-426a8e5336fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:53.622511 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed552135-0fbf-4a79-a372-426a8e5336fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:53.622847 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed552135-0fbf-4a79-a372-426a8e5336fb admin admin] PATH_INFO: `/v3/projects/2fc8e80475d04d25aa50aec369122555/users/f3fa23c6e7ed4840ac0f9b78c1db347c/roles/965049e7ce6144aaad23c15f3a5e37c3` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:53.630610 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed552135-0fbf-4a79-a372-426a8e5336fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fc8e80475d04d25aa50aec369122555, user_id=f3fa23c6e7ed4840ac0f9b78c1db347c, role_id=965049e7ce6144aaad23c15f3a5e37c3)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:53.633446 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed552135-0fbf-4a79-a372-426a8e5336fb admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:53.655975 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1349/2668] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:23:53 2022] PUT /identity/v3/projects/2fc8e80475d04d25aa50aec369122555/users/f3fa23c6e7ed4840ac0f9b78c1db347c/roles/965049e7ce6144aaad23c15f3a5e37c3 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:23:53.658441 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a74f9f-fa25-4afb-816f-40c2151962dc None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:53.658725 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a74f9f-fa25-4afb-816f-40c2151962dc None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:53.658995 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a74f9f-fa25-4afb-816f-40c2151962dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:53.695307 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-15a74f9f-fa25-4afb-816f-40c2151962dc None None] MFA Rules not processed for user `f3fa23c6e7ed4840ac0f9b78c1db347c`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:23:53.696616 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-15a74f9f-fa25-4afb-816f-40c2151962dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:53.792159 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1320/2669] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:23:53 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:23:53.805927 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed552135-0fbf-4a79-a372-426a8e5336fb admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:53.807932 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-ed552135-0fbf-4a79-a372-426a8e5336fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:53.875706 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed552135-0fbf-4a79-a372-426a8e5336fb admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:53.884915 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b470249-3f09-4303-b628-0654d85acc86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f86373d65440da97c853fff3c1d0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:53.886132 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b470249-3f09-4303-b628-0654d85acc86 service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:53.886628 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b470249-3f09-4303-b628-0654d85acc86 service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:53.887553 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b470249-3f09-4303-b628-0654d85acc86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:53.902780 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b470249-3f09-4303-b628-0654d85acc86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:53.904339 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b470249-3f09-4303-b628-0654d85acc86 service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:53.915126 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1350/2670] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:23:53 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:23:53.975791 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a74f9f-fa25-4afb-816f-40c2151962dc None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:53.977346 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-15a74f9f-fa25-4afb-816f-40c2151962dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:53.992465 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a74f9f-fa25-4afb-816f-40c2151962dc None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:53.998009 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2459168-7e39-4e1d-bf5d-1b56b48cc56b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f86373d65440da97c853fff3c1d0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:53.999570 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2459168-7e39-4e1d-bf5d-1b56b48cc56b service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:54.000058 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2459168-7e39-4e1d-bf5d-1b56b48cc56b service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:54.001068 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2459168-7e39-4e1d-bf5d-1b56b48cc56b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:54.032473 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:54.103494 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2459168-7e39-4e1d-bf5d-1b56b48cc56b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:54.105744 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2459168-7e39-4e1d-bf5d-1b56b48cc56b service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:54.120160 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1321/2671] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:23:53 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:23:54.334112 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39067300-111d-4609-9b57-7ed8de7d16a7 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:54.334410 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39067300-111d-4609-9b57-7ed8de7d16a7 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:54.334694 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39067300-111d-4609-9b57-7ed8de7d16a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:54.342472 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:54.403053 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-39067300-111d-4609-9b57-7ed8de7d16a7 None None] MFA Rules not processed for user `54de34583d5544d28f52c5fdb08e1e38`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:23:54.404329 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-39067300-111d-4609-9b57-7ed8de7d16a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:54.504867 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1351/2672] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:23:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:23:54.509770 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2459168-7e39-4e1d-bf5d-1b56b48cc56b service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:54.511626 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d2459168-7e39-4e1d-bf5d-1b56b48cc56b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:54.611536 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2459168-7e39-4e1d-bf5d-1b56b48cc56b service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:54.622762 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae6eec8-cfd0-40f1-b536-4e7cec885a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:54.624079 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6eec8-cfd0-40f1-b536-4e7cec885a86 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:54.624506 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6eec8-cfd0-40f1-b536-4e7cec885a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:54.624773 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6eec8-cfd0-40f1-b536-4e7cec885a86 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:54.625540 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae6eec8-cfd0-40f1-b536-4e7cec885a86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:54.629167 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae6eec8-cfd0-40f1-b536-4e7cec885a86 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:54.658143 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1322/2673] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:23:54 2022] POST /identity/v3/projects => generated 383 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:23:54.662303 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39067300-111d-4609-9b57-7ed8de7d16a7 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:54.673539 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39067300-111d-4609-9b57-7ed8de7d16a7 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:54.737928 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339afcf8-28c7-4058-9db1-4987b440e62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:54.738809 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339afcf8-28c7-4058-9db1-4987b440e62f admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:54.739165 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339afcf8-28c7-4058-9db1-4987b440e62f admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:54.739448 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339afcf8-28c7-4058-9db1-4987b440e62f admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:54.740214 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339afcf8-28c7-4058-9db1-4987b440e62f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:54.742195 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339afcf8-28c7-4058-9db1-4987b440e62f admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:54.767983 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1352/2674] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:23:54 2022] POST /identity/v3/users => generated 298 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:23:54.771858 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae6eec8-cfd0-40f1-b536-4e7cec885a86 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:54.782775 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae6eec8-cfd0-40f1-b536-4e7cec885a86 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:54.787639 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8126393-421e-407c-b251-19f4b4278c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:54.788493 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8126393-421e-407c-b251-19f4b4278c18 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:54.788788 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8126393-421e-407c-b251-19f4b4278c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:54.789059 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8126393-421e-407c-b251-19f4b4278c18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:54.789811 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8126393-421e-407c-b251-19f4b4278c18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:54.791479 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8126393-421e-407c-b251-19f4b4278c18 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:54.803499 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1323/2675] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:23:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:23:54.807671 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339afcf8-28c7-4058-9db1-4987b440e62f admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:54.820096 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339afcf8-28c7-4058-9db1-4987b440e62f admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:54.825209 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355385cf-030a-40c2-8b75-7b3d8ac59ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:54.826132 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355385cf-030a-40c2-8b75-7b3d8ac59ed1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:54.826418 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355385cf-030a-40c2-8b75-7b3d8ac59ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:54.826746 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355385cf-030a-40c2-8b75-7b3d8ac59ed1 admin admin] PATH_INFO: `/v3/projects/8b65cbe443ec4d95a1d1012007413d1d/users/97ecb1dfc3344d85bf90d598e8c12f2f/roles/965049e7ce6144aaad23c15f3a5e37c3` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:54.846183 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355385cf-030a-40c2-8b75-7b3d8ac59ed1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b65cbe443ec4d95a1d1012007413d1d, user_id=97ecb1dfc3344d85bf90d598e8c12f2f, role_id=965049e7ce6144aaad23c15f3a5e37c3)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:54.848959 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355385cf-030a-40c2-8b75-7b3d8ac59ed1 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:54.871911 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1353/2676] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:23:54 2022] PUT /identity/v3/projects/8b65cbe443ec4d95a1d1012007413d1d/users/97ecb1dfc3344d85bf90d598e8c12f2f/roles/965049e7ce6144aaad23c15f3a5e37c3 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:23:54.873127 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8126393-421e-407c-b251-19f4b4278c18 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:54.891142 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8126393-421e-407c-b251-19f4b4278c18 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:54.972578 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6bcb21-073c-4026-aa2d-bbf5eba99b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:54.973366 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6bcb21-073c-4026-aa2d-bbf5eba99b59 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:54.973738 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6bcb21-073c-4026-aa2d-bbf5eba99b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:54.974019 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6bcb21-073c-4026-aa2d-bbf5eba99b59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:54.974744 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6bcb21-073c-4026-aa2d-bbf5eba99b59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:54.976820 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6bcb21-073c-4026-aa2d-bbf5eba99b59 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:54.988456 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1324/2677] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:23:54 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:23:54.992457 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355385cf-030a-40c2-8b75-7b3d8ac59ed1 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:55.007001 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355385cf-030a-40c2-8b75-7b3d8ac59ed1 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:55.014648 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dadf04-dbaa-4625-99b1-fc8f6d5a2715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:55.015919 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dadf04-dbaa-4625-99b1-fc8f6d5a2715 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:55.016213 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dadf04-dbaa-4625-99b1-fc8f6d5a2715 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:55.016661 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dadf04-dbaa-4625-99b1-fc8f6d5a2715 admin admin] PATH_INFO: `/v3/projects/8b65cbe443ec4d95a1d1012007413d1d/users/97ecb1dfc3344d85bf90d598e8c12f2f/roles/965049e7ce6144aaad23c15f3a5e37c3` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:55.018980 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dadf04-dbaa-4625-99b1-fc8f6d5a2715 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b65cbe443ec4d95a1d1012007413d1d, user_id=97ecb1dfc3344d85bf90d598e8c12f2f, role_id=965049e7ce6144aaad23c15f3a5e37c3)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:55.022887 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dadf04-dbaa-4625-99b1-fc8f6d5a2715 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:55.039972 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1354/2678] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:23:54 2022] PUT /identity/v3/projects/8b65cbe443ec4d95a1d1012007413d1d/users/97ecb1dfc3344d85bf90d598e8c12f2f/roles/965049e7ce6144aaad23c15f3a5e37c3 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:23:57.833040 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6bcb21-073c-4026-aa2d-bbf5eba99b59 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:57.852515 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6bcb21-073c-4026-aa2d-bbf5eba99b59 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:57.937397 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:58.007377 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638997ff-673a-464a-84d7-b8867c1da200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:58.008299 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638997ff-673a-464a-84d7-b8867c1da200 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:58.008587 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638997ff-673a-464a-84d7-b8867c1da200 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:58.008864 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638997ff-673a-464a-84d7-b8867c1da200 admin admin] PATH_INFO: `/v3/users/183772299d6c42fb90b748bbb6579361` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:58.010405 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638997ff-673a-464a-84d7-b8867c1da200 admin admin] RBAC: Authorizing `identity:delete_user(user_id=183772299d6c42fb90b748bbb6579361)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:58.012415 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638997ff-673a-464a-84d7-b8867c1da200 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:58.079441 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-638997ff-673a-464a-84d7-b8867c1da200 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '183772299d6c42fb90b748bbb6579361'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:58.080467 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-638997ff-673a-464a-84d7-b8867c1da200 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '183772299d6c42fb90b748bbb6579361'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:58.089708 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-638997ff-673a-464a-84d7-b8867c1da200 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '183772299d6c42fb90b748bbb6579361'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:58.090470 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-638997ff-673a-464a-84d7-b8867c1da200 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '183772299d6c42fb90b748bbb6579361'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:58.103714 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-638997ff-673a-464a-84d7-b8867c1da200 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '183772299d6c42fb90b748bbb6579361'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:58.118142 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1325/2679] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:23:57 2022] DELETE /identity/v3/users/183772299d6c42fb90b748bbb6579361 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:23:58.123131 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4805c5-4475-4501-91b7-efb6b260805c None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:58.123997 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4805c5-4475-4501-91b7-efb6b260805c None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:58.124493 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4805c5-4475-4501-91b7-efb6b260805c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:58.149593 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-dc4805c5-4475-4501-91b7-efb6b260805c None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:23:58.151152 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-dc4805c5-4475-4501-91b7-efb6b260805c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:58.215428 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:58.269041 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1355/2680] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:23:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:23:58.280284 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638997ff-673a-464a-84d7-b8867c1da200 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:58.282218 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-638997ff-673a-464a-84d7-b8867c1da200 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:58.383709 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638997ff-673a-464a-84d7-b8867c1da200 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:58.387757 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac894c-d0d5-49d8-8737-f2ec70dc1a04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:58.388497 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac894c-d0d5-49d8-8737-f2ec70dc1a04 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:58.388787 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac894c-d0d5-49d8-8737-f2ec70dc1a04 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:58.389063 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac894c-d0d5-49d8-8737-f2ec70dc1a04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:58.402573 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ac894c-d0d5-49d8-8737-f2ec70dc1a04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:58.404203 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ac894c-d0d5-49d8-8737-f2ec70dc1a04 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:58.417998 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1326/2681] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:23:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:23:59.122773 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4805c5-4475-4501-91b7-efb6b260805c None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:59.124561 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-dc4805c5-4475-4501-91b7-efb6b260805c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:59.168248 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4805c5-4475-4501-91b7-efb6b260805c None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:59.194772 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155721cd-bc5a-449a-b193-c1184d5d2539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:59.196839 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155721cd-bc5a-449a-b193-c1184d5d2539 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:59.198755 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155721cd-bc5a-449a-b193-c1184d5d2539 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:59.199187 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155721cd-bc5a-449a-b193-c1184d5d2539 admin admin] PATH_INFO: `/v3/projects/95e834fb931244d28dddc0fa4ec333f7` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:59.200720 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155721cd-bc5a-449a-b193-c1184d5d2539 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95e834fb931244d28dddc0fa4ec333f7)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:59.202985 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155721cd-bc5a-449a-b193-c1184d5d2539 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:59.323627 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-155721cd-bc5a-449a-b193-c1184d5d2539 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95e834fb931244d28dddc0fa4ec333f7', 'request_id': 'req-155721cd-bc5a-449a-b193-c1184d5d2539'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:59.337095 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-155721cd-bc5a-449a-b193-c1184d5d2539 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95e834fb931244d28dddc0fa4ec333f7', 'request_id': 'req-155721cd-bc5a-449a-b193-c1184d5d2539'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:59.344338 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-155721cd-bc5a-449a-b193-c1184d5d2539 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95e834fb931244d28dddc0fa4ec333f7', 'request_id': 'req-155721cd-bc5a-449a-b193-c1184d5d2539'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:59.357923 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-155721cd-bc5a-449a-b193-c1184d5d2539 admin admin] The token cache is being invalidate because project 95e834fb931244d28dddc0fa4ec333f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:23:59.358203 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-155721cd-bc5a-449a-b193-c1184d5d2539 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:59.359157 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-155721cd-bc5a-449a-b193-c1184d5d2539 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:59.364873 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac894c-d0d5-49d8-8737-f2ec70dc1a04 service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:59.365335 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1356/2682] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:23:59 2022] DELETE /identity/v3/projects/95e834fb931244d28dddc0fa4ec333f7 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:23:59.378213 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac894c-d0d5-49d8-8737-f2ec70dc1a04 service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:59.446295 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:59.454493 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e2e997-e8db-4781-968d-330716b532fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:59.455529 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e2e997-e8db-4781-968d-330716b532fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:59.455920 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e2e997-e8db-4781-968d-330716b532fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:59.456114 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e2e997-e8db-4781-968d-330716b532fe admin admin] PATH_INFO: `/v3/users/f3fa23c6e7ed4840ac0f9b78c1db347c` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:59.466959 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e2e997-e8db-4781-968d-330716b532fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3fa23c6e7ed4840ac0f9b78c1db347c)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:59.470575 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e2e997-e8db-4781-968d-330716b532fe admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:59.537708 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-04e2e997-e8db-4781-968d-330716b532fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3fa23c6e7ed4840ac0f9b78c1db347c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:59.538431 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-04e2e997-e8db-4781-968d-330716b532fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3fa23c6e7ed4840ac0f9b78c1db347c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:59.551096 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-04e2e997-e8db-4781-968d-330716b532fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3fa23c6e7ed4840ac0f9b78c1db347c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:59.552772 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-04e2e997-e8db-4781-968d-330716b532fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3fa23c6e7ed4840ac0f9b78c1db347c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:59.575179 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-04e2e997-e8db-4781-968d-330716b532fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3fa23c6e7ed4840ac0f9b78c1db347c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:23:59.614298 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1327/2683] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:23:59 2022] DELETE /identity/v3/users/f3fa23c6e7ed4840ac0f9b78c1db347c => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:23:59.936202 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155721cd-bc5a-449a-b193-c1184d5d2539 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:59.937672 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-155721cd-bc5a-449a-b193-c1184d5d2539 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:59.957551 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155721cd-bc5a-449a-b193-c1184d5d2539 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:00.082203 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd08c869-5576-431b-b59d-c1f8fdfbb601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:00.083120 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08c869-5576-431b-b59d-c1f8fdfbb601 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:00.083404 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08c869-5576-431b-b59d-c1f8fdfbb601 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:00.083681 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08c869-5576-431b-b59d-c1f8fdfbb601 admin admin] PATH_INFO: `/v3/projects/2fc8e80475d04d25aa50aec369122555` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:00.084934 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd08c869-5576-431b-b59d-c1f8fdfbb601 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fc8e80475d04d25aa50aec369122555)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:00.086920 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd08c869-5576-431b-b59d-c1f8fdfbb601 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:00.147740 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c665bf-2e3d-4e27-83c9-0d69de3bd231 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:00.148229 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c665bf-2e3d-4e27-83c9-0d69de3bd231 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:00.148515 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c665bf-2e3d-4e27-83c9-0d69de3bd231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:00.156874 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-bd08c869-5576-431b-b59d-c1f8fdfbb601 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fc8e80475d04d25aa50aec369122555', 'request_id': 'req-bd08c869-5576-431b-b59d-c1f8fdfbb601'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:00.166518 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-bd08c869-5576-431b-b59d-c1f8fdfbb601 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fc8e80475d04d25aa50aec369122555', 'request_id': 'req-bd08c869-5576-431b-b59d-c1f8fdfbb601'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:00.172928 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-bd08c869-5576-431b-b59d-c1f8fdfbb601 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fc8e80475d04d25aa50aec369122555', 'request_id': 'req-bd08c869-5576-431b-b59d-c1f8fdfbb601'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:00.181519 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-34c665bf-2e3d-4e27-83c9-0d69de3bd231 None None] MFA Rules not processed for user `97ecb1dfc3344d85bf90d598e8c12f2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:24:00.182606 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:24:00.182839 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-34c665bf-2e3d-4e27-83c9-0d69de3bd231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:00.191082 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-bd08c869-5576-431b-b59d-c1f8fdfbb601 admin admin] The token cache is being invalidate because project 2fc8e80475d04d25aa50aec369122555 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:24:00.191590 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-bd08c869-5576-431b-b59d-c1f8fdfbb601 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:00.192788 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-bd08c869-5576-431b-b59d-c1f8fdfbb601 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:00.195243 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1357/2684] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:23:59 2022] DELETE /identity/v3/projects/2fc8e80475d04d25aa50aec369122555 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:24:00.199917 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497466f-19a4-4da8-b98b-15cdce3641a1 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:00.200314 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497466f-19a4-4da8-b98b-15cdce3641a1 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:00.200602 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497466f-19a4-4da8-b98b-15cdce3641a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:00.222363 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-e497466f-19a4-4da8-b98b-15cdce3641a1 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:24:00.223927 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-e497466f-19a4-4da8-b98b-15cdce3641a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:00.285408 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1328/2685] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:24:00 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:24:00.318438 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1358/2686] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:24:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:24:00.326113 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f949d35-8174-4d1e-bcca-a9811951c0b6 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:00.326413 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f949d35-8174-4d1e-bcca-a9811951c0b6 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:00.326694 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f949d35-8174-4d1e-bcca-a9811951c0b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:00.330035 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e497466f-19a4-4da8-b98b-15cdce3641a1 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:00.332177 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-e497466f-19a4-4da8-b98b-15cdce3641a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:00.351434 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-2f949d35-8174-4d1e-bcca-a9811951c0b6 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:24:00.356608 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-2f949d35-8174-4d1e-bcca-a9811951c0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:00.366638 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1329/2687] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:24:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:24:00.371196 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f949d35-8174-4d1e-bcca-a9811951c0b6 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:00.397324 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f949d35-8174-4d1e-bcca-a9811951c0b6 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:00.405469 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6cc1ed-0d61-453f-bc5b-799bd5a5ef6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:00.406948 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6cc1ed-0d61-453f-bc5b-799bd5a5ef6e admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:00.407236 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6cc1ed-0d61-453f-bc5b-799bd5a5ef6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:00.407513 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6cc1ed-0d61-453f-bc5b-799bd5a5ef6e admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:00.408305 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6cc1ed-0d61-453f-bc5b-799bd5a5ef6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:24:00.408623 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6cc1ed-0d61-453f-bc5b-799bd5a5ef6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:00.411435 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6cc1ed-0d61-453f-bc5b-799bd5a5ef6e admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:00.420173 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e497466f-19a4-4da8-b98b-15cdce3641a1 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:00.423991 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a3e4f4-9052-4b95-80cf-6fc7cf843e98 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92e3804048824cde829e6273ce7c19b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:00.424657 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a3e4f4-9052-4b95-80cf-6fc7cf843e98 service glance] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:00.424937 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a3e4f4-9052-4b95-80cf-6fc7cf843e98 service glance] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:00.425210 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a3e4f4-9052-4b95-80cf-6fc7cf843e98 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:00.427913 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1330/2688] 10.222.0.42 () {58 vars in 1152 bytes} [Mon Jul 4 09:24:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:24:00.431371 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-f9a3e4f4-9052-4b95-80cf-6fc7cf843e98 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:00.434698 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6cc1ed-0d61-453f-bc5b-799bd5a5ef6e admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:00.455931 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6cc1ed-0d61-453f-bc5b-799bd5a5ef6e admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:00.461475 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99570776-364a-408e-bc09-d3c6425681b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:00.462133 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99570776-364a-408e-bc09-d3c6425681b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:00.463028 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99570776-364a-408e-bc09-d3c6425681b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:00.463311 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99570776-364a-408e-bc09-d3c6425681b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:00.464043 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99570776-364a-408e-bc09-d3c6425681b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:00.466313 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99570776-364a-408e-bc09-d3c6425681b4 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:00.508343 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1331/2689] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:24:00 2022] POST /identity/v3/projects => generated 367 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:24:00.510030 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99570776-364a-408e-bc09-d3c6425681b4 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:00.518685 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a3e4f4-9052-4b95-80cf-6fc7cf843e98 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:00.520240 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a3e4f4-9052-4b95-80cf-6fc7cf843e98 service glance] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:00.530021 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1359/2690] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:24:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:24:00.535934 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:24:00.607903 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99570776-364a-408e-bc09-d3c6425681b4 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:00.613511 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f79f61-d00f-476f-ba9e-e294a52258f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:00.614247 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f79f61-d00f-476f-ba9e-e294a52258f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:00.614701 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f79f61-d00f-476f-ba9e-e294a52258f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:00.614795 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f79f61-d00f-476f-ba9e-e294a52258f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:00.615522 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f79f61-d00f-476f-ba9e-e294a52258f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:00.617609 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f79f61-d00f-476f-ba9e-e294a52258f0 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:00.645499 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1332/2691] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:24:00 2022] POST /identity/v3/users => generated 284 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:24:00.649960 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a3e4f4-9052-4b95-80cf-6fc7cf843e98 service glance] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:00.662275 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5e344-2572-4134-982b-40bab8dbb1c3 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:00.662574 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5e344-2572-4134-982b-40bab8dbb1c3 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:00.662896 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5e344-2572-4134-982b-40bab8dbb1c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:00.663840 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a3e4f4-9052-4b95-80cf-6fc7cf843e98 service glance] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:00.671260 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5663f31d-007a-4882-b3e7-2cda707d7137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:00.672151 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5663f31d-007a-4882-b3e7-2cda707d7137 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:00.672506 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5663f31d-007a-4882-b3e7-2cda707d7137 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:00.672869 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5663f31d-007a-4882-b3e7-2cda707d7137 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:00.673748 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5663f31d-007a-4882-b3e7-2cda707d7137 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:00.675650 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5663f31d-007a-4882-b3e7-2cda707d7137 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:00.684875 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-84f5e344-2572-4134-982b-40bab8dbb1c3 None None] MFA Rules not processed for user `bd758d5b21684027b0d199021df0ad2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:24:00.685877 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-84f5e344-2572-4134-982b-40bab8dbb1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:00.691349 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1360/2692] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:24:00 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:24:00.693538 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5663f31d-007a-4882-b3e7-2cda707d7137 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:00.713804 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5663f31d-007a-4882-b3e7-2cda707d7137 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:00.725893 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15ce8b5-9a2f-4561-8bb7-1f87e939d5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:00.727915 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ce8b5-9a2f-4561-8bb7-1f87e939d5d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:00.727915 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ce8b5-9a2f-4561-8bb7-1f87e939d5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:00.727915 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ce8b5-9a2f-4561-8bb7-1f87e939d5d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:00.728355 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15ce8b5-9a2f-4561-8bb7-1f87e939d5d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:00.732623 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15ce8b5-9a2f-4561-8bb7-1f87e939d5d7 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:00.759847 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1361/2693] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:24:00 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:24:00.764203 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15ce8b5-9a2f-4561-8bb7-1f87e939d5d7 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:00.780486 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1333/2694] 10.222.0.42 () {58 vars in 1009 bytes} [Mon Jul 4 09:24:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:24:00.785737 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15ce8b5-9a2f-4561-8bb7-1f87e939d5d7 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:00.791434 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214c496f-c2a5-4096-af75-364c6931daf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:00.792461 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214c496f-c2a5-4096-af75-364c6931daf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:00.793390 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214c496f-c2a5-4096-af75-364c6931daf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:00.793390 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214c496f-c2a5-4096-af75-364c6931daf5 admin admin] PATH_INFO: `/v3/projects/9e6c77bf7cf341d6a20e9c1ef635780f/users/75dd7e46ecab4e91be5982377c67b4d9/roles/81634e7812344f84afcb29b0dba2687c` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:00.793595 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f5e344-2572-4134-982b-40bab8dbb1c3 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:00.795490 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-84f5e344-2572-4134-982b-40bab8dbb1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:00.814210 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214c496f-c2a5-4096-af75-364c6931daf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e6c77bf7cf341d6a20e9c1ef635780f, user_id=75dd7e46ecab4e91be5982377c67b4d9, role_id=81634e7812344f84afcb29b0dba2687c)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:00.817098 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214c496f-c2a5-4096-af75-364c6931daf5 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:00.836481 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1362/2695] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:24:00 2022] PUT /identity/v3/projects/9e6c77bf7cf341d6a20e9c1ef635780f/users/75dd7e46ecab4e91be5982377c67b4d9/roles/81634e7812344f84afcb29b0dba2687c => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:24:00.847375 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de70235-7085-4961-88ee-143d01ebc729 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:00.847709 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de70235-7085-4961-88ee-143d01ebc729 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:00.848018 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de70235-7085-4961-88ee-143d01ebc729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:00.860401 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:24:00.876619 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-0de70235-7085-4961-88ee-143d01ebc729 None None] MFA Rules not processed for user `75dd7e46ecab4e91be5982377c67b4d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:24:00.877781 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-0de70235-7085-4961-88ee-143d01ebc729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:00.884717 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f5e344-2572-4134-982b-40bab8dbb1c3 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:00.939582 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:24:00.950579 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026715ad-ec61-4934-ba65-f1794c010013 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59d8698c45fb46259765eb3c8de2297f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:00.951218 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1363/2696] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:24:00 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:24:00.951378 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026715ad-ec61-4934-ba65-f1794c010013 service swift] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:00.951680 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026715ad-ec61-4934-ba65-f1794c010013 service swift] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:00.951998 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026715ad-ec61-4934-ba65-f1794c010013 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:00.955647 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de70235-7085-4961-88ee-143d01ebc729 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:01.012504 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026715ad-ec61-4934-ba65-f1794c010013 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:01.014240 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026715ad-ec61-4934-ba65-f1794c010013 service swift] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:01.019613 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de70235-7085-4961-88ee-143d01ebc729 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:01.023445 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1334/2697] 10.222.0.42 () {60 vars in 1384 bytes} [Mon Jul 4 09:24:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 04 09:24:01.024546 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043b32d6-b4d0-41d9-8aa0-ce1ad3d4a3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:01.025421 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043b32d6-b4d0-41d9-8aa0-ce1ad3d4a3d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:01.025707 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043b32d6-b4d0-41d9-8aa0-ce1ad3d4a3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:01.025977 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043b32d6-b4d0-41d9-8aa0-ce1ad3d4a3d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:01.026742 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043b32d6-b4d0-41d9-8aa0-ce1ad3d4a3d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:01.028621 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043b32d6-b4d0-41d9-8aa0-ce1ad3d4a3d8 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:01.059007 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1364/2698] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:24:00 2022] POST /identity/v3/projects => generated 363 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:24:01.066036 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026715ad-ec61-4934-ba65-f1794c010013 service swift] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:01.087254 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026715ad-ec61-4934-ba65-f1794c010013 service swift] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:01.208154 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f629b-c063-4577-9451-4fa45cb850ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:01.209110 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f629b-c063-4577-9451-4fa45cb850ab admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:01.209549 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f629b-c063-4577-9451-4fa45cb850ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:01.209974 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f629b-c063-4577-9451-4fa45cb850ab admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:01.210856 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00f629b-c063-4577-9451-4fa45cb850ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:01.215082 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00f629b-c063-4577-9451-4fa45cb850ab admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:01.243021 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1335/2699] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:24:01 2022] POST /identity/v3/users => generated 288 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:24:01.244398 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043b32d6-b4d0-41d9-8aa0-ce1ad3d4a3d8 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:01.259937 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043b32d6-b4d0-41d9-8aa0-ce1ad3d4a3d8 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:01.266949 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a429c9-58ae-4e42-a527-35a957ccc6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:01.267930 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a429c9-58ae-4e42-a527-35a957ccc6ab admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:01.268421 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a429c9-58ae-4e42-a527-35a957ccc6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:01.268881 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a429c9-58ae-4e42-a527-35a957ccc6ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:01.269802 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a429c9-58ae-4e42-a527-35a957ccc6ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:01.271603 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a429c9-58ae-4e42-a527-35a957ccc6ab admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:01.285820 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1365/2700] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:24:01 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:24:01.289950 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f629b-c063-4577-9451-4fa45cb850ab admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:01.303932 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f629b-c063-4577-9451-4fa45cb850ab admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:01.309319 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aedc13c-e2ed-4efc-aa0f-644affaa97fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:01.310701 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aedc13c-e2ed-4efc-aa0f-644affaa97fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:01.311187 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aedc13c-e2ed-4efc-aa0f-644affaa97fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:01.312007 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aedc13c-e2ed-4efc-aa0f-644affaa97fd admin admin] PATH_INFO: `/v3/projects/d55452da2e4143a4be62db0e14f2f9fd/users/c17f79e10e6042b0890db53baf269fb5/roles/965049e7ce6144aaad23c15f3a5e37c3` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:01.332799 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aedc13c-e2ed-4efc-aa0f-644affaa97fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d55452da2e4143a4be62db0e14f2f9fd, user_id=c17f79e10e6042b0890db53baf269fb5, role_id=965049e7ce6144aaad23c15f3a5e37c3)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:01.338386 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aedc13c-e2ed-4efc-aa0f-644affaa97fd admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:01.364650 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1336/2701] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:24:01 2022] PUT /identity/v3/projects/d55452da2e4143a4be62db0e14f2f9fd/users/c17f79e10e6042b0890db53baf269fb5/roles/965049e7ce6144aaad23c15f3a5e37c3 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:24:01.368715 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a429c9-58ae-4e42-a527-35a957ccc6ab admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:01.381973 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a429c9-58ae-4e42-a527-35a957ccc6ab admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:01.465139 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9186b5f7-ae03-47ae-92e9-5a8b55ffa383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:01.465820 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9186b5f7-ae03-47ae-92e9-5a8b55ffa383 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:01.466101 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9186b5f7-ae03-47ae-92e9-5a8b55ffa383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:01.466377 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9186b5f7-ae03-47ae-92e9-5a8b55ffa383 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:01.467115 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9186b5f7-ae03-47ae-92e9-5a8b55ffa383 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:01.468831 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9186b5f7-ae03-47ae-92e9-5a8b55ffa383 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:01.489797 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1366/2702] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:24:01 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:24:01.494323 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aedc13c-e2ed-4efc-aa0f-644affaa97fd admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:01.522241 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aedc13c-e2ed-4efc-aa0f-644affaa97fd admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:01.530549 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9da1dde-e1d6-4cf4-8079-01b94c47be9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:01.531477 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da1dde-e1d6-4cf4-8079-01b94c47be9d admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:01.532157 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da1dde-e1d6-4cf4-8079-01b94c47be9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:01.532157 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da1dde-e1d6-4cf4-8079-01b94c47be9d admin admin] PATH_INFO: `/v3/projects/d55452da2e4143a4be62db0e14f2f9fd/users/c17f79e10e6042b0890db53baf269fb5/roles/965049e7ce6144aaad23c15f3a5e37c3` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:01.534210 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9da1dde-e1d6-4cf4-8079-01b94c47be9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d55452da2e4143a4be62db0e14f2f9fd, user_id=c17f79e10e6042b0890db53baf269fb5, role_id=965049e7ce6144aaad23c15f3a5e37c3)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:01.537005 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9da1dde-e1d6-4cf4-8079-01b94c47be9d admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:01.572577 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1337/2703] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:24:01 2022] PUT /identity/v3/projects/d55452da2e4143a4be62db0e14f2f9fd/users/c17f79e10e6042b0890db53baf269fb5/roles/965049e7ce6144aaad23c15f3a5e37c3 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:24:01.628842 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6374548b-62c7-422e-b12a-fd8eb35b16b3 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:01.629136 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6374548b-62c7-422e-b12a-fd8eb35b16b3 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:01.629425 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6374548b-62c7-422e-b12a-fd8eb35b16b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:01.643795 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:24:01.661343 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-6374548b-62c7-422e-b12a-fd8eb35b16b3 None None] MFA Rules not processed for user `c17f79e10e6042b0890db53baf269fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:24:01.662628 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-6374548b-62c7-422e-b12a-fd8eb35b16b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:01.762246 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1367/2704] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:24:01 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:24:01.769313 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9da1dde-e1d6-4cf4-8079-01b94c47be9d admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:01.772475 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a9da1dde-e1d6-4cf4-8079-01b94c47be9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:01.928182 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9da1dde-e1d6-4cf4-8079-01b94c47be9d admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:01.937063 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302e3fa7-2c5c-4633-afe3-fee4068fe467 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f86373d65440da97c853fff3c1d0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:01.937597 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e3fa7-2c5c-4633-afe3-fee4068fe467 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:01.937861 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e3fa7-2c5c-4633-afe3-fee4068fe467 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:01.938128 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e3fa7-2c5c-4633-afe3-fee4068fe467 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:01.946901 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:24:01.950792 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302e3fa7-2c5c-4633-afe3-fee4068fe467 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:01.952627 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302e3fa7-2c5c-4633-afe3-fee4068fe467 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:01.966598 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1338/2705] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:24:01 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:24:02.073430 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6374548b-62c7-422e-b12a-fd8eb35b16b3 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:02.086958 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6374548b-62c7-422e-b12a-fd8eb35b16b3 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:02.098067 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f63d473-5ce3-4ed8-9eb5-20e6653eb5b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f86373d65440da97c853fff3c1d0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:02.098728 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63d473-5ce3-4ed8-9eb5-20e6653eb5b5 service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:02.099013 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63d473-5ce3-4ed8-9eb5-20e6653eb5b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:02.100657 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63d473-5ce3-4ed8-9eb5-20e6653eb5b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:02.182880 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f63d473-5ce3-4ed8-9eb5-20e6653eb5b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:02.185019 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f63d473-5ce3-4ed8-9eb5-20e6653eb5b5 service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:02.198542 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1368/2706] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:24:02 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:24:07.531251 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302e3fa7-2c5c-4633-afe3-fee4068fe467 service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:07.612358 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302e3fa7-2c5c-4633-afe3-fee4068fe467 service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:07.616934 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32672f7-ab7a-4dea-a9f9-b1c1840cf8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:07.617814 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32672f7-ab7a-4dea-a9f9-b1c1840cf8b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:07.618093 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32672f7-ab7a-4dea-a9f9-b1c1840cf8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:07.618363 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32672f7-ab7a-4dea-a9f9-b1c1840cf8b3 admin admin] PATH_INFO: `/v3/users/75dd7e46ecab4e91be5982377c67b4d9` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:07.619551 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32672f7-ab7a-4dea-a9f9-b1c1840cf8b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75dd7e46ecab4e91be5982377c67b4d9)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:07.623116 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32672f7-ab7a-4dea-a9f9-b1c1840cf8b3 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:07.687691 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-f32672f7-ab7a-4dea-a9f9-b1c1840cf8b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75dd7e46ecab4e91be5982377c67b4d9'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:07.688358 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-f32672f7-ab7a-4dea-a9f9-b1c1840cf8b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75dd7e46ecab4e91be5982377c67b4d9'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:07.699620 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-f32672f7-ab7a-4dea-a9f9-b1c1840cf8b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75dd7e46ecab4e91be5982377c67b4d9'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:07.700434 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-f32672f7-ab7a-4dea-a9f9-b1c1840cf8b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75dd7e46ecab4e91be5982377c67b4d9'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:07.715759 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-f32672f7-ab7a-4dea-a9f9-b1c1840cf8b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75dd7e46ecab4e91be5982377c67b4d9'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:07.732972 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1339/2707] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:24:07 2022] DELETE /identity/v3/users/75dd7e46ecab4e91be5982377c67b4d9 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:24:07.737749 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d46edfc-5a79-4f83-a825-8ee5e6f1c542 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:07.738583 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d46edfc-5a79-4f83-a825-8ee5e6f1c542 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:07.739032 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d46edfc-5a79-4f83-a825-8ee5e6f1c542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:07.758525 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-2d46edfc-5a79-4f83-a825-8ee5e6f1c542 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:24:07.759810 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-2d46edfc-5a79-4f83-a825-8ee5e6f1c542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:07.830419 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1369/2708] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:24:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:24:07.839774 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32672f7-ab7a-4dea-a9f9-b1c1840cf8b3 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:07.841302 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f32672f7-ab7a-4dea-a9f9-b1c1840cf8b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:07.923921 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32672f7-ab7a-4dea-a9f9-b1c1840cf8b3 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:07.927689 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81e9d9f-6ea5-49ac-8a83-db720f9e48a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:07.928515 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e9d9f-6ea5-49ac-8a83-db720f9e48a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:07.928803 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e9d9f-6ea5-49ac-8a83-db720f9e48a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:07.929080 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e9d9f-6ea5-49ac-8a83-db720f9e48a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:07.940143 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81e9d9f-6ea5-49ac-8a83-db720f9e48a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:07.941634 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81e9d9f-6ea5-49ac-8a83-db720f9e48a6 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:07.953160 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1340/2709] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:24:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 09:24:08.152408 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d46edfc-5a79-4f83-a825-8ee5e6f1c542 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:08.154451 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-2d46edfc-5a79-4f83-a825-8ee5e6f1c542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:08.167092 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d46edfc-5a79-4f83-a825-8ee5e6f1c542 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:08.175319 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4436311b-d818-460c-8394-57cf7b7902f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:08.176484 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4436311b-d818-460c-8394-57cf7b7902f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:08.176843 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4436311b-d818-460c-8394-57cf7b7902f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:08.177201 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4436311b-d818-460c-8394-57cf7b7902f3 admin admin] PATH_INFO: `/v3/users/690c83a9da7c4707b5e34e8ad9155a44` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:08.178573 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4436311b-d818-460c-8394-57cf7b7902f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=690c83a9da7c4707b5e34e8ad9155a44)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:08.180630 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4436311b-d818-460c-8394-57cf7b7902f3 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:08.220004 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:24:08.251146 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-4436311b-d818-460c-8394-57cf7b7902f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '690c83a9da7c4707b5e34e8ad9155a44'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:08.262270 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-4436311b-d818-460c-8394-57cf7b7902f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '690c83a9da7c4707b5e34e8ad9155a44'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:08.263095 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-4436311b-d818-460c-8394-57cf7b7902f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '690c83a9da7c4707b5e34e8ad9155a44'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:08.263883 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-4436311b-d818-460c-8394-57cf7b7902f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '690c83a9da7c4707b5e34e8ad9155a44'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:08.275485 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81e9d9f-6ea5-49ac-8a83-db720f9e48a6 service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:08.276986 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b81e9d9f-6ea5-49ac-8a83-db720f9e48a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:08.285387 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-4436311b-d818-460c-8394-57cf7b7902f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '690c83a9da7c4707b5e34e8ad9155a44'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:08.294758 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81e9d9f-6ea5-49ac-8a83-db720f9e48a6 service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:08.300293 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1370/2710] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:24:08 2022] DELETE /identity/v3/users/690c83a9da7c4707b5e34e8ad9155a44 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:24:08.313617 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8360d-ff2a-4a55-ac13-982d33f2ed09 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:08.314047 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8360d-ff2a-4a55-ac13-982d33f2ed09 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:08.315435 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8360d-ff2a-4a55-ac13-982d33f2ed09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:08.334956 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:24:08.351983 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-0bf8360d-ff2a-4a55-ac13-982d33f2ed09 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:24:08.353273 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-0bf8360d-ff2a-4a55-ac13-982d33f2ed09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:08.408841 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863db775-7325-40f5-a291-2ae30d69bf07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:08.409708 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863db775-7325-40f5-a291-2ae30d69bf07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:08.410142 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863db775-7325-40f5-a291-2ae30d69bf07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:08.410416 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863db775-7325-40f5-a291-2ae30d69bf07 admin admin] PATH_INFO: `/v3/projects/9e6c77bf7cf341d6a20e9c1ef635780f` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:08.411677 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863db775-7325-40f5-a291-2ae30d69bf07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e6c77bf7cf341d6a20e9c1ef635780f)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:08.413657 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863db775-7325-40f5-a291-2ae30d69bf07 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:08.449130 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1371/2711] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:24:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:24:08.460992 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf8360d-ff2a-4a55-ac13-982d33f2ed09 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:08.462435 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-0bf8360d-ff2a-4a55-ac13-982d33f2ed09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:08.480009 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-863db775-7325-40f5-a291-2ae30d69bf07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e6c77bf7cf341d6a20e9c1ef635780f', 'request_id': 'req-863db775-7325-40f5-a291-2ae30d69bf07'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:08.485380 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-863db775-7325-40f5-a291-2ae30d69bf07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e6c77bf7cf341d6a20e9c1ef635780f', 'request_id': 'req-863db775-7325-40f5-a291-2ae30d69bf07'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:08.495333 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-863db775-7325-40f5-a291-2ae30d69bf07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e6c77bf7cf341d6a20e9c1ef635780f', 'request_id': 'req-863db775-7325-40f5-a291-2ae30d69bf07'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:08.513800 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-863db775-7325-40f5-a291-2ae30d69bf07 admin admin] The token cache is being invalidate because project 9e6c77bf7cf341d6a20e9c1ef635780f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:24:08.514090 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-863db775-7325-40f5-a291-2ae30d69bf07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:08.514958 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-863db775-7325-40f5-a291-2ae30d69bf07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:08.518092 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1341/2712] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:24:08 2022] DELETE /identity/v3/projects/9e6c77bf7cf341d6a20e9c1ef635780f => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:24:08.525193 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863db775-7325-40f5-a291-2ae30d69bf07 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:08.527753 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-863db775-7325-40f5-a291-2ae30d69bf07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:08.573936 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf8360d-ff2a-4a55-ac13-982d33f2ed09 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:08.630016 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863db775-7325-40f5-a291-2ae30d69bf07 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:08.634769 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f23b15-ed37-4e16-9c97-fd257e7c9537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:08.635643 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f23b15-ed37-4e16-9c97-fd257e7c9537 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:08.635975 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f23b15-ed37-4e16-9c97-fd257e7c9537 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:08.636269 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f23b15-ed37-4e16-9c97-fd257e7c9537 admin admin] PATH_INFO: `/v3/users/c17f79e10e6042b0890db53baf269fb5` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:08.637492 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f23b15-ed37-4e16-9c97-fd257e7c9537 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c17f79e10e6042b0890db53baf269fb5)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:08.639693 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f23b15-ed37-4e16-9c97-fd257e7c9537 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:08.650037 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1883c872-5045-4ce1-9cb8-754b871b54f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:08.650810 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1883c872-5045-4ce1-9cb8-754b871b54f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:08.651077 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1883c872-5045-4ce1-9cb8-754b871b54f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:08.651583 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1883c872-5045-4ce1-9cb8-754b871b54f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:08.654629 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-1883c872-5045-4ce1-9cb8-754b871b54f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:08.668534 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1883c872-5045-4ce1-9cb8-754b871b54f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:08.670213 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1883c872-5045-4ce1-9cb8-754b871b54f9 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:08.685256 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1372/2713] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:24:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:24:08.729178 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-52f23b15-ed37-4e16-9c97-fd257e7c9537 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c17f79e10e6042b0890db53baf269fb5'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:08.731988 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-52f23b15-ed37-4e16-9c97-fd257e7c9537 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c17f79e10e6042b0890db53baf269fb5'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:08.735435 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:24:08.749338 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-52f23b15-ed37-4e16-9c97-fd257e7c9537 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c17f79e10e6042b0890db53baf269fb5'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:08.750304 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-52f23b15-ed37-4e16-9c97-fd257e7c9537 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c17f79e10e6042b0890db53baf269fb5'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:08.768655 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-52f23b15-ed37-4e16-9c97-fd257e7c9537 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c17f79e10e6042b0890db53baf269fb5'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:08.788646 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1342/2714] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:24:08 2022] DELETE /identity/v3/users/c17f79e10e6042b0890db53baf269fb5 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:24:09.077395 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1883c872-5045-4ce1-9cb8-754b871b54f9 service neutron] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:09.078975 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-1883c872-5045-4ce1-9cb8-754b871b54f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:09.096848 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:24:09.114766 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1883c872-5045-4ce1-9cb8-754b871b54f9 service neutron] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:09.192822 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f23b15-ed37-4e16-9c97-fd257e7c9537 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:09.194564 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-52f23b15-ed37-4e16-9c97-fd257e7c9537 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:09.213781 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231c0bcd-912e-41c7-a872-61fec71ec9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:09.214801 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c0bcd-912e-41c7-a872-61fec71ec9ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:09.215085 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c0bcd-912e-41c7-a872-61fec71ec9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:09.215363 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c0bcd-912e-41c7-a872-61fec71ec9ff admin admin] PATH_INFO: `/v3/projects/877c3a1fc9d542f4979463c6937f0fa7` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:09.216696 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231c0bcd-912e-41c7-a872-61fec71ec9ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=877c3a1fc9d542f4979463c6937f0fa7)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:09.218994 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231c0bcd-912e-41c7-a872-61fec71ec9ff admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:09.295311 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-231c0bcd-912e-41c7-a872-61fec71ec9ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '877c3a1fc9d542f4979463c6937f0fa7', 'request_id': 'req-231c0bcd-912e-41c7-a872-61fec71ec9ff'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:09.309787 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-231c0bcd-912e-41c7-a872-61fec71ec9ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '877c3a1fc9d542f4979463c6937f0fa7', 'request_id': 'req-231c0bcd-912e-41c7-a872-61fec71ec9ff'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:09.316399 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-231c0bcd-912e-41c7-a872-61fec71ec9ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '877c3a1fc9d542f4979463c6937f0fa7', 'request_id': 'req-231c0bcd-912e-41c7-a872-61fec71ec9ff'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:09.330635 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-231c0bcd-912e-41c7-a872-61fec71ec9ff admin admin] The token cache is being invalidate because project 877c3a1fc9d542f4979463c6937f0fa7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:24:09.330917 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-231c0bcd-912e-41c7-a872-61fec71ec9ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:09.331207 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f23b15-ed37-4e16-9c97-fd257e7c9537 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:09.331619 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-231c0bcd-912e-41c7-a872-61fec71ec9ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:09.335913 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1373/2715] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:24:09 2022] DELETE /identity/v3/projects/877c3a1fc9d542f4979463c6937f0fa7 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:24:09.338378 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2df8a2-12ef-4cfe-ba98-c27ee2fa413e None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:09.338859 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2df8a2-12ef-4cfe-ba98-c27ee2fa413e None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:09.339347 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2df8a2-12ef-4cfe-ba98-c27ee2fa413e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:09.360684 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-fc2df8a2-12ef-4cfe-ba98-c27ee2fa413e None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:24:09.362050 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-fc2df8a2-12ef-4cfe-ba98-c27ee2fa413e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:09.406166 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37c8e96-2854-4c8b-9b70-48509a0d4eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:09.407374 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c8e96-2854-4c8b-9b70-48509a0d4eb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:09.407781 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c8e96-2854-4c8b-9b70-48509a0d4eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:09.408276 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c8e96-2854-4c8b-9b70-48509a0d4eb4 admin admin] PATH_INFO: `/v3/projects/d55452da2e4143a4be62db0e14f2f9fd` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:09.409946 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37c8e96-2854-4c8b-9b70-48509a0d4eb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d55452da2e4143a4be62db0e14f2f9fd)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:09.411506 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37c8e96-2854-4c8b-9b70-48509a0d4eb4 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:09.443712 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1374/2716] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:24:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:24:09.453252 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b71153-9973-4dd8-950d-3f8e20b84182 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:09.453611 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b71153-9973-4dd8-950d-3f8e20b84182 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:09.453959 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b71153-9973-4dd8-950d-3f8e20b84182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:09.471439 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c37c8e96-2854-4c8b-9b70-48509a0d4eb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd55452da2e4143a4be62db0e14f2f9fd', 'request_id': 'req-c37c8e96-2854-4c8b-9b70-48509a0d4eb4'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:09.476981 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-39b71153-9973-4dd8-950d-3f8e20b84182 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:24:09.478216 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-39b71153-9973-4dd8-950d-3f8e20b84182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:09.478510 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c37c8e96-2854-4c8b-9b70-48509a0d4eb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd55452da2e4143a4be62db0e14f2f9fd', 'request_id': 'req-c37c8e96-2854-4c8b-9b70-48509a0d4eb4'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:09.488193 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c37c8e96-2854-4c8b-9b70-48509a0d4eb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd55452da2e4143a4be62db0e14f2f9fd', 'request_id': 'req-c37c8e96-2854-4c8b-9b70-48509a0d4eb4'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:09.503949 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c37c8e96-2854-4c8b-9b70-48509a0d4eb4 admin admin] The token cache is being invalidate because project d55452da2e4143a4be62db0e14f2f9fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:24:09.504240 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c37c8e96-2854-4c8b-9b70-48509a0d4eb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:09.505018 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c37c8e96-2854-4c8b-9b70-48509a0d4eb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:09.507055 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1343/2717] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:24:09 2022] DELETE /identity/v3/projects/d55452da2e4143a4be62db0e14f2f9fd => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:24:09.515529 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe8c939-9545-4170-be9b-2a1088b3b257 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:09.515812 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe8c939-9545-4170-be9b-2a1088b3b257 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:09.516129 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe8c939-9545-4170-be9b-2a1088b3b257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:09.516298 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:24:09.529419 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:24:09.546257 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-dbe8c939-9545-4170-be9b-2a1088b3b257 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:24:09.547645 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-dbe8c939-9545-4170-be9b-2a1088b3b257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:09.554880 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1375/2718] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:24:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:24:09.558353 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1344/2719] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:24:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:24:09.560047 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b71153-9973-4dd8-950d-3f8e20b84182 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:09.566090 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bbd98f-abc0-42bb-8479-6a66a542c338 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:09.566376 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bbd98f-abc0-42bb-8479-6a66a542c338 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:09.566687 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bbd98f-abc0-42bb-8479-6a66a542c338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:09.579979 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b71153-9973-4dd8-950d-3f8e20b84182 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:09.592171 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8bc5e1-7973-49f8-a52b-8f1aa7d3d8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:09.592965 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8bc5e1-7973-49f8-a52b-8f1aa7d3d8c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:09.593248 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8bc5e1-7973-49f8-a52b-8f1aa7d3d8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:09.593526 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8bc5e1-7973-49f8-a52b-8f1aa7d3d8c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:09.597274 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8bc5e1-7973-49f8-a52b-8f1aa7d3d8c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:24:09.597587 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8bc5e1-7973-49f8-a52b-8f1aa7d3d8c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:09.597688 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-37bbd98f-abc0-42bb-8479-6a66a542c338 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:24:09.598899 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-37bbd98f-abc0-42bb-8479-6a66a542c338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:09.599253 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8bc5e1-7973-49f8-a52b-8f1aa7d3d8c7 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:09.611521 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1345/2720] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:24:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:24:09.613027 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bbd98f-abc0-42bb-8479-6a66a542c338 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:09.624673 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bbd98f-abc0-42bb-8479-6a66a542c338 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:09.629183 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1376/2721] 10.222.0.42 () {58 vars in 1152 bytes} [Mon Jul 4 09:24:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:24:09.630385 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1266f867-88c5-436e-a948-c0919efaddb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:09.630856 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8bc5e1-7973-49f8-a52b-8f1aa7d3d8c7 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:09.631030 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266f867-88c5-436e-a948-c0919efaddb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:09.631316 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266f867-88c5-436e-a948-c0919efaddb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:09.631591 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266f867-88c5-436e-a948-c0919efaddb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:09.632434 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1266f867-88c5-436e-a948-c0919efaddb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:24:09.632741 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1266f867-88c5-436e-a948-c0919efaddb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:09.634383 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1266f867-88c5-436e-a948-c0919efaddb2 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:09.642530 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8bc5e1-7973-49f8-a52b-8f1aa7d3d8c7 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:09.648426 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2858e490-5219-4959-9b4d-0ddba92ec781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:09.649293 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858e490-5219-4959-9b4d-0ddba92ec781 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:09.652831 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1346/2722] 10.222.0.42 () {58 vars in 1152 bytes} [Mon Jul 4 09:24:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:24:09.652947 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858e490-5219-4959-9b4d-0ddba92ec781 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:09.652947 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858e490-5219-4959-9b4d-0ddba92ec781 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:09.652947 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2858e490-5219-4959-9b4d-0ddba92ec781 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:09.653332 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2858e490-5219-4959-9b4d-0ddba92ec781 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:09.654068 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1266f867-88c5-436e-a948-c0919efaddb2 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:09.669733 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1266f867-88c5-436e-a948-c0919efaddb2 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:09.676317 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87cf8aa-723b-499b-9f70-bffb81580cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:09.677266 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87cf8aa-723b-499b-9f70-bffb81580cbf admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:09.677800 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87cf8aa-723b-499b-9f70-bffb81580cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:09.678254 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87cf8aa-723b-499b-9f70-bffb81580cbf admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:09.679204 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87cf8aa-723b-499b-9f70-bffb81580cbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:09.682571 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87cf8aa-723b-499b-9f70-bffb81580cbf admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:09.687119 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1377/2723] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:24:09 2022] POST /identity/v3/projects => generated 397 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:24:09.691026 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2858e490-5219-4959-9b4d-0ddba92ec781 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:09.728332 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1347/2724] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:24:09 2022] POST /identity/v3/projects => generated 383 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:24:09.731812 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87cf8aa-723b-499b-9f70-bffb81580cbf admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:09.768798 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2858e490-5219-4959-9b4d-0ddba92ec781 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:09.831509 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87cf8aa-723b-499b-9f70-bffb81580cbf admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:09.835703 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef6e0f8-cff9-4fbb-800d-75691fe16be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:09.837036 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e5aace-8407-400b-ac60-2b15daca50ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:09.838340 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e5aace-8407-400b-ac60-2b15daca50ae admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:09.838340 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e5aace-8407-400b-ac60-2b15daca50ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:09.838560 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e5aace-8407-400b-ac60-2b15daca50ae admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:09.838755 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef6e0f8-cff9-4fbb-800d-75691fe16be4 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:09.838990 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef6e0f8-cff9-4fbb-800d-75691fe16be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:09.839219 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e5aace-8407-400b-ac60-2b15daca50ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:09.839334 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef6e0f8-cff9-4fbb-800d-75691fe16be4 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:09.840211 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef6e0f8-cff9-4fbb-800d-75691fe16be4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:09.841308 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e5aace-8407-400b-ac60-2b15daca50ae admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:09.842243 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef6e0f8-cff9-4fbb-800d-75691fe16be4 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:09.870469 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1378/2725] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:24:09 2022] POST /identity/v3/users => generated 299 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:24:09.874457 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1348/2726] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:24:09 2022] POST /identity/v3/users => generated 292 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:24:09.874649 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef6e0f8-cff9-4fbb-800d-75691fe16be4 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:09.882744 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e5aace-8407-400b-ac60-2b15daca50ae admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:09.888732 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef6e0f8-cff9-4fbb-800d-75691fe16be4 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:09.897810 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e5aace-8407-400b-ac60-2b15daca50ae admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:09.898936 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beff7500-5543-4871-8b06-c73b6c53fd5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:09.900070 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff7500-5543-4871-8b06-c73b6c53fd5d admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:09.900070 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff7500-5543-4871-8b06-c73b6c53fd5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:09.900341 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff7500-5543-4871-8b06-c73b6c53fd5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:09.901374 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beff7500-5543-4871-8b06-c73b6c53fd5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:09.902978 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beff7500-5543-4871-8b06-c73b6c53fd5d admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:09.906535 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc39f776-815d-41c0-8a0f-c04bc329d7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:09.907205 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc39f776-815d-41c0-8a0f-c04bc329d7b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:09.907549 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc39f776-815d-41c0-8a0f-c04bc329d7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:09.907925 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc39f776-815d-41c0-8a0f-c04bc329d7b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:09.908739 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc39f776-815d-41c0-8a0f-c04bc329d7b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:09.910732 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc39f776-815d-41c0-8a0f-c04bc329d7b0 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:09.916699 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1379/2727] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:24:09 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:24:09.920589 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beff7500-5543-4871-8b06-c73b6c53fd5d admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:09.926615 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1349/2728] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:24:09 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:24:09.930483 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc39f776-815d-41c0-8a0f-c04bc329d7b0 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:09.931655 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beff7500-5543-4871-8b06-c73b6c53fd5d admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:09.936489 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0c6ef2-416d-40db-8e73-4e510efc0167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:09.937250 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c6ef2-416d-40db-8e73-4e510efc0167 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:09.937455 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c6ef2-416d-40db-8e73-4e510efc0167 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:09.937734 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c6ef2-416d-40db-8e73-4e510efc0167 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:09.938631 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0c6ef2-416d-40db-8e73-4e510efc0167 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:09.940438 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0c6ef2-416d-40db-8e73-4e510efc0167 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:09.944425 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc39f776-815d-41c0-8a0f-c04bc329d7b0 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:09.951645 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcf4088-72da-4243-bf59-a646d9a17fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:09.952609 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf4088-72da-4243-bf59-a646d9a17fe8 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:09.952891 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf4088-72da-4243-bf59-a646d9a17fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:09.953274 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf4088-72da-4243-bf59-a646d9a17fe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:09.954020 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcf4088-72da-4243-bf59-a646d9a17fe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:09.955605 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1380/2729] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:24:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:24:09.956109 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcf4088-72da-4243-bf59-a646d9a17fe8 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:09.956779 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0c6ef2-416d-40db-8e73-4e510efc0167 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:09.967016 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0c6ef2-416d-40db-8e73-4e510efc0167 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:09.972490 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1350/2730] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:24:09 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:24:09.973624 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcf4088-72da-4243-bf59-a646d9a17fe8 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:09.975733 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fa1ad0-b6d0-4300-b03e-57e5704709b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:09.976699 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa1ad0-b6d0-4300-b03e-57e5704709b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:09.976983 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa1ad0-b6d0-4300-b03e-57e5704709b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:09.977256 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa1ad0-b6d0-4300-b03e-57e5704709b1 admin admin] PATH_INFO: `/v3/projects/52f647b58cca4fbfbfe596044d50dbf6/users/4af3d3485c26412d93b8ab0680704a8b/roles/81634e7812344f84afcb29b0dba2687c` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:09.986617 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcf4088-72da-4243-bf59-a646d9a17fe8 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:09.989994 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:24:09.995098 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b639b15d-acc4-4bca-94df-6292901a97dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:09.995913 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fa1ad0-b6d0-4300-b03e-57e5704709b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52f647b58cca4fbfbfe596044d50dbf6, user_id=4af3d3485c26412d93b8ab0680704a8b, role_id=81634e7812344f84afcb29b0dba2687c)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:09.996469 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b639b15d-acc4-4bca-94df-6292901a97dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:09.996919 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b639b15d-acc4-4bca-94df-6292901a97dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:09.997346 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b639b15d-acc4-4bca-94df-6292901a97dd admin admin] PATH_INFO: `/v3/projects/b87232834f9345b089ec61c0f3556060/users/0023a67a400a410caa6a36a9b4cf0abf/roles/81634e7812344f84afcb29b0dba2687c` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:09.998757 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fa1ad0-b6d0-4300-b03e-57e5704709b1 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:10.020066 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b639b15d-acc4-4bca-94df-6292901a97dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b87232834f9345b089ec61c0f3556060, user_id=0023a67a400a410caa6a36a9b4cf0abf, role_id=81634e7812344f84afcb29b0dba2687c)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:10.020460 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1381/2731] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:24:09 2022] PUT /identity/v3/projects/52f647b58cca4fbfbfe596044d50dbf6/users/4af3d3485c26412d93b8ab0680704a8b/roles/81634e7812344f84afcb29b0dba2687c => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:24:10.024016 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b639b15d-acc4-4bca-94df-6292901a97dd admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:10.031024 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d449ed-612e-4300-b26b-8f5e3c767ecb None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:10.031473 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d449ed-612e-4300-b26b-8f5e3c767ecb None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:10.031861 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d449ed-612e-4300-b26b-8f5e3c767ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:10.043682 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1351/2732] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:24:09 2022] PUT /identity/v3/projects/b87232834f9345b089ec61c0f3556060/users/0023a67a400a410caa6a36a9b4cf0abf/roles/81634e7812344f84afcb29b0dba2687c => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:24:10.060480 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d282bef1-506d-478e-a463-a95f9c5d4d3d None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:10.060949 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d282bef1-506d-478e-a463-a95f9c5d4d3d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:10.061469 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d282bef1-506d-478e-a463-a95f9c5d4d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:10.081895 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-b2d449ed-612e-4300-b26b-8f5e3c767ecb None None] MFA Rules not processed for user `4af3d3485c26412d93b8ab0680704a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:24:10.086735 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-b2d449ed-612e-4300-b26b-8f5e3c767ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:10.113228 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-d282bef1-506d-478e-a463-a95f9c5d4d3d None None] MFA Rules not processed for user `0023a67a400a410caa6a36a9b4cf0abf`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:24:10.115263 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d282bef1-506d-478e-a463-a95f9c5d4d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:10.168744 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:24:10.197302 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1382/2733] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:24:10 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:24:10.205868 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1352/2734] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:24:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:24:10.210746 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d449ed-612e-4300-b26b-8f5e3c767ecb None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:10.218735 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d282bef1-506d-478e-a463-a95f9c5d4d3d None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:10.219201 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-b2d449ed-612e-4300-b26b-8f5e3c767ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:10.220692 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d282bef1-506d-478e-a463-a95f9c5d4d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:10.300531 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d282bef1-506d-478e-a463-a95f9c5d4d3d None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:10.306873 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d449ed-612e-4300-b26b-8f5e3c767ecb None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:10.306873 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6560634d-f78e-478c-9835-68983d598060 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f86373d65440da97c853fff3c1d0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:10.307467 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6560634d-f78e-478c-9835-68983d598060 service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:10.307751 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6560634d-f78e-478c-9835-68983d598060 service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:10.308067 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6560634d-f78e-478c-9835-68983d598060 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:10.318069 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41936214-1843-416c-83e2-d46b38b8be32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f86373d65440da97c853fff3c1d0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:10.318935 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41936214-1843-416c-83e2-d46b38b8be32 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:10.319411 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41936214-1843-416c-83e2-d46b38b8be32 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:10.320515 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41936214-1843-416c-83e2-d46b38b8be32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:10.323936 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6560634d-f78e-478c-9835-68983d598060 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:10.326956 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6560634d-f78e-478c-9835-68983d598060 service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:10.334253 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41936214-1843-416c-83e2-d46b38b8be32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:10.335747 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41936214-1843-416c-83e2-d46b38b8be32 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:10.337448 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1383/2735] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:24:10 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:24:10.349730 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1353/2736] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:24:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:24:11.099049 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d521c3-9fab-4339-bc11-53a9846b29e6 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:11.099591 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d521c3-9fab-4339-bc11-53a9846b29e6 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:11.099591 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d521c3-9fab-4339-bc11-53a9846b29e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:11.119548 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-b6d521c3-9fab-4339-bc11-53a9846b29e6 None None] MFA Rules not processed for user `54de34583d5544d28f52c5fdb08e1e38`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:24:11.121003 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-b6d521c3-9fab-4339-bc11-53a9846b29e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:11.179308 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1384/2737] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:24:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:24:11.435893 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41936214-1843-416c-83e2-d46b38b8be32 service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:11.437470 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-41936214-1843-416c-83e2-d46b38b8be32 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:11.497525 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41936214-1843-416c-83e2-d46b38b8be32 service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:11.503033 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372bf1f4-8bb6-465e-ae7f-c845996d616b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:11.503745 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372bf1f4-8bb6-465e-ae7f-c845996d616b service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:11.504104 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372bf1f4-8bb6-465e-ae7f-c845996d616b service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:11.504337 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372bf1f4-8bb6-465e-ae7f-c845996d616b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:11.506467 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-372bf1f4-8bb6-465e-ae7f-c845996d616b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:11.517009 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372bf1f4-8bb6-465e-ae7f-c845996d616b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:11.518462 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372bf1f4-8bb6-465e-ae7f-c845996d616b service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:11.526453 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1354/2738] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:24:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:24:12.999436 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d521c3-9fab-4339-bc11-53a9846b29e6 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:13.033968 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:24:13.074654 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d521c3-9fab-4339-bc11-53a9846b29e6 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:13.081419 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75877f2c-0c10-42a8-8267-7f81ff01e56e None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:13.081945 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8d6542-5a23-4ba5-81cb-c8c16c68adb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:13.082090 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75877f2c-0c10-42a8-8267-7f81ff01e56e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:13.082198 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75877f2c-0c10-42a8-8267-7f81ff01e56e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:13.082669 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d6542-5a23-4ba5-81cb-c8c16c68adb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:13.083014 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d6542-5a23-4ba5-81cb-c8c16c68adb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:13.083361 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d6542-5a23-4ba5-81cb-c8c16c68adb4 admin admin] PATH_INFO: `/v3/users/0023a67a400a410caa6a36a9b4cf0abf` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:13.084666 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8d6542-5a23-4ba5-81cb-c8c16c68adb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0023a67a400a410caa6a36a9b4cf0abf)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:13.086795 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8d6542-5a23-4ba5-81cb-c8c16c68adb4 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:13.103679 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-75877f2c-0c10-42a8-8267-7f81ff01e56e None None] MFA Rules not processed for user `bd758d5b21684027b0d199021df0ad2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:24:13.105738 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-75877f2c-0c10-42a8-8267-7f81ff01e56e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:13.149051 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-fd8d6542-5a23-4ba5-81cb-c8c16c68adb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0023a67a400a410caa6a36a9b4cf0abf'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:13.157527 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-fd8d6542-5a23-4ba5-81cb-c8c16c68adb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0023a67a400a410caa6a36a9b4cf0abf'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:13.158385 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-fd8d6542-5a23-4ba5-81cb-c8c16c68adb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0023a67a400a410caa6a36a9b4cf0abf'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:13.159364 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-fd8d6542-5a23-4ba5-81cb-c8c16c68adb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0023a67a400a410caa6a36a9b4cf0abf'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:13.172517 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1355/2739] 10.222.0.42 () {58 vars in 1009 bytes} [Mon Jul 4 09:24:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:24:13.177045 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-fd8d6542-5a23-4ba5-81cb-c8c16c68adb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0023a67a400a410caa6a36a9b4cf0abf'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:13.193051 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75877f2c-0c10-42a8-8267-7f81ff01e56e None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:13.195486 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1385/2740] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:24:12 2022] DELETE /identity/v3/users/0023a67a400a410caa6a36a9b4cf0abf => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:24:13.196182 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-75877f2c-0c10-42a8-8267-7f81ff01e56e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:13.201640 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a15b36-d6b5-4f72-b78b-9087d3a72fee None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:13.202076 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a15b36-d6b5-4f72-b78b-9087d3a72fee None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:13.202476 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a15b36-d6b5-4f72-b78b-9087d3a72fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:13.228096 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-33a15b36-d6b5-4f72-b78b-9087d3a72fee None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:24:13.229596 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-33a15b36-d6b5-4f72-b78b-9087d3a72fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:13.289688 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:24:13.343718 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1386/2741] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:24:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:24:13.351516 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75877f2c-0c10-42a8-8267-7f81ff01e56e None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:13.355604 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a15b36-d6b5-4f72-b78b-9087d3a72fee None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:13.357055 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-33a15b36-d6b5-4f72-b78b-9087d3a72fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:13.429104 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:24:13.438687 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a15b36-d6b5-4f72-b78b-9087d3a72fee None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:13.454634 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23fdd20-615d-44aa-be3e-19952ea72edb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:13.455347 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23fdd20-615d-44aa-be3e-19952ea72edb service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:13.455634 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23fdd20-615d-44aa-be3e-19952ea72edb service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:13.455936 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23fdd20-615d-44aa-be3e-19952ea72edb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:13.462344 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6211d2-787f-47fd-92a5-4d835c9bac02 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59d8698c45fb46259765eb3c8de2297f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:13.463471 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6211d2-787f-47fd-92a5-4d835c9bac02 service swift] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:13.463471 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6211d2-787f-47fd-92a5-4d835c9bac02 service swift] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:13.464421 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6211d2-787f-47fd-92a5-4d835c9bac02 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:13.470035 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23fdd20-615d-44aa-be3e-19952ea72edb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:13.472943 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23fdd20-615d-44aa-be3e-19952ea72edb service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:13.491111 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1387/2742] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:24:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 09:24:13.548266 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6211d2-787f-47fd-92a5-4d835c9bac02 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:13.550583 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6211d2-787f-47fd-92a5-4d835c9bac02 service swift] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:13.564290 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1356/2743] 10.222.0.42 () {60 vars in 1384 bytes} [Mon Jul 4 09:24:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 04 09:24:14.015671 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23fdd20-615d-44aa-be3e-19952ea72edb service neutron] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:14.019177 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-f23fdd20-615d-44aa-be3e-19952ea72edb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:14.036025 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23fdd20-615d-44aa-be3e-19952ea72edb service neutron] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:14.049684 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9366856-297d-4902-815b-cea2ef5c6f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:14.050594 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9366856-297d-4902-815b-cea2ef5c6f46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:14.050880 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9366856-297d-4902-815b-cea2ef5c6f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:14.051155 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9366856-297d-4902-815b-cea2ef5c6f46 admin admin] PATH_INFO: `/v3/projects/b87232834f9345b089ec61c0f3556060` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:14.052417 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9366856-297d-4902-815b-cea2ef5c6f46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b87232834f9345b089ec61c0f3556060)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:14.054930 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9366856-297d-4902-815b-cea2ef5c6f46 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:14.108543 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a9366856-297d-4902-815b-cea2ef5c6f46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b87232834f9345b089ec61c0f3556060', 'request_id': 'req-a9366856-297d-4902-815b-cea2ef5c6f46'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:14.117254 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a9366856-297d-4902-815b-cea2ef5c6f46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b87232834f9345b089ec61c0f3556060', 'request_id': 'req-a9366856-297d-4902-815b-cea2ef5c6f46'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:14.123436 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a9366856-297d-4902-815b-cea2ef5c6f46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b87232834f9345b089ec61c0f3556060', 'request_id': 'req-a9366856-297d-4902-815b-cea2ef5c6f46'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:14.134899 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a9366856-297d-4902-815b-cea2ef5c6f46 admin admin] The token cache is being invalidate because project b87232834f9345b089ec61c0f3556060 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:24:14.135183 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a9366856-297d-4902-815b-cea2ef5c6f46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:14.136167 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a9366856-297d-4902-815b-cea2ef5c6f46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:14.138017 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1388/2744] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:24:14 2022] DELETE /identity/v3/projects/b87232834f9345b089ec61c0f3556060 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:24:15.600932 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6211d2-787f-47fd-92a5-4d835c9bac02 service swift] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:15.602502 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0b6211d2-787f-47fd-92a5-4d835c9bac02 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:15.617329 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6211d2-787f-47fd-92a5-4d835c9bac02 service swift] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:15.681936 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8866ef96-3b83-4690-bdf1-c11af9e93a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:15.682822 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8866ef96-3b83-4690-bdf1-c11af9e93a36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:15.683099 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8866ef96-3b83-4690-bdf1-c11af9e93a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:15.683368 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8866ef96-3b83-4690-bdf1-c11af9e93a36 admin admin] PATH_INFO: `/v3/users/4af3d3485c26412d93b8ab0680704a8b` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:15.684615 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8866ef96-3b83-4690-bdf1-c11af9e93a36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4af3d3485c26412d93b8ab0680704a8b)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:15.686806 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8866ef96-3b83-4690-bdf1-c11af9e93a36 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:15.715968 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:24:15.749494 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8866ef96-3b83-4690-bdf1-c11af9e93a36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4af3d3485c26412d93b8ab0680704a8b'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:15.750144 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8866ef96-3b83-4690-bdf1-c11af9e93a36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4af3d3485c26412d93b8ab0680704a8b'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:15.758015 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8866ef96-3b83-4690-bdf1-c11af9e93a36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4af3d3485c26412d93b8ab0680704a8b'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:15.758687 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8866ef96-3b83-4690-bdf1-c11af9e93a36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4af3d3485c26412d93b8ab0680704a8b'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:15.772803 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8866ef96-3b83-4690-bdf1-c11af9e93a36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4af3d3485c26412d93b8ab0680704a8b'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:15.786352 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1357/2745] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:24:15 2022] DELETE /identity/v3/users/4af3d3485c26412d93b8ab0680704a8b => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:24:15.790975 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb301c3-4e58-420e-b030-a5b80422e848 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:15.791498 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb301c3-4e58-420e-b030-a5b80422e848 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:15.791498 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb301c3-4e58-420e-b030-a5b80422e848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:15.810994 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-ffb301c3-4e58-420e-b030-a5b80422e848 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:24:15.812468 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-ffb301c3-4e58-420e-b030-a5b80422e848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:15.895161 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8866ef96-3b83-4690-bdf1-c11af9e93a36 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:15.897121 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-8866ef96-3b83-4690-bdf1-c11af9e93a36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:15.898142 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1389/2746] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:24:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:24:15.963088 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8866ef96-3b83-4690-bdf1-c11af9e93a36 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:15.966683 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e65d87-4143-42c2-b59c-f596e584eac1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:15.967369 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e65d87-4143-42c2-b59c-f596e584eac1 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:15.967653 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e65d87-4143-42c2-b59c-f596e584eac1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:15.967941 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e65d87-4143-42c2-b59c-f596e584eac1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:15.978498 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e65d87-4143-42c2-b59c-f596e584eac1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:15.980125 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e65d87-4143-42c2-b59c-f596e584eac1 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:15.991170 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1358/2747] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:24:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 09:24:16.393744 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb301c3-4e58-420e-b030-a5b80422e848 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:16.396680 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-ffb301c3-4e58-420e-b030-a5b80422e848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:16.411819 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb301c3-4e58-420e-b030-a5b80422e848 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:16.426574 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac1ca03-3968-4103-9b5e-ae3c11a31ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:16.428042 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac1ca03-3968-4103-9b5e-ae3c11a31ea7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:16.429020 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac1ca03-3968-4103-9b5e-ae3c11a31ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:16.429433 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac1ca03-3968-4103-9b5e-ae3c11a31ea7 admin admin] PATH_INFO: `/v3/projects/52f647b58cca4fbfbfe596044d50dbf6` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:16.431621 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac1ca03-3968-4103-9b5e-ae3c11a31ea7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52f647b58cca4fbfbfe596044d50dbf6)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:16.435151 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac1ca03-3968-4103-9b5e-ae3c11a31ea7 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:16.494826 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-dac1ca03-3968-4103-9b5e-ae3c11a31ea7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52f647b58cca4fbfbfe596044d50dbf6', 'request_id': 'req-dac1ca03-3968-4103-9b5e-ae3c11a31ea7'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:16.504487 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-dac1ca03-3968-4103-9b5e-ae3c11a31ea7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52f647b58cca4fbfbfe596044d50dbf6', 'request_id': 'req-dac1ca03-3968-4103-9b5e-ae3c11a31ea7'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:16.511123 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-dac1ca03-3968-4103-9b5e-ae3c11a31ea7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52f647b58cca4fbfbfe596044d50dbf6', 'request_id': 'req-dac1ca03-3968-4103-9b5e-ae3c11a31ea7'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:16.517186 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:24:16.529554 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-dac1ca03-3968-4103-9b5e-ae3c11a31ea7 admin admin] The token cache is being invalidate because project 52f647b58cca4fbfbfe596044d50dbf6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:24:16.530329 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-dac1ca03-3968-4103-9b5e-ae3c11a31ea7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:16.531552 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-dac1ca03-3968-4103-9b5e-ae3c11a31ea7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:16.538017 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1390/2748] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:24:16 2022] DELETE /identity/v3/projects/52f647b58cca4fbfbfe596044d50dbf6 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:24:16.538733 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd762bf-72c9-470e-8b0a-ab41e4ad9d52 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:16.539022 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd762bf-72c9-470e-8b0a-ab41e4ad9d52 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:16.539300 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd762bf-72c9-470e-8b0a-ab41e4ad9d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:16.573706 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-8dd762bf-72c9-470e-8b0a-ab41e4ad9d52 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:24:16.574938 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-8dd762bf-72c9-470e-8b0a-ab41e4ad9d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:16.670916 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1359/2749] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:24:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:24:16.677254 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb02411-0e39-465d-ac51-50de062bbb07 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:16.677540 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb02411-0e39-465d-ac51-50de062bbb07 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:16.677812 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb02411-0e39-465d-ac51-50de062bbb07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:16.698342 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-8fb02411-0e39-465d-ac51-50de062bbb07 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:24:16.699566 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-8fb02411-0e39-465d-ac51-50de062bbb07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:16.711396 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1391/2750] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:24:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:24:16.712509 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd762bf-72c9-470e-8b0a-ab41e4ad9d52 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:16.723428 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd762bf-72c9-470e-8b0a-ab41e4ad9d52 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:16.728821 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16d9f09-0714-40de-9731-b139410211b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:16.729903 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d9f09-0714-40de-9731-b139410211b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:16.730251 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d9f09-0714-40de-9731-b139410211b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:16.730774 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d9f09-0714-40de-9731-b139410211b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:16.731548 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16d9f09-0714-40de-9731-b139410211b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:24:16.732013 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16d9f09-0714-40de-9731-b139410211b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:16.734043 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16d9f09-0714-40de-9731-b139410211b4 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:16.748317 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1360/2751] 10.222.0.42 () {58 vars in 1152 bytes} [Mon Jul 4 09:24:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:24:16.753113 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb02411-0e39-465d-ac51-50de062bbb07 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:16.763587 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb02411-0e39-465d-ac51-50de062bbb07 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:16.768798 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8044a9a-22cf-4f22-b19f-040aee1b7ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:16.769468 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8044a9a-22cf-4f22-b19f-040aee1b7ebf admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:16.770785 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8044a9a-22cf-4f22-b19f-040aee1b7ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:16.770785 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8044a9a-22cf-4f22-b19f-040aee1b7ebf admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:16.772074 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8044a9a-22cf-4f22-b19f-040aee1b7ebf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:16.774163 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8044a9a-22cf-4f22-b19f-040aee1b7ebf admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:16.806442 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1392/2752] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:24:16 2022] POST /identity/v3/projects => generated 371 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:24:16.810437 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16d9f09-0714-40de-9731-b139410211b4 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:16.822799 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16d9f09-0714-40de-9731-b139410211b4 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:16.854597 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:24:16.899214 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20060d08-eeaf-4e4a-9246-5fac1cabf2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:16.900029 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20060d08-eeaf-4e4a-9246-5fac1cabf2da admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:16.900469 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20060d08-eeaf-4e4a-9246-5fac1cabf2da admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:16.900747 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20060d08-eeaf-4e4a-9246-5fac1cabf2da admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:16.901478 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20060d08-eeaf-4e4a-9246-5fac1cabf2da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:16.903419 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20060d08-eeaf-4e4a-9246-5fac1cabf2da admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:16.927935 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1361/2753] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:24:16 2022] POST /identity/v3/users => generated 286 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:24:16.932094 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8044a9a-22cf-4f22-b19f-040aee1b7ebf admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:16.944522 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8044a9a-22cf-4f22-b19f-040aee1b7ebf admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:16.949764 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cbbebf-fc85-4623-bbf2-31fe85b4e512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:16.950511 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cbbebf-fc85-4623-bbf2-31fe85b4e512 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:16.950891 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cbbebf-fc85-4623-bbf2-31fe85b4e512 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:16.951436 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cbbebf-fc85-4623-bbf2-31fe85b4e512 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:16.952267 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cbbebf-fc85-4623-bbf2-31fe85b4e512 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:16.953969 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cbbebf-fc85-4623-bbf2-31fe85b4e512 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:16.965149 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1393/2754] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:24:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:24:16.969938 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20060d08-eeaf-4e4a-9246-5fac1cabf2da admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:16.980462 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20060d08-eeaf-4e4a-9246-5fac1cabf2da admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:16.985267 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8d4812-4dce-462a-93d2-a1e64e3855eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:16.986021 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d4812-4dce-462a-93d2-a1e64e3855eb admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:16.986422 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d4812-4dce-462a-93d2-a1e64e3855eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:16.986760 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d4812-4dce-462a-93d2-a1e64e3855eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:16.987571 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8d4812-4dce-462a-93d2-a1e64e3855eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:16.989315 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8d4812-4dce-462a-93d2-a1e64e3855eb admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:17.000429 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1362/2755] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:24:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:24:17.005174 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cbbebf-fc85-4623-bbf2-31fe85b4e512 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:17.018438 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cbbebf-fc85-4623-bbf2-31fe85b4e512 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:17.023132 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a28f6d-6c0d-4ad9-aa4b-e6140cf497bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:17.024169 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a28f6d-6c0d-4ad9-aa4b-e6140cf497bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:17.024449 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a28f6d-6c0d-4ad9-aa4b-e6140cf497bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:17.024723 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a28f6d-6c0d-4ad9-aa4b-e6140cf497bb admin admin] PATH_INFO: `/v3/projects/44cd2bf7c0614eb88fbcd3bbe07cd4d0/users/9e90ac63942941da8f8cd00e874613a1/roles/81634e7812344f84afcb29b0dba2687c` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:17.041192 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a28f6d-6c0d-4ad9-aa4b-e6140cf497bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=44cd2bf7c0614eb88fbcd3bbe07cd4d0, user_id=9e90ac63942941da8f8cd00e874613a1, role_id=81634e7812344f84afcb29b0dba2687c)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:17.043950 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a28f6d-6c0d-4ad9-aa4b-e6140cf497bb admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:17.062137 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1394/2756] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:24:17 2022] PUT /identity/v3/projects/44cd2bf7c0614eb88fbcd3bbe07cd4d0/users/9e90ac63942941da8f8cd00e874613a1/roles/81634e7812344f84afcb29b0dba2687c => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:24:17.064587 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeda79d-d9e3-408e-920a-991e6ceb8442 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:17.065203 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeda79d-d9e3-408e-920a-991e6ceb8442 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:17.065596 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeda79d-d9e3-408e-920a-991e6ceb8442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:17.087485 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-beeda79d-d9e3-408e-920a-991e6ceb8442 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:24:17.088874 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-beeda79d-d9e3-408e-920a-991e6ceb8442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:17.161918 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1363/2757] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:24:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:24:17.168454 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a28f6d-6c0d-4ad9-aa4b-e6140cf497bb admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:17.170385 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-b5a28f6d-6c0d-4ad9-aa4b-e6140cf497bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:17.234077 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a28f6d-6c0d-4ad9-aa4b-e6140cf497bb admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:17.248096 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4da109c-631d-4eab-941d-3c467de18d68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:17.248924 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4da109c-631d-4eab-941d-3c467de18d68 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:17.249217 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4da109c-631d-4eab-941d-3c467de18d68 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:17.249480 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4da109c-631d-4eab-941d-3c467de18d68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:17.259650 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4da109c-631d-4eab-941d-3c467de18d68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:17.261129 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4da109c-631d-4eab-941d-3c467de18d68 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:17.271698 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1395/2758] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:24:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:24:24.588488 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248c9d85-3fae-4d1f-9748-81d8cff91da2 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:24.589090 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248c9d85-3fae-4d1f-9748-81d8cff91da2 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:24.589090 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248c9d85-3fae-4d1f-9748-81d8cff91da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:24.617043 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-248c9d85-3fae-4d1f-9748-81d8cff91da2 None None] MFA Rules not processed for user `9e90ac63942941da8f8cd00e874613a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:24:24.618260 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-248c9d85-3fae-4d1f-9748-81d8cff91da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:24.702049 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1364/2759] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:24:24 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:24:24.708213 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4da109c-631d-4eab-941d-3c467de18d68 service neutron] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:24.719613 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4da109c-631d-4eab-941d-3c467de18d68 service neutron] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:24.728724 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8c4774-13d4-45bb-80ec-e935933bd71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:24.729609 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8c4774-13d4-45bb-80ec-e935933bd71b admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:24.730071 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8c4774-13d4-45bb-80ec-e935933bd71b admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:24.730657 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8c4774-13d4-45bb-80ec-e935933bd71b admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:24.731616 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8c4774-13d4-45bb-80ec-e935933bd71b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:24.734352 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8c4774-13d4-45bb-80ec-e935933bd71b admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:24.771915 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1396/2760] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:24:24 2022] POST /identity/v3/projects => generated 373 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:24:24.775780 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248c9d85-3fae-4d1f-9748-81d8cff91da2 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:24.788124 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248c9d85-3fae-4d1f-9748-81d8cff91da2 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:24.837954 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:24:24.864426 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7451279c-ee55-47e0-9577-9bd96c3fe641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:24.865211 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7451279c-ee55-47e0-9577-9bd96c3fe641 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:24.865567 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7451279c-ee55-47e0-9577-9bd96c3fe641 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:24.865913 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7451279c-ee55-47e0-9577-9bd96c3fe641 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:24.866759 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7451279c-ee55-47e0-9577-9bd96c3fe641 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:24.868861 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7451279c-ee55-47e0-9577-9bd96c3fe641 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:24.898420 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1365/2761] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:24:24 2022] POST /identity/v3/users => generated 293 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:24:24.902199 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8c4774-13d4-45bb-80ec-e935933bd71b admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:24.915832 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8c4774-13d4-45bb-80ec-e935933bd71b admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:24.921016 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec8657-00d3-496c-92a3-3f7573c25347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:24.922126 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec8657-00d3-496c-92a3-3f7573c25347 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:24.922126 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec8657-00d3-496c-92a3-3f7573c25347 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:24.922375 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec8657-00d3-496c-92a3-3f7573c25347 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:24.923024 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ec8657-00d3-496c-92a3-3f7573c25347 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:24.929648 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ec8657-00d3-496c-92a3-3f7573c25347 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:24.947488 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1397/2762] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:24:24 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:24:24.951644 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7451279c-ee55-47e0-9577-9bd96c3fe641 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:24.964271 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7451279c-ee55-47e0-9577-9bd96c3fe641 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:24.972024 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb6ab8f-6110-4584-9bb3-bbf846d4dc05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:24.973408 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb6ab8f-6110-4584-9bb3-bbf846d4dc05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:24.973787 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb6ab8f-6110-4584-9bb3-bbf846d4dc05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:24.974236 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb6ab8f-6110-4584-9bb3-bbf846d4dc05 admin admin] PATH_INFO: `/v3/projects/daf30f6331b74d40aa344d35053d0d98/users/605437a314d74faabe18a36861a0ddc6/roles/965049e7ce6144aaad23c15f3a5e37c3` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:24.997338 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb6ab8f-6110-4584-9bb3-bbf846d4dc05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=daf30f6331b74d40aa344d35053d0d98, user_id=605437a314d74faabe18a36861a0ddc6, role_id=965049e7ce6144aaad23c15f3a5e37c3)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:25.000945 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb6ab8f-6110-4584-9bb3-bbf846d4dc05 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:25.027599 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1366/2763] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:24:24 2022] PUT /identity/v3/projects/daf30f6331b74d40aa344d35053d0d98/users/605437a314d74faabe18a36861a0ddc6/roles/965049e7ce6144aaad23c15f3a5e37c3 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:24:25.031694 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec8657-00d3-496c-92a3-3f7573c25347 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:25.043280 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec8657-00d3-496c-92a3-3f7573c25347 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:25.136873 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653cd9ea-1761-4284-8741-cb49ff5ef159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:25.138256 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653cd9ea-1761-4284-8741-cb49ff5ef159 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:25.140640 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653cd9ea-1761-4284-8741-cb49ff5ef159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:25.140640 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653cd9ea-1761-4284-8741-cb49ff5ef159 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:25.141407 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653cd9ea-1761-4284-8741-cb49ff5ef159 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:25.144600 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653cd9ea-1761-4284-8741-cb49ff5ef159 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:25.147497 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:24:25.166930 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1398/2764] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:24:25 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:24:25.168001 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb6ab8f-6110-4584-9bb3-bbf846d4dc05 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:25.187229 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb6ab8f-6110-4584-9bb3-bbf846d4dc05 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:25.199100 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d981932-64b0-4a49-aeed-e1abf5af755d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:25.200390 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d981932-64b0-4a49-aeed-e1abf5af755d admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:25.200820 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d981932-64b0-4a49-aeed-e1abf5af755d admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:25.201115 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d981932-64b0-4a49-aeed-e1abf5af755d admin admin] PATH_INFO: `/v3/projects/daf30f6331b74d40aa344d35053d0d98/users/605437a314d74faabe18a36861a0ddc6/roles/965049e7ce6144aaad23c15f3a5e37c3` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:25.207770 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d981932-64b0-4a49-aeed-e1abf5af755d admin admin] RBAC: Authorizing `identity:create_grant(project_id=daf30f6331b74d40aa344d35053d0d98, user_id=605437a314d74faabe18a36861a0ddc6, role_id=965049e7ce6144aaad23c15f3a5e37c3)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:25.228603 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d981932-64b0-4a49-aeed-e1abf5af755d admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:25.259422 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1367/2765] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:24:25 2022] PUT /identity/v3/projects/daf30f6331b74d40aa344d35053d0d98/users/605437a314d74faabe18a36861a0ddc6/roles/965049e7ce6144aaad23c15f3a5e37c3 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:24:29.185928 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653cd9ea-1761-4284-8741-cb49ff5ef159 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:29.188541 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-653cd9ea-1761-4284-8741-cb49ff5ef159 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:29.259934 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653cd9ea-1761-4284-8741-cb49ff5ef159 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:29.323391 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac6771-8a04-4c7c-bfc3-2fc04e48075c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:29.324515 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac6771-8a04-4c7c-bfc3-2fc04e48075c service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:29.324731 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac6771-8a04-4c7c-bfc3-2fc04e48075c service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:29.324937 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac6771-8a04-4c7c-bfc3-2fc04e48075c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:29.327520 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-2dac6771-8a04-4c7c-bfc3-2fc04e48075c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:29.438933 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dac6771-8a04-4c7c-bfc3-2fc04e48075c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:29.440455 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dac6771-8a04-4c7c-bfc3-2fc04e48075c service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:29.453883 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1399/2766] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:24:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:24:30.510812 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a1ee0-7de8-4e54-9e33-f10902e064ab None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:30.511492 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a1ee0-7de8-4e54-9e33-f10902e064ab None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:30.511492 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a1ee0-7de8-4e54-9e33-f10902e064ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:30.542477 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-f91a1ee0-7de8-4e54-9e33-f10902e064ab None None] MFA Rules not processed for user `605437a314d74faabe18a36861a0ddc6`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:24:30.544109 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f91a1ee0-7de8-4e54-9e33-f10902e064ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:30.648109 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1368/2767] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:24:30 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:24:30.655486 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac6771-8a04-4c7c-bfc3-2fc04e48075c service neutron] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:30.657033 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-2dac6771-8a04-4c7c-bfc3-2fc04e48075c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:30.768355 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:24:30.778006 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac6771-8a04-4c7c-bfc3-2fc04e48075c service neutron] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:30.785445 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abfb2f8-d539-41d8-a344-30ead79a80d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3b6e252a8c434a99432bcece6493b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:30.786283 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abfb2f8-d539-41d8-a344-30ead79a80d4 service nova] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:30.786635 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abfb2f8-d539-41d8-a344-30ead79a80d4 service nova] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:30.787189 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abfb2f8-d539-41d8-a344-30ead79a80d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:30.862481 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abfb2f8-d539-41d8-a344-30ead79a80d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:30.864377 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abfb2f8-d539-41d8-a344-30ead79a80d4 service nova] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:30.875946 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1400/2768] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:24:30 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:24:32.375993 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba79fd-308d-4f46-8f8d-13fc148607f0 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:32.376547 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba79fd-308d-4f46-8f8d-13fc148607f0 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:32.376787 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba79fd-308d-4f46-8f8d-13fc148607f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:32.396158 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-4aba79fd-308d-4f46-8f8d-13fc148607f0 None None] MFA Rules not processed for user `9e90ac63942941da8f8cd00e874613a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:24:32.397381 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-4aba79fd-308d-4f46-8f8d-13fc148607f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:32.404497 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1369/2769] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:24:32 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:24:33.733412 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abfb2f8-d539-41d8-a344-30ead79a80d4 service nova] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:33.735362 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-5abfb2f8-d539-41d8-a344-30ead79a80d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:33.787421 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aba79fd-308d-4f46-8f8d-13fc148607f0 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:33.789573 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-4aba79fd-308d-4f46-8f8d-13fc148607f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:33.806512 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aba79fd-308d-4f46-8f8d-13fc148607f0 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:33.811546 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c39b58-4ebf-404d-80a0-92080d287f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:33.812513 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c39b58-4ebf-404d-80a0-92080d287f62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:33.812817 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c39b58-4ebf-404d-80a0-92080d287f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:33.813118 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c39b58-4ebf-404d-80a0-92080d287f62 admin admin] PATH_INFO: `/v3/users/34b5671b702a4d369463b45fb5dbe07a` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:33.814306 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c39b58-4ebf-404d-80a0-92080d287f62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34b5671b702a4d369463b45fb5dbe07a)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:33.816359 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c39b58-4ebf-404d-80a0-92080d287f62 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:33.828864 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abfb2f8-d539-41d8-a344-30ead79a80d4 service nova] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:33.833879 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318813ca-a544-4dea-b801-4bc865c36954 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46ec1a2091f1434cabc69066eb3b6725', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:33.834618 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318813ca-a544-4dea-b801-4bc865c36954 service placement] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:33.834887 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318813ca-a544-4dea-b801-4bc865c36954 service placement] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:33.835162 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318813ca-a544-4dea-b801-4bc865c36954 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:33.837147 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-318813ca-a544-4dea-b801-4bc865c36954 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:33.851249 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318813ca-a544-4dea-b801-4bc865c36954 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:33.853355 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318813ca-a544-4dea-b801-4bc865c36954 service placement] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:33.865366 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1401/2770] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:24:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:24:33.872268 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b9c39b58-4ebf-404d-80a0-92080d287f62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34b5671b702a4d369463b45fb5dbe07a'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:33.872954 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b9c39b58-4ebf-404d-80a0-92080d287f62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34b5671b702a4d369463b45fb5dbe07a'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:33.881916 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b9c39b58-4ebf-404d-80a0-92080d287f62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34b5671b702a4d369463b45fb5dbe07a'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:33.882616 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b9c39b58-4ebf-404d-80a0-92080d287f62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34b5671b702a4d369463b45fb5dbe07a'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:33.900241 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=85,keystone:INSERT=6,keystone:DELETE=9 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:24:33.906546 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b9c39b58-4ebf-404d-80a0-92080d287f62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34b5671b702a4d369463b45fb5dbe07a'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:33.920274 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1370/2771] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:24:33 2022] DELETE /identity/v3/users/34b5671b702a4d369463b45fb5dbe07a => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:24:34.115089 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318813ca-a544-4dea-b801-4bc865c36954 service placement] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:34.128703 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318813ca-a544-4dea-b801-4bc865c36954 service placement] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:34.204607 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b0884a-5b8c-4c2f-9faf-c5397e1c37ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:34.205483 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b0884a-5b8c-4c2f-9faf-c5397e1c37ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:34.205770 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b0884a-5b8c-4c2f-9faf-c5397e1c37ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:34.206081 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b0884a-5b8c-4c2f-9faf-c5397e1c37ab admin admin] PATH_INFO: `/v3/projects/17c43e06ebe740af9b4fe4678526ef7a` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:34.207450 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b0884a-5b8c-4c2f-9faf-c5397e1c37ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=17c43e06ebe740af9b4fe4678526ef7a)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:34.209464 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b0884a-5b8c-4c2f-9faf-c5397e1c37ab admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:34.253327 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:24:34.269126 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-40b0884a-5b8c-4c2f-9faf-c5397e1c37ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17c43e06ebe740af9b4fe4678526ef7a', 'request_id': 'req-40b0884a-5b8c-4c2f-9faf-c5397e1c37ab'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:34.278328 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-40b0884a-5b8c-4c2f-9faf-c5397e1c37ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17c43e06ebe740af9b4fe4678526ef7a', 'request_id': 'req-40b0884a-5b8c-4c2f-9faf-c5397e1c37ab'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:34.284896 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-40b0884a-5b8c-4c2f-9faf-c5397e1c37ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17c43e06ebe740af9b4fe4678526ef7a', 'request_id': 'req-40b0884a-5b8c-4c2f-9faf-c5397e1c37ab'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:34.298047 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-40b0884a-5b8c-4c2f-9faf-c5397e1c37ab admin admin] The token cache is being invalidate because project 17c43e06ebe740af9b4fe4678526ef7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:24:34.298393 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-40b0884a-5b8c-4c2f-9faf-c5397e1c37ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:34.299202 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-40b0884a-5b8c-4c2f-9faf-c5397e1c37ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:34.300958 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1402/2772] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:24:34 2022] DELETE /identity/v3/projects/17c43e06ebe740af9b4fe4678526ef7a => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:24:34.306097 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec983c7-b7f3-4b69-b365-8030f69f0521 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:34.306418 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec983c7-b7f3-4b69-b365-8030f69f0521 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:34.306749 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec983c7-b7f3-4b69-b365-8030f69f0521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:34.331764 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-eec983c7-b7f3-4b69-b365-8030f69f0521 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:24:34.333097 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-eec983c7-b7f3-4b69-b365-8030f69f0521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:34.403544 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1371/2773] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:24:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:24:34.411788 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b844ed-7902-4a5b-bdcf-99b08b185e56 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:34.412133 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b844ed-7902-4a5b-bdcf-99b08b185e56 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:34.412417 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b844ed-7902-4a5b-bdcf-99b08b185e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:34.437343 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-e2b844ed-7902-4a5b-bdcf-99b08b185e56 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:24:34.438589 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-e2b844ed-7902-4a5b-bdcf-99b08b185e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:34.446836 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1403/2774] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:24:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:24:34.451367 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec983c7-b7f3-4b69-b365-8030f69f0521 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:34.461432 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec983c7-b7f3-4b69-b365-8030f69f0521 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:34.466416 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559f79dd-e9eb-4599-8903-b47ee6830fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:34.467548 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f79dd-e9eb-4599-8903-b47ee6830fe0 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:34.467992 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f79dd-e9eb-4599-8903-b47ee6830fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:34.468124 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f79dd-e9eb-4599-8903-b47ee6830fe0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:34.469277 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559f79dd-e9eb-4599-8903-b47ee6830fe0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:24:34.469519 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559f79dd-e9eb-4599-8903-b47ee6830fe0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:34.471236 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559f79dd-e9eb-4599-8903-b47ee6830fe0 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:34.483941 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1372/2775] 10.222.0.42 () {58 vars in 1152 bytes} [Mon Jul 4 09:24:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:24:34.488661 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b844ed-7902-4a5b-bdcf-99b08b185e56 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:34.498503 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b844ed-7902-4a5b-bdcf-99b08b185e56 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:34.503243 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9cd0c4-1ed6-494e-892a-2445d191cd62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:34.503939 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9cd0c4-1ed6-494e-892a-2445d191cd62 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:34.504229 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9cd0c4-1ed6-494e-892a-2445d191cd62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:34.504509 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9cd0c4-1ed6-494e-892a-2445d191cd62 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:34.505208 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9cd0c4-1ed6-494e-892a-2445d191cd62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:34.507250 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9cd0c4-1ed6-494e-892a-2445d191cd62 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:34.536154 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1404/2776] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:24:34 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:24:34.540313 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559f79dd-e9eb-4599-8903-b47ee6830fe0 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:34.551196 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559f79dd-e9eb-4599-8903-b47ee6830fe0 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:34.616608 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa0c444-a19a-425b-88e1-e6dba3bff103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:34.617291 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa0c444-a19a-425b-88e1-e6dba3bff103 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:34.617572 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa0c444-a19a-425b-88e1-e6dba3bff103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:34.617845 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa0c444-a19a-425b-88e1-e6dba3bff103 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:34.618550 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa0c444-a19a-425b-88e1-e6dba3bff103 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:34.620532 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa0c444-a19a-425b-88e1-e6dba3bff103 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:34.645707 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1373/2777] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:24:34 2022] POST /identity/v3/users => generated 291 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:24:34.651198 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9cd0c4-1ed6-494e-892a-2445d191cd62 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:34.662589 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9cd0c4-1ed6-494e-892a-2445d191cd62 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:34.668201 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03850739-7560-4fba-b160-d681e7d2b37f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:34.669131 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03850739-7560-4fba-b160-d681e7d2b37f admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:34.669556 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03850739-7560-4fba-b160-d681e7d2b37f admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:34.670023 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03850739-7560-4fba-b160-d681e7d2b37f admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:34.670966 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03850739-7560-4fba-b160-d681e7d2b37f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:34.672843 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03850739-7560-4fba-b160-d681e7d2b37f admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:34.689773 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1405/2778] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:24:34 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:24:34.694077 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa0c444-a19a-425b-88e1-e6dba3bff103 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:34.707788 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa0c444-a19a-425b-88e1-e6dba3bff103 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:34.713903 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7c676e-c01a-4c31-b03c-c4554e958d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:34.715424 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c676e-c01a-4c31-b03c-c4554e958d90 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:34.715424 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c676e-c01a-4c31-b03c-c4554e958d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:34.715424 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c676e-c01a-4c31-b03c-c4554e958d90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:34.715900 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7c676e-c01a-4c31-b03c-c4554e958d90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:34.717649 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7c676e-c01a-4c31-b03c-c4554e958d90 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:34.728533 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1374/2779] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:24:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:24:34.733362 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03850739-7560-4fba-b160-d681e7d2b37f admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:34.745580 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03850739-7560-4fba-b160-d681e7d2b37f admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:34.751097 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acefd047-6518-4d1f-b858-b70a5f61374b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:34.752349 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acefd047-6518-4d1f-b858-b70a5f61374b admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:34.752719 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acefd047-6518-4d1f-b858-b70a5f61374b admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:34.753074 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acefd047-6518-4d1f-b858-b70a5f61374b admin admin] PATH_INFO: `/v3/projects/075d90f9c4674254ace8960cb72ec358/users/5239da8c97d34e0086940c452642dc20/roles/81634e7812344f84afcb29b0dba2687c` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:34.771442 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acefd047-6518-4d1f-b858-b70a5f61374b admin admin] RBAC: Authorizing `identity:create_grant(project_id=075d90f9c4674254ace8960cb72ec358, user_id=5239da8c97d34e0086940c452642dc20, role_id=81634e7812344f84afcb29b0dba2687c)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:34.774384 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acefd047-6518-4d1f-b858-b70a5f61374b admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:34.792949 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1406/2780] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:24:34 2022] PUT /identity/v3/projects/075d90f9c4674254ace8960cb72ec358/users/5239da8c97d34e0086940c452642dc20/roles/81634e7812344f84afcb29b0dba2687c => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:24:34.803136 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854edb17-5653-4493-83d2-fa6670b1613b None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:34.803658 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854edb17-5653-4493-83d2-fa6670b1613b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:34.803778 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854edb17-5653-4493-83d2-fa6670b1613b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:34.840952 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-854edb17-5653-4493-83d2-fa6670b1613b None None] MFA Rules not processed for user `5239da8c97d34e0086940c452642dc20`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:24:34.842311 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-854edb17-5653-4493-83d2-fa6670b1613b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:34.904671 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:24:34.942193 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1375/2781] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:24:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:24:34.947293 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acefd047-6518-4d1f-b858-b70a5f61374b admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:35.100301 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acefd047-6518-4d1f-b858-b70a5f61374b admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:35.106498 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef624ad-ce42-4def-8c41-8bce5c54bfb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:35.107752 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef624ad-ce42-4def-8c41-8bce5c54bfb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:35.108412 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef624ad-ce42-4def-8c41-8bce5c54bfb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:35.108913 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef624ad-ce42-4def-8c41-8bce5c54bfb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:35.109863 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef624ad-ce42-4def-8c41-8bce5c54bfb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:35.112266 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef624ad-ce42-4def-8c41-8bce5c54bfb2 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:35.144722 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1407/2782] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:24:34 2022] POST /identity/v3/projects => generated 379 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:24:35.148439 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854edb17-5653-4493-83d2-fa6670b1613b None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:35.160406 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854edb17-5653-4493-83d2-fa6670b1613b None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:35.224365 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74020e16-192f-43ef-af14-e36b59eeaf7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:35.225059 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74020e16-192f-43ef-af14-e36b59eeaf7b admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:35.225336 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74020e16-192f-43ef-af14-e36b59eeaf7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:35.225604 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74020e16-192f-43ef-af14-e36b59eeaf7b admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:35.226324 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74020e16-192f-43ef-af14-e36b59eeaf7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:35.228830 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74020e16-192f-43ef-af14-e36b59eeaf7b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:35.271587 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1376/2783] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:24:35 2022] POST /identity/v3/users => generated 296 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:24:35.276720 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef624ad-ce42-4def-8c41-8bce5c54bfb2 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:35.296699 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef624ad-ce42-4def-8c41-8bce5c54bfb2 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:35.302177 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcd289c-5a1f-473a-ac55-09cdd607ff12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:35.302880 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd289c-5a1f-473a-ac55-09cdd607ff12 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:35.303167 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd289c-5a1f-473a-ac55-09cdd607ff12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:35.303451 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd289c-5a1f-473a-ac55-09cdd607ff12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:35.304273 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcd289c-5a1f-473a-ac55-09cdd607ff12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:35.305919 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcd289c-5a1f-473a-ac55-09cdd607ff12 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:35.320110 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1408/2784] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:24:35 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:24:35.322286 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74020e16-192f-43ef-af14-e36b59eeaf7b admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:35.333986 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74020e16-192f-43ef-af14-e36b59eeaf7b admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:35.339074 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d815cd-e7e6-48bb-a005-2a5e5f5876b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:35.340030 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d815cd-e7e6-48bb-a005-2a5e5f5876b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:35.340310 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d815cd-e7e6-48bb-a005-2a5e5f5876b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:35.340592 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d815cd-e7e6-48bb-a005-2a5e5f5876b0 admin admin] PATH_INFO: `/v3/projects/3a52155c074a42248c13f33706b7290f/users/6a4649a11b3440dfbc181abadd36ca96/roles/965049e7ce6144aaad23c15f3a5e37c3` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:35.362607 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d815cd-e7e6-48bb-a005-2a5e5f5876b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a52155c074a42248c13f33706b7290f, user_id=6a4649a11b3440dfbc181abadd36ca96, role_id=965049e7ce6144aaad23c15f3a5e37c3)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:35.365427 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d815cd-e7e6-48bb-a005-2a5e5f5876b0 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:35.380999 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1377/2785] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:24:35 2022] PUT /identity/v3/projects/3a52155c074a42248c13f33706b7290f/users/6a4649a11b3440dfbc181abadd36ca96/roles/965049e7ce6144aaad23c15f3a5e37c3 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:24:35.385176 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcd289c-5a1f-473a-ac55-09cdd607ff12 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:35.398071 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcd289c-5a1f-473a-ac55-09cdd607ff12 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:35.444585 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:24:35.480650 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83f0fed-a913-49b4-b45e-72ed65d496e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:35.481364 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f0fed-a913-49b4-b45e-72ed65d496e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:35.481689 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f0fed-a913-49b4-b45e-72ed65d496e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:35.482306 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f0fed-a913-49b4-b45e-72ed65d496e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:35.483110 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83f0fed-a913-49b4-b45e-72ed65d496e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:35.484957 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83f0fed-a913-49b4-b45e-72ed65d496e7 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:35.500897 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1409/2786] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:24:35 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:24:35.504803 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d815cd-e7e6-48bb-a005-2a5e5f5876b0 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:35.524363 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d815cd-e7e6-48bb-a005-2a5e5f5876b0 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:35.532189 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4105845d-0de2-40c0-9274-5071a23c626c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:35.533348 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4105845d-0de2-40c0-9274-5071a23c626c admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:35.533694 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4105845d-0de2-40c0-9274-5071a23c626c admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:35.533971 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4105845d-0de2-40c0-9274-5071a23c626c admin admin] PATH_INFO: `/v3/projects/3a52155c074a42248c13f33706b7290f/users/6a4649a11b3440dfbc181abadd36ca96/roles/965049e7ce6144aaad23c15f3a5e37c3` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:35.536630 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4105845d-0de2-40c0-9274-5071a23c626c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a52155c074a42248c13f33706b7290f, user_id=6a4649a11b3440dfbc181abadd36ca96, role_id=965049e7ce6144aaad23c15f3a5e37c3)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:35.539529 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4105845d-0de2-40c0-9274-5071a23c626c admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:35.552155 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1378/2787] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:24:35 2022] PUT /identity/v3/projects/3a52155c074a42248c13f33706b7290f/users/6a4649a11b3440dfbc181abadd36ca96/roles/965049e7ce6144aaad23c15f3a5e37c3 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:24:35.570969 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1781cbf3-2170-48a8-9648-bd18aeb1359d None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:35.571434 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1781cbf3-2170-48a8-9648-bd18aeb1359d None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:35.571745 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1781cbf3-2170-48a8-9648-bd18aeb1359d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:35.619298 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-1781cbf3-2170-48a8-9648-bd18aeb1359d None None] MFA Rules not processed for user `6a4649a11b3440dfbc181abadd36ca96`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:24:35.620684 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-1781cbf3-2170-48a8-9648-bd18aeb1359d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:35.744905 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1410/2788] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:24:35 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:24:35.760694 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4105845d-0de2-40c0-9274-5071a23c626c admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:35.762892 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-4105845d-0de2-40c0-9274-5071a23c626c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:35.845485 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4105845d-0de2-40c0-9274-5071a23c626c admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:35.853788 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff2b2cf-6b7a-4378-8a4a-485d0f35df72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f86373d65440da97c853fff3c1d0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:35.854666 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2b2cf-6b7a-4378-8a4a-485d0f35df72 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:35.854953 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2b2cf-6b7a-4378-8a4a-485d0f35df72 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:35.855398 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2b2cf-6b7a-4378-8a4a-485d0f35df72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:35.868001 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff2b2cf-6b7a-4378-8a4a-485d0f35df72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:35.868844 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff2b2cf-6b7a-4378-8a4a-485d0f35df72 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:35.880432 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1379/2789] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:24:35 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:24:36.339805 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1781cbf3-2170-48a8-9648-bd18aeb1359d None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:36.352319 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1781cbf3-2170-48a8-9648-bd18aeb1359d None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:36.357367 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7da4783-f80e-4853-930f-129891b8bfa1 tempest-VolumeQuotaClassesTest-337633931 tempest-VolumeQuotaClassesTest-337633931-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a4649a11b3440dfbc181abadd36ca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a52155c074a42248c13f33706b7290f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:36.358039 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da4783-f80e-4853-930f-129891b8bfa1 tempest-VolumeQuotaClassesTest-337633931 tempest-VolumeQuotaClassesTest-337633931-project-admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:36.358327 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da4783-f80e-4853-930f-129891b8bfa1 tempest-VolumeQuotaClassesTest-337633931 tempest-VolumeQuotaClassesTest-337633931-project-admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:36.358627 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da4783-f80e-4853-930f-129891b8bfa1 tempest-VolumeQuotaClassesTest-337633931 tempest-VolumeQuotaClassesTest-337633931-project-admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:36.359365 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7da4783-f80e-4853-930f-129891b8bfa1 tempest-VolumeQuotaClassesTest-337633931 tempest-VolumeQuotaClassesTest-337633931-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:24:36.359673 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7da4783-f80e-4853-930f-129891b8bfa1 tempest-VolumeQuotaClassesTest-337633931 tempest-VolumeQuotaClassesTest-337633931-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:36.361326 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7da4783-f80e-4853-930f-129891b8bfa1 tempest-VolumeQuotaClassesTest-337633931 tempest-VolumeQuotaClassesTest-337633931-project-admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:36.386875 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1411/2790] 10.222.0.42 () {58 vars in 1152 bytes} [Mon Jul 4 09:24:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:24:36.388205 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff2b2cf-6b7a-4378-8a4a-485d0f35df72 service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:36.398762 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff2b2cf-6b7a-4378-8a4a-485d0f35df72 service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:36.404771 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5ed527-248a-4a9f-8f9d-1644c55501c1 tempest-VolumeQuotaClassesTest-337633931 tempest-VolumeQuotaClassesTest-337633931-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a4649a11b3440dfbc181abadd36ca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a52155c074a42248c13f33706b7290f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:36.405468 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ed527-248a-4a9f-8f9d-1644c55501c1 tempest-VolumeQuotaClassesTest-337633931 tempest-VolumeQuotaClassesTest-337633931-project-admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:36.405754 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ed527-248a-4a9f-8f9d-1644c55501c1 tempest-VolumeQuotaClassesTest-337633931 tempest-VolumeQuotaClassesTest-337633931-project-admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:36.406160 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ed527-248a-4a9f-8f9d-1644c55501c1 tempest-VolumeQuotaClassesTest-337633931 tempest-VolumeQuotaClassesTest-337633931-project-admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:36.406740 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5ed527-248a-4a9f-8f9d-1644c55501c1 tempest-VolumeQuotaClassesTest-337633931 tempest-VolumeQuotaClassesTest-337633931-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:36.408892 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5ed527-248a-4a9f-8f9d-1644c55501c1 tempest-VolumeQuotaClassesTest-337633931 tempest-VolumeQuotaClassesTest-337633931-project-admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:36.447763 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1380/2791] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:24:36 2022] POST /identity/v3/projects => generated 353 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:24:36.451764 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7da4783-f80e-4853-930f-129891b8bfa1 tempest-VolumeQuotaClassesTest-337633931 tempest-VolumeQuotaClassesTest-337633931-project-admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:36.462977 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7da4783-f80e-4853-930f-129891b8bfa1 tempest-VolumeQuotaClassesTest-337633931 tempest-VolumeQuotaClassesTest-337633931-project-admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:36.567607 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2500d43c-6feb-408b-ac12-3d5c078f5b59 tempest-VolumeQuotaClassesTest-337633931 tempest-VolumeQuotaClassesTest-337633931-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a4649a11b3440dfbc181abadd36ca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a52155c074a42248c13f33706b7290f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:36.568942 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500d43c-6feb-408b-ac12-3d5c078f5b59 tempest-VolumeQuotaClassesTest-337633931 tempest-VolumeQuotaClassesTest-337633931-project-admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:36.569576 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500d43c-6feb-408b-ac12-3d5c078f5b59 tempest-VolumeQuotaClassesTest-337633931 tempest-VolumeQuotaClassesTest-337633931-project-admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:36.569950 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500d43c-6feb-408b-ac12-3d5c078f5b59 tempest-VolumeQuotaClassesTest-337633931 tempest-VolumeQuotaClassesTest-337633931-project-admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:36.570918 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2500d43c-6feb-408b-ac12-3d5c078f5b59 tempest-VolumeQuotaClassesTest-337633931 tempest-VolumeQuotaClassesTest-337633931-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:24:36.572045 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2500d43c-6feb-408b-ac12-3d5c078f5b59 tempest-VolumeQuotaClassesTest-337633931 tempest-VolumeQuotaClassesTest-337633931-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:36.575597 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2500d43c-6feb-408b-ac12-3d5c078f5b59 tempest-VolumeQuotaClassesTest-337633931 tempest-VolumeQuotaClassesTest-337633931-project-admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:36.591342 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1412/2792] 10.222.0.42 () {58 vars in 1152 bytes} [Mon Jul 4 09:24:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:24:36.645095 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5ed527-248a-4a9f-8f9d-1644c55501c1 tempest-VolumeQuotaClassesTest-337633931 tempest-VolumeQuotaClassesTest-337633931-project-admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:36.657434 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5ed527-248a-4a9f-8f9d-1644c55501c1 tempest-VolumeQuotaClassesTest-337633931 tempest-VolumeQuotaClassesTest-337633931-project-admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:36.666483 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174e2a57-1706-4dc8-bcdf-dd34a9a5c61f tempest-VolumeQuotaClassesTest-337633931 tempest-VolumeQuotaClassesTest-337633931-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a4649a11b3440dfbc181abadd36ca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a52155c074a42248c13f33706b7290f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:36.667376 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e2a57-1706-4dc8-bcdf-dd34a9a5c61f tempest-VolumeQuotaClassesTest-337633931 tempest-VolumeQuotaClassesTest-337633931-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:36.667663 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e2a57-1706-4dc8-bcdf-dd34a9a5c61f tempest-VolumeQuotaClassesTest-337633931 tempest-VolumeQuotaClassesTest-337633931-project-admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:36.668639 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e2a57-1706-4dc8-bcdf-dd34a9a5c61f tempest-VolumeQuotaClassesTest-337633931 tempest-VolumeQuotaClassesTest-337633931-project-admin] PATH_INFO: `/v3/projects/d466349f7dcd486d80a76089d87cf632` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:36.670668 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174e2a57-1706-4dc8-bcdf-dd34a9a5c61f tempest-VolumeQuotaClassesTest-337633931 tempest-VolumeQuotaClassesTest-337633931-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d466349f7dcd486d80a76089d87cf632)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:36.672570 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174e2a57-1706-4dc8-bcdf-dd34a9a5c61f tempest-VolumeQuotaClassesTest-337633931 tempest-VolumeQuotaClassesTest-337633931-project-admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:36.680696 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:24:36.730753 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-174e2a57-1706-4dc8-bcdf-dd34a9a5c61f tempest-VolumeQuotaClassesTest-337633931 tempest-VolumeQuotaClassesTest-337633931-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd466349f7dcd486d80a76089d87cf632', 'request_id': 'req-174e2a57-1706-4dc8-bcdf-dd34a9a5c61f'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:36.737956 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-174e2a57-1706-4dc8-bcdf-dd34a9a5c61f tempest-VolumeQuotaClassesTest-337633931 tempest-VolumeQuotaClassesTest-337633931-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd466349f7dcd486d80a76089d87cf632', 'request_id': 'req-174e2a57-1706-4dc8-bcdf-dd34a9a5c61f'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:36.747759 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-174e2a57-1706-4dc8-bcdf-dd34a9a5c61f tempest-VolumeQuotaClassesTest-337633931 tempest-VolumeQuotaClassesTest-337633931-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd466349f7dcd486d80a76089d87cf632', 'request_id': 'req-174e2a57-1706-4dc8-bcdf-dd34a9a5c61f'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:36.759167 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-174e2a57-1706-4dc8-bcdf-dd34a9a5c61f tempest-VolumeQuotaClassesTest-337633931 tempest-VolumeQuotaClassesTest-337633931-project-admin] The token cache is being invalidate because project d466349f7dcd486d80a76089d87cf632 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:24:36.759425 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-174e2a57-1706-4dc8-bcdf-dd34a9a5c61f tempest-VolumeQuotaClassesTest-337633931 tempest-VolumeQuotaClassesTest-337633931-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:36.760124 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-174e2a57-1706-4dc8-bcdf-dd34a9a5c61f tempest-VolumeQuotaClassesTest-337633931 tempest-VolumeQuotaClassesTest-337633931-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:36.761726 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1381/2793] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:24:36 2022] DELETE /identity/v3/projects/d466349f7dcd486d80a76089d87cf632 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:24:36.974516 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2500d43c-6feb-408b-ac12-3d5c078f5b59 tempest-VolumeQuotaClassesTest-337633931 tempest-VolumeQuotaClassesTest-337633931-project-admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:36.976505 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-2500d43c-6feb-408b-ac12-3d5c078f5b59 tempest-VolumeQuotaClassesTest-337633931 tempest-VolumeQuotaClassesTest-337633931-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:37.020531 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:24:37.054846 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2500d43c-6feb-408b-ac12-3d5c078f5b59 tempest-VolumeQuotaClassesTest-337633931 tempest-VolumeQuotaClassesTest-337633931-project-admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:37.118856 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601d4acf-11c7-4c5e-b166-c072b9433eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:37.119960 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d4acf-11c7-4c5e-b166-c072b9433eb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:37.120243 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d4acf-11c7-4c5e-b166-c072b9433eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:37.120525 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d4acf-11c7-4c5e-b166-c072b9433eb6 admin admin] PATH_INFO: `/v3/users/5239da8c97d34e0086940c452642dc20` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:37.121721 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601d4acf-11c7-4c5e-b166-c072b9433eb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5239da8c97d34e0086940c452642dc20)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:37.123986 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601d4acf-11c7-4c5e-b166-c072b9433eb6 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:37.179984 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-601d4acf-11c7-4c5e-b166-c072b9433eb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5239da8c97d34e0086940c452642dc20'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:37.188330 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-601d4acf-11c7-4c5e-b166-c072b9433eb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5239da8c97d34e0086940c452642dc20'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:37.188953 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-601d4acf-11c7-4c5e-b166-c072b9433eb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5239da8c97d34e0086940c452642dc20'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:37.189552 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-601d4acf-11c7-4c5e-b166-c072b9433eb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5239da8c97d34e0086940c452642dc20'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:37.205076 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-601d4acf-11c7-4c5e-b166-c072b9433eb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5239da8c97d34e0086940c452642dc20'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:37.218272 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1413/2794] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:24:36 2022] DELETE /identity/v3/users/5239da8c97d34e0086940c452642dc20 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:24:37.223297 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd2993c-a1a6-43f8-b1e2-7c567bf07836 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:37.223811 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd2993c-a1a6-43f8-b1e2-7c567bf07836 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:37.223943 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd2993c-a1a6-43f8-b1e2-7c567bf07836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:37.250612 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-4cd2993c-a1a6-43f8-b1e2-7c567bf07836 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:24:37.251856 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-4cd2993c-a1a6-43f8-b1e2-7c567bf07836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:37.318913 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1382/2795] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:24:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:24:37.329610 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601d4acf-11c7-4c5e-b166-c072b9433eb6 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:37.332202 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-601d4acf-11c7-4c5e-b166-c072b9433eb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:37.396363 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601d4acf-11c7-4c5e-b166-c072b9433eb6 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:37.400545 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b3d3fd-6fbc-4c24-93ba-a5a43c5dcdf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:37.401202 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b3d3fd-6fbc-4c24-93ba-a5a43c5dcdf9 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:37.401538 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b3d3fd-6fbc-4c24-93ba-a5a43c5dcdf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:37.401819 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b3d3fd-6fbc-4c24-93ba-a5a43c5dcdf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:37.411769 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b3d3fd-6fbc-4c24-93ba-a5a43c5dcdf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:37.413288 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b3d3fd-6fbc-4c24-93ba-a5a43c5dcdf9 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:37.423918 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1414/2796] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:24:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:24:37.736973 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd2993c-a1a6-43f8-b1e2-7c567bf07836 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:37.744092 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-4cd2993c-a1a6-43f8-b1e2-7c567bf07836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:37.777637 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd2993c-a1a6-43f8-b1e2-7c567bf07836 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:37.790070 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e4ba1b-b143-4357-b8dd-71a8ff671989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:37.790609 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e4ba1b-b143-4357-b8dd-71a8ff671989 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:37.791056 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e4ba1b-b143-4357-b8dd-71a8ff671989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:37.791480 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e4ba1b-b143-4357-b8dd-71a8ff671989 admin admin] PATH_INFO: `/v3/projects/075d90f9c4674254ace8960cb72ec358` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:37.793042 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e4ba1b-b143-4357-b8dd-71a8ff671989 admin admin] RBAC: Authorizing `identity:delete_project(project_id=075d90f9c4674254ace8960cb72ec358)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:37.795062 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e4ba1b-b143-4357-b8dd-71a8ff671989 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:37.857097 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-22e4ba1b-b143-4357-b8dd-71a8ff671989 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '075d90f9c4674254ace8960cb72ec358', 'request_id': 'req-22e4ba1b-b143-4357-b8dd-71a8ff671989'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:37.864765 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-22e4ba1b-b143-4357-b8dd-71a8ff671989 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '075d90f9c4674254ace8960cb72ec358', 'request_id': 'req-22e4ba1b-b143-4357-b8dd-71a8ff671989'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:37.878113 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-22e4ba1b-b143-4357-b8dd-71a8ff671989 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '075d90f9c4674254ace8960cb72ec358', 'request_id': 'req-22e4ba1b-b143-4357-b8dd-71a8ff671989'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:37.896022 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-22e4ba1b-b143-4357-b8dd-71a8ff671989 admin admin] The token cache is being invalidate because project 075d90f9c4674254ace8960cb72ec358 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:24:37.896394 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-22e4ba1b-b143-4357-b8dd-71a8ff671989 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:37.897119 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-22e4ba1b-b143-4357-b8dd-71a8ff671989 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:37.898790 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1383/2797] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:24:37 2022] DELETE /identity/v3/projects/075d90f9c4674254ace8960cb72ec358 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:24:37.902998 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b3d3fd-6fbc-4c24-93ba-a5a43c5dcdf9 service neutron] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:37.908311 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:24:37.916498 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b3d3fd-6fbc-4c24-93ba-a5a43c5dcdf9 service neutron] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:37.983736 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a07c173-0efa-47fa-9b52-e1bf8f67ae26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:37.985136 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07c173-0efa-47fa-9b52-e1bf8f67ae26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:37.985647 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07c173-0efa-47fa-9b52-e1bf8f67ae26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:37.986167 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07c173-0efa-47fa-9b52-e1bf8f67ae26 admin admin] PATH_INFO: `/v3/users/6a4649a11b3440dfbc181abadd36ca96` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:37.988664 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a07c173-0efa-47fa-9b52-e1bf8f67ae26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a4649a11b3440dfbc181abadd36ca96)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:37.993178 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a07c173-0efa-47fa-9b52-e1bf8f67ae26 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:38.020547 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e4ba1b-b143-4357-b8dd-71a8ff671989 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:38.022816 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-22e4ba1b-b143-4357-b8dd-71a8ff671989 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:38.049648 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-5a07c173-0efa-47fa-9b52-e1bf8f67ae26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a4649a11b3440dfbc181abadd36ca96'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:38.054586 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:24:38.061870 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-5a07c173-0efa-47fa-9b52-e1bf8f67ae26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a4649a11b3440dfbc181abadd36ca96'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:38.062645 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-5a07c173-0efa-47fa-9b52-e1bf8f67ae26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a4649a11b3440dfbc181abadd36ca96'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:38.063331 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-5a07c173-0efa-47fa-9b52-e1bf8f67ae26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a4649a11b3440dfbc181abadd36ca96'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:38.082543 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-5a07c173-0efa-47fa-9b52-e1bf8f67ae26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a4649a11b3440dfbc181abadd36ca96'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:38.097073 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1415/2798] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:24:37 2022] DELETE /identity/v3/users/6a4649a11b3440dfbc181abadd36ca96 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:24:38.106326 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e4ba1b-b143-4357-b8dd-71a8ff671989 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:38.168724 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd790adb-185a-4726-a663-e7bcac10a04a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:38.169368 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd790adb-185a-4726-a663-e7bcac10a04a service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:38.169675 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd790adb-185a-4726-a663-e7bcac10a04a service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:38.170010 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd790adb-185a-4726-a663-e7bcac10a04a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:38.172251 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-cd790adb-185a-4726-a663-e7bcac10a04a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:38.248152 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd790adb-185a-4726-a663-e7bcac10a04a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:38.251027 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd790adb-185a-4726-a663-e7bcac10a04a service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:38.274143 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1384/2799] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:24:38 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:24:38.400475 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a07c173-0efa-47fa-9b52-e1bf8f67ae26 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:38.402084 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-5a07c173-0efa-47fa-9b52-e1bf8f67ae26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:38.489963 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a07c173-0efa-47fa-9b52-e1bf8f67ae26 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:38.495350 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b40900-0f29-4fc0-9cb5-0773db24a9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:38.496309 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b40900-0f29-4fc0-9cb5-0773db24a9b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:38.496588 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b40900-0f29-4fc0-9cb5-0773db24a9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:38.497343 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b40900-0f29-4fc0-9cb5-0773db24a9b6 admin admin] PATH_INFO: `/v3/projects/3a52155c074a42248c13f33706b7290f` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:38.498134 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b40900-0f29-4fc0-9cb5-0773db24a9b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a52155c074a42248c13f33706b7290f)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:38.500168 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b40900-0f29-4fc0-9cb5-0773db24a9b6 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:38.526057 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:24:38.554696 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-92b40900-0f29-4fc0-9cb5-0773db24a9b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a52155c074a42248c13f33706b7290f', 'request_id': 'req-92b40900-0f29-4fc0-9cb5-0773db24a9b6'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:38.562052 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-92b40900-0f29-4fc0-9cb5-0773db24a9b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a52155c074a42248c13f33706b7290f', 'request_id': 'req-92b40900-0f29-4fc0-9cb5-0773db24a9b6'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:38.568466 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-92b40900-0f29-4fc0-9cb5-0773db24a9b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a52155c074a42248c13f33706b7290f', 'request_id': 'req-92b40900-0f29-4fc0-9cb5-0773db24a9b6'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:38.580878 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-92b40900-0f29-4fc0-9cb5-0773db24a9b6 admin admin] The token cache is being invalidate because project 3a52155c074a42248c13f33706b7290f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:24:38.581168 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-92b40900-0f29-4fc0-9cb5-0773db24a9b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:38.581835 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-92b40900-0f29-4fc0-9cb5-0773db24a9b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:38.583405 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1416/2800] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:24:38 2022] DELETE /identity/v3/projects/3a52155c074a42248c13f33706b7290f => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:24:38.590551 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e97ad-c692-4206-a150-13effb0c5b4a None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:38.590998 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e97ad-c692-4206-a150-13effb0c5b4a None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:38.591347 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e97ad-c692-4206-a150-13effb0c5b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:38.610588 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-a99e97ad-c692-4206-a150-13effb0c5b4a None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:24:38.611961 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a99e97ad-c692-4206-a150-13effb0c5b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:38.679725 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1385/2801] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:24:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:24:38.688446 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19560a52-bf99-48b0-a594-2196b377fa18 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:38.688885 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19560a52-bf99-48b0-a594-2196b377fa18 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:38.689230 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19560a52-bf99-48b0-a594-2196b377fa18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:38.710157 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-19560a52-bf99-48b0-a594-2196b377fa18 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:24:38.711438 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-19560a52-bf99-48b0-a594-2196b377fa18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:38.720208 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1417/2802] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:24:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:24:38.724702 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99e97ad-c692-4206-a150-13effb0c5b4a None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:38.737429 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99e97ad-c692-4206-a150-13effb0c5b4a None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:38.743484 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40783dcb-8593-408c-a24b-82ed86e4c385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:38.744290 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40783dcb-8593-408c-a24b-82ed86e4c385 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:38.744639 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40783dcb-8593-408c-a24b-82ed86e4c385 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:38.745515 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40783dcb-8593-408c-a24b-82ed86e4c385 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:38.746295 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40783dcb-8593-408c-a24b-82ed86e4c385 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:24:38.746893 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40783dcb-8593-408c-a24b-82ed86e4c385 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:38.748589 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40783dcb-8593-408c-a24b-82ed86e4c385 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:38.761333 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1386/2803] 10.222.0.42 () {58 vars in 1152 bytes} [Mon Jul 4 09:24:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:24:38.765840 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19560a52-bf99-48b0-a594-2196b377fa18 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:38.775367 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19560a52-bf99-48b0-a594-2196b377fa18 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:38.780498 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a495cff3-a260-4787-b215-2831f984d979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:38.781295 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a495cff3-a260-4787-b215-2831f984d979 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:38.781746 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a495cff3-a260-4787-b215-2831f984d979 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:38.782080 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a495cff3-a260-4787-b215-2831f984d979 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:38.782850 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a495cff3-a260-4787-b215-2831f984d979 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:38.785274 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a495cff3-a260-4787-b215-2831f984d979 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:38.815751 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1418/2804] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:24:38 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:24:38.817048 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40783dcb-8593-408c-a24b-82ed86e4c385 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:38.830776 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40783dcb-8593-408c-a24b-82ed86e4c385 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:38.839147 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:24:38.890582 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af5edd7-8151-47c9-bc35-5412767c98c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:38.891269 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5edd7-8151-47c9-bc35-5412767c98c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:38.891557 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5edd7-8151-47c9-bc35-5412767c98c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:38.891835 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5edd7-8151-47c9-bc35-5412767c98c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:38.892583 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af5edd7-8151-47c9-bc35-5412767c98c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:38.895145 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af5edd7-8151-47c9-bc35-5412767c98c3 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:38.916461 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1387/2805] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:24:38 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:24:38.920626 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a495cff3-a260-4787-b215-2831f984d979 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:38.931342 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a495cff3-a260-4787-b215-2831f984d979 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:38.938954 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae82e65d-56c1-4502-88b9-6ab2ad4d5f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:38.939753 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82e65d-56c1-4502-88b9-6ab2ad4d5f6a admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:38.940084 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82e65d-56c1-4502-88b9-6ab2ad4d5f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:38.940370 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82e65d-56c1-4502-88b9-6ab2ad4d5f6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:38.941129 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae82e65d-56c1-4502-88b9-6ab2ad4d5f6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:38.942913 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae82e65d-56c1-4502-88b9-6ab2ad4d5f6a admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:38.958191 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1419/2806] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:24:38 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:24:38.959577 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af5edd7-8151-47c9-bc35-5412767c98c3 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:38.971226 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af5edd7-8151-47c9-bc35-5412767c98c3 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:38.976766 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4639540-3f4d-44d9-b37e-64531c4a7e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:38.977547 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4639540-3f4d-44d9-b37e-64531c4a7e6a admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:38.977902 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4639540-3f4d-44d9-b37e-64531c4a7e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:38.978247 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4639540-3f4d-44d9-b37e-64531c4a7e6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:38.979053 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4639540-3f4d-44d9-b37e-64531c4a7e6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:38.980827 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4639540-3f4d-44d9-b37e-64531c4a7e6a admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:38.991911 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1388/2807] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:24:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:24:38.995970 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae82e65d-56c1-4502-88b9-6ab2ad4d5f6a admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:39.006282 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae82e65d-56c1-4502-88b9-6ab2ad4d5f6a admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:39.017705 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fe0086-d035-4e71-89f3-9269e25697de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:39.018628 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe0086-d035-4e71-89f3-9269e25697de admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:39.018974 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe0086-d035-4e71-89f3-9269e25697de admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:39.019249 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe0086-d035-4e71-89f3-9269e25697de admin admin] PATH_INFO: `/v3/projects/1bc6bb36f7dc413d9f2338e8d44c0e07/users/f6cb922510314ff2be33182826eb9a66/roles/81634e7812344f84afcb29b0dba2687c` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:39.035241 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fe0086-d035-4e71-89f3-9269e25697de admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bc6bb36f7dc413d9f2338e8d44c0e07, user_id=f6cb922510314ff2be33182826eb9a66, role_id=81634e7812344f84afcb29b0dba2687c)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:39.037968 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fe0086-d035-4e71-89f3-9269e25697de admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:39.053335 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1420/2808] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:24:38 2022] PUT /identity/v3/projects/1bc6bb36f7dc413d9f2338e8d44c0e07/users/f6cb922510314ff2be33182826eb9a66/roles/81634e7812344f84afcb29b0dba2687c => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:24:39.064441 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a3170b-ae22-44c2-9536-378353e48f8e None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:39.064733 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a3170b-ae22-44c2-9536-378353e48f8e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:39.065008 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a3170b-ae22-44c2-9536-378353e48f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:39.094189 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-95a3170b-ae22-44c2-9536-378353e48f8e None None] MFA Rules not processed for user `f6cb922510314ff2be33182826eb9a66`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:24:39.095431 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-95a3170b-ae22-44c2-9536-378353e48f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:39.170424 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1389/2809] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:24:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:24:39.175024 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fe0086-d035-4e71-89f3-9269e25697de admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:39.245438 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fe0086-d035-4e71-89f3-9269e25697de admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:39.250542 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c294d0b6-7b3c-4872-9c4c-af9a59e3959e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:39.251269 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c294d0b6-7b3c-4872-9c4c-af9a59e3959e admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:39.251554 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c294d0b6-7b3c-4872-9c4c-af9a59e3959e admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:39.251828 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c294d0b6-7b3c-4872-9c4c-af9a59e3959e admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:39.252560 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c294d0b6-7b3c-4872-9c4c-af9a59e3959e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:39.254538 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c294d0b6-7b3c-4872-9c4c-af9a59e3959e admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:39.285864 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1421/2810] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:24:39 2022] POST /identity/v3/projects => generated 383 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:24:39.287325 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a3170b-ae22-44c2-9536-378353e48f8e None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:39.323584 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a3170b-ae22-44c2-9536-378353e48f8e None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:39.389368 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ff4310-5439-4e43-ae7e-4365c380af9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:39.390046 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff4310-5439-4e43-ae7e-4365c380af9b admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:39.390324 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff4310-5439-4e43-ae7e-4365c380af9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:39.390596 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff4310-5439-4e43-ae7e-4365c380af9b admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:39.391431 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ff4310-5439-4e43-ae7e-4365c380af9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:39.393465 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ff4310-5439-4e43-ae7e-4365c380af9b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:39.416853 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1390/2811] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:24:39 2022] POST /identity/v3/users => generated 298 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:24:39.420561 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c294d0b6-7b3c-4872-9c4c-af9a59e3959e admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:39.431079 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c294d0b6-7b3c-4872-9c4c-af9a59e3959e admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:39.435793 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7fc122-6acc-4f1c-92a0-2c0e3c100bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:39.436488 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7fc122-6acc-4f1c-92a0-2c0e3c100bec admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:39.436804 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7fc122-6acc-4f1c-92a0-2c0e3c100bec admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:39.437078 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7fc122-6acc-4f1c-92a0-2c0e3c100bec admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:39.437834 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7fc122-6acc-4f1c-92a0-2c0e3c100bec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:39.439429 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7fc122-6acc-4f1c-92a0-2c0e3c100bec admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:39.450457 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1422/2812] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:24:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:24:39.458410 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ff4310-5439-4e43-ae7e-4365c380af9b admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:39.467434 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ff4310-5439-4e43-ae7e-4365c380af9b admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:39.472928 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56243a25-7e63-4bd5-8ee5-ba2d01e519dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:39.473888 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56243a25-7e63-4bd5-8ee5-ba2d01e519dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:39.474166 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56243a25-7e63-4bd5-8ee5-ba2d01e519dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:39.474436 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56243a25-7e63-4bd5-8ee5-ba2d01e519dd admin admin] PATH_INFO: `/v3/projects/95337984a3bb4e2faed3fba60b8220c0/users/0434a8de37304902b76b0522d5037b59/roles/965049e7ce6144aaad23c15f3a5e37c3` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:39.479072 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:24:39.493386 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56243a25-7e63-4bd5-8ee5-ba2d01e519dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=95337984a3bb4e2faed3fba60b8220c0, user_id=0434a8de37304902b76b0522d5037b59, role_id=965049e7ce6144aaad23c15f3a5e37c3)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:39.496324 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56243a25-7e63-4bd5-8ee5-ba2d01e519dd admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:39.513992 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1391/2813] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:24:39 2022] PUT /identity/v3/projects/95337984a3bb4e2faed3fba60b8220c0/users/0434a8de37304902b76b0522d5037b59/roles/965049e7ce6144aaad23c15f3a5e37c3 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:24:39.518265 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7fc122-6acc-4f1c-92a0-2c0e3c100bec admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:39.529022 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7fc122-6acc-4f1c-92a0-2c0e3c100bec admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:39.549467 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:24:39.599445 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9523019a-421a-4a11-b359-8dc0e5e46896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:39.600427 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9523019a-421a-4a11-b359-8dc0e5e46896 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:39.600710 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9523019a-421a-4a11-b359-8dc0e5e46896 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:39.600986 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9523019a-421a-4a11-b359-8dc0e5e46896 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:39.601735 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9523019a-421a-4a11-b359-8dc0e5e46896 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:39.603385 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9523019a-421a-4a11-b359-8dc0e5e46896 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:39.614081 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1423/2814] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:24:39 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:24:39.618518 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56243a25-7e63-4bd5-8ee5-ba2d01e519dd admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:39.629411 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56243a25-7e63-4bd5-8ee5-ba2d01e519dd admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:39.635584 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39805a2-2e2c-4630-92dd-3b21fd5c423e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:39.636875 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39805a2-2e2c-4630-92dd-3b21fd5c423e admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:39.637190 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39805a2-2e2c-4630-92dd-3b21fd5c423e admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:39.637475 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39805a2-2e2c-4630-92dd-3b21fd5c423e admin admin] PATH_INFO: `/v3/projects/95337984a3bb4e2faed3fba60b8220c0/users/0434a8de37304902b76b0522d5037b59/roles/965049e7ce6144aaad23c15f3a5e37c3` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:39.640355 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39805a2-2e2c-4630-92dd-3b21fd5c423e admin admin] RBAC: Authorizing `identity:create_grant(project_id=95337984a3bb4e2faed3fba60b8220c0, user_id=0434a8de37304902b76b0522d5037b59, role_id=965049e7ce6144aaad23c15f3a5e37c3)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:39.643544 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39805a2-2e2c-4630-92dd-3b21fd5c423e admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:39.654725 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1392/2815] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:24:39 2022] PUT /identity/v3/projects/95337984a3bb4e2faed3fba60b8220c0/users/0434a8de37304902b76b0522d5037b59/roles/965049e7ce6144aaad23c15f3a5e37c3 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:24:39.667121 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a287ed9-8adb-4e6e-90f2-a31485ef6b70 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:39.667438 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a287ed9-8adb-4e6e-90f2-a31485ef6b70 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:39.667731 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a287ed9-8adb-4e6e-90f2-a31485ef6b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:39.695741 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-4a287ed9-8adb-4e6e-90f2-a31485ef6b70 None None] MFA Rules not processed for user `0434a8de37304902b76b0522d5037b59`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:24:39.697031 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-4a287ed9-8adb-4e6e-90f2-a31485ef6b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:39.774863 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1424/2816] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:24:39 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:24:39.785993 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39805a2-2e2c-4630-92dd-3b21fd5c423e admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:39.787948 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d39805a2-2e2c-4630-92dd-3b21fd5c423e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:39.850547 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39805a2-2e2c-4630-92dd-3b21fd5c423e admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:39.855151 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252205e9-cb18-49ed-b163-a3805118ba97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f86373d65440da97c853fff3c1d0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:39.856348 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252205e9-cb18-49ed-b163-a3805118ba97 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:39.856348 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252205e9-cb18-49ed-b163-a3805118ba97 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:39.856557 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252205e9-cb18-49ed-b163-a3805118ba97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:39.926395 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252205e9-cb18-49ed-b163-a3805118ba97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:39.927921 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252205e9-cb18-49ed-b163-a3805118ba97 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:39.938361 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1393/2817] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:24:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:24:41.931308 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a287ed9-8adb-4e6e-90f2-a31485ef6b70 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:41.933466 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-4a287ed9-8adb-4e6e-90f2-a31485ef6b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:42.045807 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a287ed9-8adb-4e6e-90f2-a31485ef6b70 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:42.054483 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5639ff46-a0e8-45ff-a459-62c45ba0058d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3b6e252a8c434a99432bcece6493b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:42.055685 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5639ff46-a0e8-45ff-a459-62c45ba0058d service nova] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:42.056233 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5639ff46-a0e8-45ff-a459-62c45ba0058d service nova] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:42.056681 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5639ff46-a0e8-45ff-a459-62c45ba0058d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:42.059488 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-5639ff46-a0e8-45ff-a459-62c45ba0058d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:42.077129 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5639ff46-a0e8-45ff-a459-62c45ba0058d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:42.078997 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5639ff46-a0e8-45ff-a459-62c45ba0058d service nova] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:42.106750 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1425/2818] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:24:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:24:44.300385 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252205e9-cb18-49ed-b163-a3805118ba97 service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:44.302532 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-252205e9-cb18-49ed-b163-a3805118ba97 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:44.321066 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252205e9-cb18-49ed-b163-a3805118ba97 service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:44.328156 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36036bf3-1581-4462-bcb2-ff3f8ab45a59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f86373d65440da97c853fff3c1d0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:44.328903 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36036bf3-1581-4462-bcb2-ff3f8ab45a59 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:44.329183 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36036bf3-1581-4462-bcb2-ff3f8ab45a59 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:44.329457 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36036bf3-1581-4462-bcb2-ff3f8ab45a59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:44.340429 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36036bf3-1581-4462-bcb2-ff3f8ab45a59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:44.341893 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36036bf3-1581-4462-bcb2-ff3f8ab45a59 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:44.352716 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1394/2819] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:24:44 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:24:49.259083 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5639ff46-a0e8-45ff-a459-62c45ba0058d service nova] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:49.292223 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:24:49.328305 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5639ff46-a0e8-45ff-a459-62c45ba0058d service nova] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:49.333182 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d32150-7044-4da1-8c8b-2ddfc83e3238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:49.334008 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d32150-7044-4da1-8c8b-2ddfc83e3238 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:49.334292 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d32150-7044-4da1-8c8b-2ddfc83e3238 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:49.334570 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d32150-7044-4da1-8c8b-2ddfc83e3238 admin admin] PATH_INFO: `/v3/users/f6cb922510314ff2be33182826eb9a66` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:49.335808 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d32150-7044-4da1-8c8b-2ddfc83e3238 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6cb922510314ff2be33182826eb9a66)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:49.337792 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d32150-7044-4da1-8c8b-2ddfc83e3238 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:49.412322 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-37d32150-7044-4da1-8c8b-2ddfc83e3238 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6cb922510314ff2be33182826eb9a66'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:49.422084 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-37d32150-7044-4da1-8c8b-2ddfc83e3238 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6cb922510314ff2be33182826eb9a66'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:49.422871 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-37d32150-7044-4da1-8c8b-2ddfc83e3238 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6cb922510314ff2be33182826eb9a66'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:49.423576 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-37d32150-7044-4da1-8c8b-2ddfc83e3238 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6cb922510314ff2be33182826eb9a66'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:49.444766 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-37d32150-7044-4da1-8c8b-2ddfc83e3238 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6cb922510314ff2be33182826eb9a66'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:49.464044 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1426/2820] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:24:49 2022] DELETE /identity/v3/users/f6cb922510314ff2be33182826eb9a66 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:24:49.469025 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188142c9-6b01-4b6a-bb9b-62c6d2725d26 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:49.469494 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188142c9-6b01-4b6a-bb9b-62c6d2725d26 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:49.469579 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188142c9-6b01-4b6a-bb9b-62c6d2725d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:49.487429 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-188142c9-6b01-4b6a-bb9b-62c6d2725d26 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:24:49.488665 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-188142c9-6b01-4b6a-bb9b-62c6d2725d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:49.548560 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1395/2821] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:24:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:24:49.557899 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d32150-7044-4da1-8c8b-2ddfc83e3238 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:49.559350 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-37d32150-7044-4da1-8c8b-2ddfc83e3238 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:49.617008 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d32150-7044-4da1-8c8b-2ddfc83e3238 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:49.620802 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dcad7f-a9fb-4dc0-b59c-fc26e42c1a64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:49.621464 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dcad7f-a9fb-4dc0-b59c-fc26e42c1a64 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:49.621733 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dcad7f-a9fb-4dc0-b59c-fc26e42c1a64 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:49.622010 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dcad7f-a9fb-4dc0-b59c-fc26e42c1a64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:49.631701 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dcad7f-a9fb-4dc0-b59c-fc26e42c1a64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:49.633177 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dcad7f-a9fb-4dc0-b59c-fc26e42c1a64 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:49.643016 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1427/2822] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:24:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:24:49.921639 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188142c9-6b01-4b6a-bb9b-62c6d2725d26 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:49.923181 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-188142c9-6b01-4b6a-bb9b-62c6d2725d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:49.936280 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188142c9-6b01-4b6a-bb9b-62c6d2725d26 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:49.942263 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e43bbe6-7dd4-4043-84b4-3907b3874529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:49.943348 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e43bbe6-7dd4-4043-84b4-3907b3874529 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:49.943755 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e43bbe6-7dd4-4043-84b4-3907b3874529 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:49.943967 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e43bbe6-7dd4-4043-84b4-3907b3874529 admin admin] PATH_INFO: `/v3/projects/1bc6bb36f7dc413d9f2338e8d44c0e07` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:49.945499 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e43bbe6-7dd4-4043-84b4-3907b3874529 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bc6bb36f7dc413d9f2338e8d44c0e07)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:49.947672 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e43bbe6-7dd4-4043-84b4-3907b3874529 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:49.958191 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:24:49.999459 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8e43bbe6-7dd4-4043-84b4-3907b3874529 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bc6bb36f7dc413d9f2338e8d44c0e07', 'request_id': 'req-8e43bbe6-7dd4-4043-84b4-3907b3874529'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:50.006007 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8e43bbe6-7dd4-4043-84b4-3907b3874529 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bc6bb36f7dc413d9f2338e8d44c0e07', 'request_id': 'req-8e43bbe6-7dd4-4043-84b4-3907b3874529'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:50.013197 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8e43bbe6-7dd4-4043-84b4-3907b3874529 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bc6bb36f7dc413d9f2338e8d44c0e07', 'request_id': 'req-8e43bbe6-7dd4-4043-84b4-3907b3874529'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:50.024985 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8e43bbe6-7dd4-4043-84b4-3907b3874529 admin admin] The token cache is being invalidate because project 1bc6bb36f7dc413d9f2338e8d44c0e07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:24:50.025322 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8e43bbe6-7dd4-4043-84b4-3907b3874529 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:50.026000 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8e43bbe6-7dd4-4043-84b4-3907b3874529 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:50.027543 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1396/2823] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:24:49 2022] DELETE /identity/v3/projects/1bc6bb36f7dc413d9f2338e8d44c0e07 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:24:50.031734 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dcad7f-a9fb-4dc0-b59c-fc26e42c1a64 service neutron] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:50.041727 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dcad7f-a9fb-4dc0-b59c-fc26e42c1a64 service neutron] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:50.090834 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:24:50.102155 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7439f4e-4645-453f-912c-4dfa7b1dc674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:50.103036 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7439f4e-4645-453f-912c-4dfa7b1dc674 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:50.103325 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7439f4e-4645-453f-912c-4dfa7b1dc674 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:50.103605 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7439f4e-4645-453f-912c-4dfa7b1dc674 admin admin] PATH_INFO: `/v3/users/0434a8de37304902b76b0522d5037b59` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:50.104868 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7439f4e-4645-453f-912c-4dfa7b1dc674 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0434a8de37304902b76b0522d5037b59)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:50.106788 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7439f4e-4645-453f-912c-4dfa7b1dc674 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:50.154830 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-d7439f4e-4645-453f-912c-4dfa7b1dc674 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0434a8de37304902b76b0522d5037b59'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:50.161802 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-d7439f4e-4645-453f-912c-4dfa7b1dc674 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0434a8de37304902b76b0522d5037b59'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:50.162500 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-d7439f4e-4645-453f-912c-4dfa7b1dc674 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0434a8de37304902b76b0522d5037b59'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:50.163131 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-d7439f4e-4645-453f-912c-4dfa7b1dc674 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0434a8de37304902b76b0522d5037b59'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:50.175001 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-d7439f4e-4645-453f-912c-4dfa7b1dc674 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0434a8de37304902b76b0522d5037b59'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:50.187112 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1428/2824] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:24:50 2022] DELETE /identity/v3/users/0434a8de37304902b76b0522d5037b59 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:24:50.521072 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e43bbe6-7dd4-4043-84b4-3907b3874529 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:50.522545 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-8e43bbe6-7dd4-4043-84b4-3907b3874529 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:50.535916 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e43bbe6-7dd4-4043-84b4-3907b3874529 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:50.597041 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b9eddf-8f29-4ef0-a21f-7adfdbb63129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:50.597963 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b9eddf-8f29-4ef0-a21f-7adfdbb63129 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:50.598267 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b9eddf-8f29-4ef0-a21f-7adfdbb63129 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:50.598575 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b9eddf-8f29-4ef0-a21f-7adfdbb63129 admin admin] PATH_INFO: `/v3/projects/95337984a3bb4e2faed3fba60b8220c0` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:50.599930 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b9eddf-8f29-4ef0-a21f-7adfdbb63129 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95337984a3bb4e2faed3fba60b8220c0)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:50.601963 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b9eddf-8f29-4ef0-a21f-7adfdbb63129 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:50.650996 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-42b9eddf-8f29-4ef0-a21f-7adfdbb63129 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95337984a3bb4e2faed3fba60b8220c0', 'request_id': 'req-42b9eddf-8f29-4ef0-a21f-7adfdbb63129'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:50.659056 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-42b9eddf-8f29-4ef0-a21f-7adfdbb63129 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95337984a3bb4e2faed3fba60b8220c0', 'request_id': 'req-42b9eddf-8f29-4ef0-a21f-7adfdbb63129'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:50.667157 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-42b9eddf-8f29-4ef0-a21f-7adfdbb63129 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95337984a3bb4e2faed3fba60b8220c0', 'request_id': 'req-42b9eddf-8f29-4ef0-a21f-7adfdbb63129'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:50.680461 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-42b9eddf-8f29-4ef0-a21f-7adfdbb63129 admin admin] The token cache is being invalidate because project 95337984a3bb4e2faed3fba60b8220c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:24:50.680751 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-42b9eddf-8f29-4ef0-a21f-7adfdbb63129 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:50.681478 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-42b9eddf-8f29-4ef0-a21f-7adfdbb63129 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:50.683125 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1397/2825] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:24:50 2022] DELETE /identity/v3/projects/95337984a3bb4e2faed3fba60b8220c0 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:24:50.689537 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3765687-a27b-4ce3-9674-dfffb7669487 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:50.690058 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3765687-a27b-4ce3-9674-dfffb7669487 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:50.690058 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3765687-a27b-4ce3-9674-dfffb7669487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:50.713344 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-f3765687-a27b-4ce3-9674-dfffb7669487 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:24:50.714945 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-f3765687-a27b-4ce3-9674-dfffb7669487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:50.782853 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1429/2826] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:24:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:24:50.791368 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ab6fb-f428-4472-b84b-5d9cda6b54c7 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:50.791797 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ab6fb-f428-4472-b84b-5d9cda6b54c7 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:50.792095 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ab6fb-f428-4472-b84b-5d9cda6b54c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:50.810640 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-e93ab6fb-f428-4472-b84b-5d9cda6b54c7 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:24:50.811856 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e93ab6fb-f428-4472-b84b-5d9cda6b54c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:50.820645 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1398/2827] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:24:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:24:50.825051 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3765687-a27b-4ce3-9674-dfffb7669487 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:50.834925 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3765687-a27b-4ce3-9674-dfffb7669487 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:50.839734 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ad4451-2bcc-45f2-9e48-a2ad9042151b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:50.840421 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ad4451-2bcc-45f2-9e48-a2ad9042151b admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:50.840699 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ad4451-2bcc-45f2-9e48-a2ad9042151b admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:50.840998 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ad4451-2bcc-45f2-9e48-a2ad9042151b admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:50.841737 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ad4451-2bcc-45f2-9e48-a2ad9042151b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:24:50.842041 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ad4451-2bcc-45f2-9e48-a2ad9042151b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:50.844205 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ad4451-2bcc-45f2-9e48-a2ad9042151b admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:50.856276 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1430/2828] 10.222.0.42 () {58 vars in 1152 bytes} [Mon Jul 4 09:24:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:24:50.860133 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93ab6fb-f428-4472-b84b-5d9cda6b54c7 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:50.869500 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93ab6fb-f428-4472-b84b-5d9cda6b54c7 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:50.874029 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1534f45b-891b-4532-b337-c0bf26d116e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:50.874670 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534f45b-891b-4532-b337-c0bf26d116e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:50.875025 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534f45b-891b-4532-b337-c0bf26d116e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:50.875305 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534f45b-891b-4532-b337-c0bf26d116e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:50.876083 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1534f45b-891b-4532-b337-c0bf26d116e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:50.878004 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1534f45b-891b-4532-b337-c0bf26d116e5 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:50.899152 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:24:50.909626 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1399/2829] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:24:50 2022] POST /identity/v3/projects => generated 359 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:24:50.913793 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ad4451-2bcc-45f2-9e48-a2ad9042151b admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:50.925099 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ad4451-2bcc-45f2-9e48-a2ad9042151b admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:50.980406 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:24:50.989708 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6a192d-aeb3-4036-adbd-7cd3a74ab64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:50.990971 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6a192d-aeb3-4036-adbd-7cd3a74ab64c admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:50.991362 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6a192d-aeb3-4036-adbd-7cd3a74ab64c admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:50.992223 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6a192d-aeb3-4036-adbd-7cd3a74ab64c admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:50.993487 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6a192d-aeb3-4036-adbd-7cd3a74ab64c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:50.996558 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6a192d-aeb3-4036-adbd-7cd3a74ab64c admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:51.020165 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1431/2830] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:24:50 2022] POST /identity/v3/users => generated 280 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:24:51.024450 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1534f45b-891b-4532-b337-c0bf26d116e5 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:51.035529 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1534f45b-891b-4532-b337-c0bf26d116e5 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:51.042096 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c04b3d-f747-4ab3-aa3f-3bd11fd8cdd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:51.042557 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c04b3d-f747-4ab3-aa3f-3bd11fd8cdd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:51.042893 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c04b3d-f747-4ab3-aa3f-3bd11fd8cdd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:51.043229 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c04b3d-f747-4ab3-aa3f-3bd11fd8cdd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:51.044073 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c04b3d-f747-4ab3-aa3f-3bd11fd8cdd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:51.045786 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c04b3d-f747-4ab3-aa3f-3bd11fd8cdd6 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:51.059943 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1400/2831] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:24:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:24:51.061213 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6a192d-aeb3-4036-adbd-7cd3a74ab64c admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:51.085902 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6a192d-aeb3-4036-adbd-7cd3a74ab64c admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:51.092819 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b3f27e-ee6e-439c-9e10-66bc3d31b185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:51.093509 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b3f27e-ee6e-439c-9e10-66bc3d31b185 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:51.094206 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b3f27e-ee6e-439c-9e10-66bc3d31b185 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:51.095160 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b3f27e-ee6e-439c-9e10-66bc3d31b185 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:51.096240 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b3f27e-ee6e-439c-9e10-66bc3d31b185 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:51.098603 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b3f27e-ee6e-439c-9e10-66bc3d31b185 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:51.115525 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1432/2832] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:24:51 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:24:51.116690 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c04b3d-f747-4ab3-aa3f-3bd11fd8cdd6 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:51.127893 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c04b3d-f747-4ab3-aa3f-3bd11fd8cdd6 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:51.135594 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a449993-0343-45a8-ab09-2d7260e3820b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:51.137190 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a449993-0343-45a8-ab09-2d7260e3820b admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:51.137544 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a449993-0343-45a8-ab09-2d7260e3820b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:51.137938 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a449993-0343-45a8-ab09-2d7260e3820b admin admin] PATH_INFO: `/v3/projects/be8d622086554a5cb89726f7c8a92938/users/5f80928995114f36bb8348750c8d47dc/roles/81634e7812344f84afcb29b0dba2687c` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:51.160425 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a449993-0343-45a8-ab09-2d7260e3820b admin admin] RBAC: Authorizing `identity:create_grant(project_id=be8d622086554a5cb89726f7c8a92938, user_id=5f80928995114f36bb8348750c8d47dc, role_id=81634e7812344f84afcb29b0dba2687c)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:51.165714 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a449993-0343-45a8-ab09-2d7260e3820b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:51.182972 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1401/2833] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:24:51 2022] PUT /identity/v3/projects/be8d622086554a5cb89726f7c8a92938/users/5f80928995114f36bb8348750c8d47dc/roles/81634e7812344f84afcb29b0dba2687c => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:24:51.195400 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dc7a26-9c51-4fbc-a7d6-94f490738dda None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:51.195596 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dc7a26-9c51-4fbc-a7d6-94f490738dda None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:51.195895 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dc7a26-9c51-4fbc-a7d6-94f490738dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:51.224972 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-26dc7a26-9c51-4fbc-a7d6-94f490738dda None None] MFA Rules not processed for user `5f80928995114f36bb8348750c8d47dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:24:51.226221 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-26dc7a26-9c51-4fbc-a7d6-94f490738dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:51.300589 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1433/2834] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:24:51 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:24:51.334068 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a449993-0343-45a8-ab09-2d7260e3820b admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:51.336499 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-8a449993-0343-45a8-ab09-2d7260e3820b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:51.398990 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a449993-0343-45a8-ab09-2d7260e3820b admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:51.402618 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3257b69-6ffa-48e4-9239-08a93faf547b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f86373d65440da97c853fff3c1d0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:51.403272 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3257b69-6ffa-48e4-9239-08a93faf547b service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:51.403599 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3257b69-6ffa-48e4-9239-08a93faf547b service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:51.404314 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3257b69-6ffa-48e4-9239-08a93faf547b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:51.413677 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3257b69-6ffa-48e4-9239-08a93faf547b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:51.415181 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3257b69-6ffa-48e4-9239-08a93faf547b service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:51.424389 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1402/2835] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:24:51 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:24:51.438964 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dc7a26-9c51-4fbc-a7d6-94f490738dda None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:51.501859 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dc7a26-9c51-4fbc-a7d6-94f490738dda None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:51.507401 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd9d908-255f-47d1-8f26-3b37c6720ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:51.508335 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd9d908-255f-47d1-8f26-3b37c6720ff4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:51.508617 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd9d908-255f-47d1-8f26-3b37c6720ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:51.508895 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd9d908-255f-47d1-8f26-3b37c6720ff4 admin admin] PATH_INFO: `/v3/users/5f80928995114f36bb8348750c8d47dc` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:51.510290 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd9d908-255f-47d1-8f26-3b37c6720ff4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f80928995114f36bb8348750c8d47dc)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:51.512371 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd9d908-255f-47d1-8f26-3b37c6720ff4 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:51.561515 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-bbd9d908-255f-47d1-8f26-3b37c6720ff4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f80928995114f36bb8348750c8d47dc'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:51.570860 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-bbd9d908-255f-47d1-8f26-3b37c6720ff4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f80928995114f36bb8348750c8d47dc'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:51.571656 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-bbd9d908-255f-47d1-8f26-3b37c6720ff4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f80928995114f36bb8348750c8d47dc'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:51.572568 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-bbd9d908-255f-47d1-8f26-3b37c6720ff4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f80928995114f36bb8348750c8d47dc'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:51.588077 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:24:51.590579 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-bbd9d908-255f-47d1-8f26-3b37c6720ff4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f80928995114f36bb8348750c8d47dc'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:51.605748 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1434/2836] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:24:51 2022] DELETE /identity/v3/users/5f80928995114f36bb8348750c8d47dc => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:24:51.610717 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f11742-6ded-44ad-8a34-4a8e612b0ed1 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:51.611185 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f11742-6ded-44ad-8a34-4a8e612b0ed1 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:51.611399 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f11742-6ded-44ad-8a34-4a8e612b0ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:51.629558 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-11f11742-6ded-44ad-8a34-4a8e612b0ed1 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:24:51.630778 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-11f11742-6ded-44ad-8a34-4a8e612b0ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:51.693737 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1403/2837] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:24:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:24:51.704177 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd9d908-255f-47d1-8f26-3b37c6720ff4 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:51.705868 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-bbd9d908-255f-47d1-8f26-3b37c6720ff4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:51.767309 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd9d908-255f-47d1-8f26-3b37c6720ff4 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:51.771545 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e39091-9324-4f71-8c96-ab0c33cc4fb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:51.772232 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e39091-9324-4f71-8c96-ab0c33cc4fb6 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:51.772517 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e39091-9324-4f71-8c96-ab0c33cc4fb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:51.772793 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e39091-9324-4f71-8c96-ab0c33cc4fb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:51.782837 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e39091-9324-4f71-8c96-ab0c33cc4fb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:51.784329 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e39091-9324-4f71-8c96-ab0c33cc4fb6 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:51.794422 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1435/2838] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:24:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:24:52.062703 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f11742-6ded-44ad-8a34-4a8e612b0ed1 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:52.064239 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-11f11742-6ded-44ad-8a34-4a8e612b0ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:52.076464 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f11742-6ded-44ad-8a34-4a8e612b0ed1 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:52.081541 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8c7ae5-1e67-4d75-a70a-f2fa2ab530b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:52.082441 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c7ae5-1e67-4d75-a70a-f2fa2ab530b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:52.082719 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c7ae5-1e67-4d75-a70a-f2fa2ab530b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:52.083165 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c7ae5-1e67-4d75-a70a-f2fa2ab530b5 admin admin] PATH_INFO: `/v3/projects/be8d622086554a5cb89726f7c8a92938` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:52.084298 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8c7ae5-1e67-4d75-a70a-f2fa2ab530b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be8d622086554a5cb89726f7c8a92938)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:52.086233 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8c7ae5-1e67-4d75-a70a-f2fa2ab530b5 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:52.133735 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-2b8c7ae5-1e67-4d75-a70a-f2fa2ab530b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be8d622086554a5cb89726f7c8a92938', 'request_id': 'req-2b8c7ae5-1e67-4d75-a70a-f2fa2ab530b5'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:52.139163 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-2b8c7ae5-1e67-4d75-a70a-f2fa2ab530b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be8d622086554a5cb89726f7c8a92938', 'request_id': 'req-2b8c7ae5-1e67-4d75-a70a-f2fa2ab530b5'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:52.141760 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:24:52.148137 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-2b8c7ae5-1e67-4d75-a70a-f2fa2ab530b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be8d622086554a5cb89726f7c8a92938', 'request_id': 'req-2b8c7ae5-1e67-4d75-a70a-f2fa2ab530b5'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:52.160367 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-2b8c7ae5-1e67-4d75-a70a-f2fa2ab530b5 admin admin] The token cache is being invalidate because project be8d622086554a5cb89726f7c8a92938 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:24:52.160650 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-2b8c7ae5-1e67-4d75-a70a-f2fa2ab530b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:52.161350 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-2b8c7ae5-1e67-4d75-a70a-f2fa2ab530b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:24:52.162992 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1404/2839] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:24:52 2022] DELETE /identity/v3/projects/be8d622086554a5cb89726f7c8a92938 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:24:52.168136 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ca245-4d5d-4c4b-8fa7-9f1e684e8a3b None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:52.168458 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ca245-4d5d-4c4b-8fa7-9f1e684e8a3b None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:52.168778 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ca245-4d5d-4c4b-8fa7-9f1e684e8a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:52.187957 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-f82ca245-4d5d-4c4b-8fa7-9f1e684e8a3b None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:24:52.189182 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-f82ca245-4d5d-4c4b-8fa7-9f1e684e8a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:52.254829 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1436/2840] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:24:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:24:52.262644 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53061bee-a14d-4ee7-b4bb-8f66007529ae None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:52.262937 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53061bee-a14d-4ee7-b4bb-8f66007529ae None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:52.263187 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53061bee-a14d-4ee7-b4bb-8f66007529ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:52.281989 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-53061bee-a14d-4ee7-b4bb-8f66007529ae None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:24:52.283184 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-53061bee-a14d-4ee7-b4bb-8f66007529ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:52.291439 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1405/2841] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:24:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:24:52.295715 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82ca245-4d5d-4c4b-8fa7-9f1e684e8a3b None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:52.306316 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82ca245-4d5d-4c4b-8fa7-9f1e684e8a3b None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:52.312616 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf6b97b-55e9-461a-b792-e0d74eeb9e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:52.313324 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf6b97b-55e9-461a-b792-e0d74eeb9e5a admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:52.313613 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf6b97b-55e9-461a-b792-e0d74eeb9e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:52.313888 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf6b97b-55e9-461a-b792-e0d74eeb9e5a admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:52.314714 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf6b97b-55e9-461a-b792-e0d74eeb9e5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:24:52.315024 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf6b97b-55e9-461a-b792-e0d74eeb9e5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:52.316700 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf6b97b-55e9-461a-b792-e0d74eeb9e5a admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:52.328972 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1437/2842] 10.222.0.42 () {58 vars in 1152 bytes} [Mon Jul 4 09:24:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:24:52.333487 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53061bee-a14d-4ee7-b4bb-8f66007529ae None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:52.343607 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53061bee-a14d-4ee7-b4bb-8f66007529ae None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:52.349776 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09b700-aae4-4e6b-83b1-2b59d711cec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:52.350424 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09b700-aae4-4e6b-83b1-2b59d711cec7 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:52.350735 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09b700-aae4-4e6b-83b1-2b59d711cec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:52.351007 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09b700-aae4-4e6b-83b1-2b59d711cec7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:52.351700 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf09b700-aae4-4e6b-83b1-2b59d711cec7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:52.353684 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf09b700-aae4-4e6b-83b1-2b59d711cec7 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:52.386248 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1406/2843] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:24:52 2022] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:24:52.387530 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf6b97b-55e9-461a-b792-e0d74eeb9e5a admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:52.398137 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf6b97b-55e9-461a-b792-e0d74eeb9e5a admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:52.459835 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962a4c9b-31b4-4698-a07f-a81ac9b8060a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:52.460563 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a4c9b-31b4-4698-a07f-a81ac9b8060a admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:52.460843 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a4c9b-31b4-4698-a07f-a81ac9b8060a admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:52.461116 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a4c9b-31b4-4698-a07f-a81ac9b8060a admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:52.461830 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962a4c9b-31b4-4698-a07f-a81ac9b8060a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:52.463742 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962a4c9b-31b4-4698-a07f-a81ac9b8060a admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:52.485584 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1438/2844] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:24:52 2022] POST /identity/v3/users => generated 283 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:24:52.489610 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09b700-aae4-4e6b-83b1-2b59d711cec7 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:52.499901 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09b700-aae4-4e6b-83b1-2b59d711cec7 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:52.504864 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6dceb5-0c5f-4387-b1ed-88e892eace0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:52.505748 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6dceb5-0c5f-4387-b1ed-88e892eace0d admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:52.506035 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6dceb5-0c5f-4387-b1ed-88e892eace0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:52.506318 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6dceb5-0c5f-4387-b1ed-88e892eace0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:52.507059 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6dceb5-0c5f-4387-b1ed-88e892eace0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:52.508741 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6dceb5-0c5f-4387-b1ed-88e892eace0d admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:52.520677 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1407/2845] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:24:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:24:52.524607 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962a4c9b-31b4-4698-a07f-a81ac9b8060a admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:52.530907 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:24:52.534695 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962a4c9b-31b4-4698-a07f-a81ac9b8060a admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:52.540164 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a39b006-ef67-443a-9ba2-2afcf98ea1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:52.540830 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a39b006-ef67-443a-9ba2-2afcf98ea1e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:52.541315 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a39b006-ef67-443a-9ba2-2afcf98ea1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:52.541769 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a39b006-ef67-443a-9ba2-2afcf98ea1e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:52.542660 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a39b006-ef67-443a-9ba2-2afcf98ea1e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:52.544343 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a39b006-ef67-443a-9ba2-2afcf98ea1e0 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:52.554203 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1439/2846] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:24:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:24:52.558361 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6dceb5-0c5f-4387-b1ed-88e892eace0d admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:52.568338 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6dceb5-0c5f-4387-b1ed-88e892eace0d admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:52.572985 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed93919-615c-4b27-8d16-7445505713c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:52.573857 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed93919-615c-4b27-8d16-7445505713c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:52.574159 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed93919-615c-4b27-8d16-7445505713c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:52.574439 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed93919-615c-4b27-8d16-7445505713c1 admin admin] PATH_INFO: `/v3/projects/45c29a4df4a7469e9cbd8e1cd7e0fee8/users/ad7304da5c424e12a2f7bc4e52085d48/roles/81634e7812344f84afcb29b0dba2687c` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:52.588769 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed93919-615c-4b27-8d16-7445505713c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45c29a4df4a7469e9cbd8e1cd7e0fee8, user_id=ad7304da5c424e12a2f7bc4e52085d48, role_id=81634e7812344f84afcb29b0dba2687c)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:52.591548 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed93919-615c-4b27-8d16-7445505713c1 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:52.607393 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1408/2847] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:24:52 2022] PUT /identity/v3/projects/45c29a4df4a7469e9cbd8e1cd7e0fee8/users/ad7304da5c424e12a2f7bc4e52085d48/roles/81634e7812344f84afcb29b0dba2687c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:24:52.618125 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1aef9e-c613-4b1f-b52f-5582b68d2421 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:52.618417 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1aef9e-c613-4b1f-b52f-5582b68d2421 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:52.618689 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1aef9e-c613-4b1f-b52f-5582b68d2421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:52.646281 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-fd1aef9e-c613-4b1f-b52f-5582b68d2421 None None] MFA Rules not processed for user `ad7304da5c424e12a2f7bc4e52085d48`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:24:52.647482 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-fd1aef9e-c613-4b1f-b52f-5582b68d2421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:52.715916 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1440/2848] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:24:52 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:24:52.727861 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed93919-615c-4b27-8d16-7445505713c1 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:52.729812 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-2ed93919-615c-4b27-8d16-7445505713c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:52.790699 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed93919-615c-4b27-8d16-7445505713c1 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:52.794674 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8525f132-0c07-46e4-8770-2a9077476a59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f86373d65440da97c853fff3c1d0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:52.795331 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8525f132-0c07-46e4-8770-2a9077476a59 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:52.795611 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8525f132-0c07-46e4-8770-2a9077476a59 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:52.795891 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8525f132-0c07-46e4-8770-2a9077476a59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:52.804837 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8525f132-0c07-46e4-8770-2a9077476a59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:52.806286 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8525f132-0c07-46e4-8770-2a9077476a59 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:52.815253 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1409/2849] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:24:52 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:24:56.194148 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1aef9e-c613-4b1f-b52f-5582b68d2421 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:56.195766 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-fd1aef9e-c613-4b1f-b52f-5582b68d2421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:56.257728 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1aef9e-c613-4b1f-b52f-5582b68d2421 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:56.261788 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e459305-e382-4843-a612-1b0034b11a02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:56.262408 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e459305-e382-4843-a612-1b0034b11a02 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:56.262684 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e459305-e382-4843-a612-1b0034b11a02 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:56.262965 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e459305-e382-4843-a612-1b0034b11a02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:56.264832 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-4e459305-e382-4843-a612-1b0034b11a02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:56.328435 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e459305-e382-4843-a612-1b0034b11a02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:56.329861 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e459305-e382-4843-a612-1b0034b11a02 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:56.339400 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1441/2850] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:24:56 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:25:02.811336 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:DELETE=1,keystone:SELECT=57,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:25:06.335513 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=85 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:25:22.734349 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8525f132-0c07-46e4-8770-2a9077476a59 service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:25:22.802872 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8525f132-0c07-46e4-8770-2a9077476a59 service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:25:22.808385 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955eed2a-ae26-43e6-a700-fc45cb99b4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:25:22.809303 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955eed2a-ae26-43e6-a700-fc45cb99b4ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:25:22.809581 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955eed2a-ae26-43e6-a700-fc45cb99b4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:25:22.809883 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955eed2a-ae26-43e6-a700-fc45cb99b4ae admin admin] PATH_INFO: `/v3/users/ad7304da5c424e12a2f7bc4e52085d48` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:25:22.811182 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955eed2a-ae26-43e6-a700-fc45cb99b4ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad7304da5c424e12a2f7bc4e52085d48)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:25:22.813193 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955eed2a-ae26-43e6-a700-fc45cb99b4ae admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:25:22.864869 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-955eed2a-ae26-43e6-a700-fc45cb99b4ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad7304da5c424e12a2f7bc4e52085d48'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:25:22.865531 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-955eed2a-ae26-43e6-a700-fc45cb99b4ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad7304da5c424e12a2f7bc4e52085d48'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:25:22.874343 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-955eed2a-ae26-43e6-a700-fc45cb99b4ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad7304da5c424e12a2f7bc4e52085d48'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:25:22.875188 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-955eed2a-ae26-43e6-a700-fc45cb99b4ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad7304da5c424e12a2f7bc4e52085d48'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:25:22.891994 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-955eed2a-ae26-43e6-a700-fc45cb99b4ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad7304da5c424e12a2f7bc4e52085d48'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:25:22.905932 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1410/2851] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:25:22 2022] DELETE /identity/v3/users/ad7304da5c424e12a2f7bc4e52085d48 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:25:22.910828 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b51affc-28e2-4da6-8c28-bec18b8e185c None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:25:22.911342 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b51affc-28e2-4da6-8c28-bec18b8e185c None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:25:22.911465 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b51affc-28e2-4da6-8c28-bec18b8e185c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:25:22.929501 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-2b51affc-28e2-4da6-8c28-bec18b8e185c None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:25:22.930760 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-2b51affc-28e2-4da6-8c28-bec18b8e185c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:25:22.990587 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1442/2852] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:25:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:25:23.000404 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955eed2a-ae26-43e6-a700-fc45cb99b4ae admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:25:23.002113 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-955eed2a-ae26-43e6-a700-fc45cb99b4ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:25:23.061828 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955eed2a-ae26-43e6-a700-fc45cb99b4ae admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:25:23.065917 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a9ea87-7e38-442b-8fc1-9e9ed5fec55c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:25:23.066556 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a9ea87-7e38-442b-8fc1-9e9ed5fec55c service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:25:23.066837 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a9ea87-7e38-442b-8fc1-9e9ed5fec55c service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:25:23.067110 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a9ea87-7e38-442b-8fc1-9e9ed5fec55c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:25:23.076801 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a9ea87-7e38-442b-8fc1-9e9ed5fec55c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:25:23.078267 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a9ea87-7e38-442b-8fc1-9e9ed5fec55c service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:25:23.088037 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1411/2853] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:25:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:25:23.378349 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b51affc-28e2-4da6-8c28-bec18b8e185c None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:25:23.379889 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-2b51affc-28e2-4da6-8c28-bec18b8e185c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:25:23.392119 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b51affc-28e2-4da6-8c28-bec18b8e185c None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:25:23.397180 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06650cf-9c24-4d04-a781-fe1e396a543a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:25:23.398046 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06650cf-9c24-4d04-a781-fe1e396a543a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:25:23.398337 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06650cf-9c24-4d04-a781-fe1e396a543a admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:25:23.398588 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06650cf-9c24-4d04-a781-fe1e396a543a admin admin] PATH_INFO: `/v3/projects/45c29a4df4a7469e9cbd8e1cd7e0fee8` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:25:23.399793 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06650cf-9c24-4d04-a781-fe1e396a543a admin admin] RBAC: Authorizing `identity:delete_project(project_id=45c29a4df4a7469e9cbd8e1cd7e0fee8)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:25:23.401747 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06650cf-9c24-4d04-a781-fe1e396a543a admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:25:23.452920 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-c06650cf-9c24-4d04-a781-fe1e396a543a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45c29a4df4a7469e9cbd8e1cd7e0fee8', 'request_id': 'req-c06650cf-9c24-4d04-a781-fe1e396a543a'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:25:23.460840 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-c06650cf-9c24-4d04-a781-fe1e396a543a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45c29a4df4a7469e9cbd8e1cd7e0fee8', 'request_id': 'req-c06650cf-9c24-4d04-a781-fe1e396a543a'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:25:23.466214 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-c06650cf-9c24-4d04-a781-fe1e396a543a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45c29a4df4a7469e9cbd8e1cd7e0fee8', 'request_id': 'req-c06650cf-9c24-4d04-a781-fe1e396a543a'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:25:23.477995 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-c06650cf-9c24-4d04-a781-fe1e396a543a admin admin] The token cache is being invalidate because project 45c29a4df4a7469e9cbd8e1cd7e0fee8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:25:23.478285 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-c06650cf-9c24-4d04-a781-fe1e396a543a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:25:23.479903 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-c06650cf-9c24-4d04-a781-fe1e396a543a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:25:23.481548 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1443/2854] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:25:23 2022] DELETE /identity/v3/projects/45c29a4df4a7469e9cbd8e1cd7e0fee8 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:25:23.487521 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64dc0e1-3762-4b1c-8fb7-f473572f2c9b None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:25:23.487811 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64dc0e1-3762-4b1c-8fb7-f473572f2c9b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:25:23.488205 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64dc0e1-3762-4b1c-8fb7-f473572f2c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:25:23.509574 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-b64dc0e1-3762-4b1c-8fb7-f473572f2c9b None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:25:23.510730 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b64dc0e1-3762-4b1c-8fb7-f473572f2c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:25:23.530186 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:25:23.584183 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1412/2855] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:25:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:25:23.597111 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4125e1-0e0d-42b3-a69e-80e011005134 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:25:23.597481 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4125e1-0e0d-42b3-a69e-80e011005134 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:25:23.597849 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4125e1-0e0d-42b3-a69e-80e011005134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:25:23.617064 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-6d4125e1-0e0d-42b3-a69e-80e011005134 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:25:23.618278 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-6d4125e1-0e0d-42b3-a69e-80e011005134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:25:23.627891 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1444/2856] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:25:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:25:23.634002 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64dc0e1-3762-4b1c-8fb7-f473572f2c9b None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:25:23.647213 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64dc0e1-3762-4b1c-8fb7-f473572f2c9b None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:25:23.653276 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacdd88f-3860-4f1f-80a1-81aec6013735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:25:23.653947 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacdd88f-3860-4f1f-80a1-81aec6013735 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:25:23.654226 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacdd88f-3860-4f1f-80a1-81aec6013735 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:25:23.654503 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacdd88f-3860-4f1f-80a1-81aec6013735 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:25:23.655240 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacdd88f-3860-4f1f-80a1-81aec6013735 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:25:23.655543 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacdd88f-3860-4f1f-80a1-81aec6013735 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:25:23.657205 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacdd88f-3860-4f1f-80a1-81aec6013735 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:25:23.669338 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1413/2857] 10.222.0.42 () {58 vars in 1152 bytes} [Mon Jul 4 09:25:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:25:23.673693 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4125e1-0e0d-42b3-a69e-80e011005134 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:25:23.683716 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4125e1-0e0d-42b3-a69e-80e011005134 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:25:23.689776 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda09718-bfbb-467d-9de0-aa360d0af8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:25:23.690426 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda09718-bfbb-467d-9de0-aa360d0af8ca admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:25:23.690712 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda09718-bfbb-467d-9de0-aa360d0af8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:25:23.690979 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda09718-bfbb-467d-9de0-aa360d0af8ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:25:23.691663 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda09718-bfbb-467d-9de0-aa360d0af8ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:25:23.693614 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda09718-bfbb-467d-9de0-aa360d0af8ca admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:25:23.722505 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1445/2858] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jul 4 09:25:23 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:25:23.727054 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacdd88f-3860-4f1f-80a1-81aec6013735 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:25:23.737196 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacdd88f-3860-4f1f-80a1-81aec6013735 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:25:23.794927 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3220f4-16dc-4792-9d53-e4b9094bc838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:25:23.795516 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3220f4-16dc-4792-9d53-e4b9094bc838 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:25:23.795795 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3220f4-16dc-4792-9d53-e4b9094bc838 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:25:23.796107 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3220f4-16dc-4792-9d53-e4b9094bc838 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:25:23.796794 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3220f4-16dc-4792-9d53-e4b9094bc838 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:25:23.798771 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3220f4-16dc-4792-9d53-e4b9094bc838 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:25:23.825834 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1414/2859] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jul 4 09:25:23 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:25:23.830158 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda09718-bfbb-467d-9de0-aa360d0af8ca admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:25:23.840681 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda09718-bfbb-467d-9de0-aa360d0af8ca admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:25:23.845972 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4edf189-cd4a-40fc-baed-a2380f3fb1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:25:23.846925 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4edf189-cd4a-40fc-baed-a2380f3fb1a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:25:23.847245 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4edf189-cd4a-40fc-baed-a2380f3fb1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:25:23.847576 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4edf189-cd4a-40fc-baed-a2380f3fb1a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:25:23.848348 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4edf189-cd4a-40fc-baed-a2380f3fb1a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:25:23.850002 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4edf189-cd4a-40fc-baed-a2380f3fb1a0 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:25:23.861951 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1446/2860] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:25:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:25:23.866785 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3220f4-16dc-4792-9d53-e4b9094bc838 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:25:23.877656 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3220f4-16dc-4792-9d53-e4b9094bc838 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:25:23.882908 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6488c87c-0a7b-42b0-aab9-7a0645598d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:25:23.883834 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488c87c-0a7b-42b0-aab9-7a0645598d9e admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:25:23.884295 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488c87c-0a7b-42b0-aab9-7a0645598d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:25:23.884692 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488c87c-0a7b-42b0-aab9-7a0645598d9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:25:23.885775 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6488c87c-0a7b-42b0-aab9-7a0645598d9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:25:23.887906 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6488c87c-0a7b-42b0-aab9-7a0645598d9e admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:25:23.900383 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1415/2861] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jul 4 09:25:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:25:23.904742 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4edf189-cd4a-40fc-baed-a2380f3fb1a0 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:25:23.915374 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4edf189-cd4a-40fc-baed-a2380f3fb1a0 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:25:23.921310 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd0a199-2e6a-41d6-a9b1-1d4a8fb62311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:25:23.922191 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd0a199-2e6a-41d6-a9b1-1d4a8fb62311 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:25:23.922478 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd0a199-2e6a-41d6-a9b1-1d4a8fb62311 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:25:23.922722 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd0a199-2e6a-41d6-a9b1-1d4a8fb62311 admin admin] PATH_INFO: `/v3/projects/2c5012cbd4ae457693899afbc6b58401/users/4944622f3e8d49f284b3bdff7bc9a568/roles/81634e7812344f84afcb29b0dba2687c` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:25:23.938804 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd0a199-2e6a-41d6-a9b1-1d4a8fb62311 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c5012cbd4ae457693899afbc6b58401, user_id=4944622f3e8d49f284b3bdff7bc9a568, role_id=81634e7812344f84afcb29b0dba2687c)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:25:23.941591 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd0a199-2e6a-41d6-a9b1-1d4a8fb62311 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:25:23.955437 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1447/2862] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jul 4 09:25:23 2022] PUT /identity/v3/projects/2c5012cbd4ae457693899afbc6b58401/users/4944622f3e8d49f284b3bdff7bc9a568/roles/81634e7812344f84afcb29b0dba2687c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:25:23.960824 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c19806-42d4-4d82-9a1c-1f8de79d1fb2 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:25:23.961120 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c19806-42d4-4d82-9a1c-1f8de79d1fb2 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:25:23.961391 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c19806-42d4-4d82-9a1c-1f8de79d1fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:25:23.979523 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-94c19806-42d4-4d82-9a1c-1f8de79d1fb2 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:25:23.980818 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-94c19806-42d4-4d82-9a1c-1f8de79d1fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:25:24.040423 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1416/2863] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:25:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:25:24.051435 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd0a199-2e6a-41d6-a9b1-1d4a8fb62311 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:25:24.053273 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-6bd0a199-2e6a-41d6-a9b1-1d4a8fb62311 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:25:24.075880 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:25:24.113482 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd0a199-2e6a-41d6-a9b1-1d4a8fb62311 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:25:24.117298 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d2e573-69b5-43f5-ad35-bfbdc4704098 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:25:24.117968 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d2e573-69b5-43f5-ad35-bfbdc4704098 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:25:24.118249 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d2e573-69b5-43f5-ad35-bfbdc4704098 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:25:24.118518 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d2e573-69b5-43f5-ad35-bfbdc4704098 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:25:24.127362 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d2e573-69b5-43f5-ad35-bfbdc4704098 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:25:24.128826 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d2e573-69b5-43f5-ad35-bfbdc4704098 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:25:24.137944 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1448/2864] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:25:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:25:24.781964 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c5e3e4-7045-4fee-8373-b0b4754b7844 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:25:24.782499 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c5e3e4-7045-4fee-8373-b0b4754b7844 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:25:24.782678 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c5e3e4-7045-4fee-8373-b0b4754b7844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:25:24.809863 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-26c5e3e4-7045-4fee-8373-b0b4754b7844 None None] MFA Rules not processed for user `4944622f3e8d49f284b3bdff7bc9a568`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:25:24.811089 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-26c5e3e4-7045-4fee-8373-b0b4754b7844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:25:24.831221 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:25:24.886563 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1417/2865] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:25:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:25:24.901824 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d2e573-69b5-43f5-ad35-bfbdc4704098 service neutron] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:25:24.903416 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-e0d2e573-69b5-43f5-ad35-bfbdc4704098 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:25:24.979104 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d2e573-69b5-43f5-ad35-bfbdc4704098 service neutron] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:25:24.982728 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436ddcfe-1c99-41b7-9e99-07807aa9f6f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f86373d65440da97c853fff3c1d0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:25:24.983374 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ddcfe-1c99-41b7-9e99-07807aa9f6f7 service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:25:24.983662 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ddcfe-1c99-41b7-9e99-07807aa9f6f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:25:24.983959 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ddcfe-1c99-41b7-9e99-07807aa9f6f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:25:24.992229 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436ddcfe-1c99-41b7-9e99-07807aa9f6f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:25:24.993675 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436ddcfe-1c99-41b7-9e99-07807aa9f6f7 service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:25:25.002317 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1449/2866] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:25:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:25:26.370704 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3393bc4f-a36b-4ea0-bf7e-5add53c30568 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:25:26.371253 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3393bc4f-a36b-4ea0-bf7e-5add53c30568 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:25:26.371361 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3393bc4f-a36b-4ea0-bf7e-5add53c30568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:25:26.392188 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-3393bc4f-a36b-4ea0-bf7e-5add53c30568 None None] MFA Rules not processed for user `4944622f3e8d49f284b3bdff7bc9a568`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:25:26.393433 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3393bc4f-a36b-4ea0-bf7e-5add53c30568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:25:26.401228 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1418/2867] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:25:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:25:34.998524 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=43 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:25:36.384773 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=22 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:25:52.652600 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436ddcfe-1c99-41b7-9e99-07807aa9f6f7 service cinder] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:25:52.654204 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-436ddcfe-1c99-41b7-9e99-07807aa9f6f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:25:52.728522 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436ddcfe-1c99-41b7-9e99-07807aa9f6f7 service cinder] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:25:52.733897 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a678cd-e129-4e5a-b99b-e834b4f64829 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46ec1a2091f1434cabc69066eb3b6725', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:25:52.734555 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a678cd-e129-4e5a-b99b-e834b4f64829 service placement] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:25:52.734835 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a678cd-e129-4e5a-b99b-e834b4f64829 service placement] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:25:52.735107 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a678cd-e129-4e5a-b99b-e834b4f64829 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:25:52.737032 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-65a678cd-e129-4e5a-b99b-e834b4f64829 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:25:52.749815 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a678cd-e129-4e5a-b99b-e834b4f64829 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:25:52.751415 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a678cd-e129-4e5a-b99b-e834b4f64829 service placement] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:25:52.761754 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1450/2868] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:25:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:25:52.953703 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a572c7-e158-4f2d-85c6-3e04f978ee59 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:25:52.954268 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a572c7-e158-4f2d-85c6-3e04f978ee59 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:25:52.954268 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a572c7-e158-4f2d-85c6-3e04f978ee59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:25:52.974427 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-06a572c7-e158-4f2d-85c6-3e04f978ee59 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:25:52.975490 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-06a572c7-e158-4f2d-85c6-3e04f978ee59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:25:52.984835 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1419/2869] 10.222.0.70 () {58 vars in 1016 bytes} [Mon Jul 4 09:25:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:25:53.005047 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a678cd-e129-4e5a-b99b-e834b4f64829 service placement] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:25:53.007010 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-65a678cd-e129-4e5a-b99b-e834b4f64829 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:25:53.083853 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a678cd-e129-4e5a-b99b-e834b4f64829 service placement] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:25:53.089981 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f146e35a-4bbf-47b6-9ae0-4772e6879c68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3b6e252a8c434a99432bcece6493b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:25:53.090655 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146e35a-4bbf-47b6-9ae0-4772e6879c68 service nova] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:25:53.090935 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146e35a-4bbf-47b6-9ae0-4772e6879c68 service nova] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:25:53.091205 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146e35a-4bbf-47b6-9ae0-4772e6879c68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:25:53.100059 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f146e35a-4bbf-47b6-9ae0-4772e6879c68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:25:53.101645 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f146e35a-4bbf-47b6-9ae0-4772e6879c68 service nova] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:25:53.111206 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1451/2870] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:25:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 09:25:56.048442 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41678109-f22b-4ec7-a1c0-abebe64f076b None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:25:56.049012 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41678109-f22b-4ec7-a1c0-abebe64f076b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:25:56.049012 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41678109-f22b-4ec7-a1c0-abebe64f076b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:25:56.071454 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-41678109-f22b-4ec7-a1c0-abebe64f076b None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:25:56.072709 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-41678109-f22b-4ec7-a1c0-abebe64f076b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:25:56.082326 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1420/2871] 10.222.0.70 () {58 vars in 1016 bytes} [Mon Jul 4 09:25:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:25:56.097811 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f146e35a-4bbf-47b6-9ae0-4772e6879c68 service nova] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:25:56.099392 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-f146e35a-4bbf-47b6-9ae0-4772e6879c68 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:25:56.115358 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f146e35a-4bbf-47b6-9ae0-4772e6879c68 service nova] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:25:56.121804 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06a7240-aba9-4833-b265-41cd8c0b99b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3b6e252a8c434a99432bcece6493b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:25:56.122463 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a7240-aba9-4833-b265-41cd8c0b99b7 service nova] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:25:56.122750 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a7240-aba9-4833-b265-41cd8c0b99b7 service nova] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:25:56.123038 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a7240-aba9-4833-b265-41cd8c0b99b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:25:56.131782 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06a7240-aba9-4833-b265-41cd8c0b99b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:25:56.133437 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06a7240-aba9-4833-b265-41cd8c0b99b7 service nova] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:25:56.143067 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1452/2872] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:25:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:25:59.288523 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8b29a-d0b3-4b43-9e40-58a00d5f2a91 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:25:59.289068 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8b29a-d0b3-4b43-9e40-58a00d5f2a91 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:25:59.289068 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8b29a-d0b3-4b43-9e40-58a00d5f2a91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:25:59.308551 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-90d8b29a-d0b3-4b43-9e40-58a00d5f2a91 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:25:59.309788 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-90d8b29a-d0b3-4b43-9e40-58a00d5f2a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:25:59.321895 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1421/2873] 10.222.0.70 () {58 vars in 1016 bytes} [Mon Jul 4 09:25:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:25:59.340206 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06a7240-aba9-4833-b265-41cd8c0b99b7 service nova] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:25:59.352647 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06a7240-aba9-4833-b265-41cd8c0b99b7 service nova] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:25:59.359779 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66140b62-e39e-4aae-9e82-8670f848582f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3b6e252a8c434a99432bcece6493b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:25:59.360558 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66140b62-e39e-4aae-9e82-8670f848582f service nova] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:25:59.360854 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66140b62-e39e-4aae-9e82-8670f848582f service nova] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:25:59.361139 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66140b62-e39e-4aae-9e82-8670f848582f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:25:59.369862 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66140b62-e39e-4aae-9e82-8670f848582f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:25:59.371461 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66140b62-e39e-4aae-9e82-8670f848582f service nova] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:25:59.381717 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1453/2874] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:25:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:26:02.379755 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f07bc76-c286-47dd-8e32-090447d11a64 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:26:02.380276 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f07bc76-c286-47dd-8e32-090447d11a64 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:26:02.380383 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f07bc76-c286-47dd-8e32-090447d11a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:26:02.398655 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-7f07bc76-c286-47dd-8e32-090447d11a64 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:26:02.399908 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-7f07bc76-c286-47dd-8e32-090447d11a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:26:02.408989 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1422/2875] 10.222.0.70 () {58 vars in 1016 bytes} [Mon Jul 4 09:26:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:26:02.430309 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66140b62-e39e-4aae-9e82-8670f848582f service nova] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:26:02.442037 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66140b62-e39e-4aae-9e82-8670f848582f service nova] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:26:02.448598 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be55877-70bf-4e79-99e0-00481d01343a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3b6e252a8c434a99432bcece6493b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:26:02.449231 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be55877-70bf-4e79-99e0-00481d01343a service nova] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:26:02.449625 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be55877-70bf-4e79-99e0-00481d01343a service nova] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:26:02.449907 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be55877-70bf-4e79-99e0-00481d01343a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:26:02.458543 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be55877-70bf-4e79-99e0-00481d01343a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:26:02.460197 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be55877-70bf-4e79-99e0-00481d01343a service nova] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:26:02.470248 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1454/2876] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:26:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:26:05.568938 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb36d46-1f9e-4341-864a-7ce94d6782b4 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:26:05.569505 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb36d46-1f9e-4341-864a-7ce94d6782b4 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:26:05.569505 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb36d46-1f9e-4341-864a-7ce94d6782b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:26:05.588399 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-4eb36d46-1f9e-4341-864a-7ce94d6782b4 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:26:05.589636 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-4eb36d46-1f9e-4341-864a-7ce94d6782b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:26:05.598440 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1423/2877] 10.222.0.70 () {58 vars in 1016 bytes} [Mon Jul 4 09:26:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:26:05.615461 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be55877-70bf-4e79-99e0-00481d01343a service nova] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:26:05.626917 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be55877-70bf-4e79-99e0-00481d01343a service nova] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:26:05.632269 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccffb49-b119-439c-8afe-38df8b811481 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3b6e252a8c434a99432bcece6493b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:26:05.632921 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccffb49-b119-439c-8afe-38df8b811481 service nova] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:26:05.633197 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccffb49-b119-439c-8afe-38df8b811481 service nova] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:26:05.633470 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccffb49-b119-439c-8afe-38df8b811481 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:26:05.642049 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccffb49-b119-439c-8afe-38df8b811481 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:26:05.643637 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccffb49-b119-439c-8afe-38df8b811481 service nova] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:26:05.654092 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1455/2878] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:26:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 09:26:13.889242 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3405d7a-411c-4ce3-8a9f-645a46c89249 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:26:13.889705 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3405d7a-411c-4ce3-8a9f-645a46c89249 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:26:13.889902 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3405d7a-411c-4ce3-8a9f-645a46c89249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:26:13.914593 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-e3405d7a-411c-4ce3-8a9f-645a46c89249 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:26:13.915957 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e3405d7a-411c-4ce3-8a9f-645a46c89249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:26:13.924908 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1424/2879] 10.222.0.70 () {58 vars in 1016 bytes} [Mon Jul 4 09:26:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:26:13.942229 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccffb49-b119-439c-8afe-38df8b811481 service nova] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:26:13.953895 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccffb49-b119-439c-8afe-38df8b811481 service nova] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:26:13.960413 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdf2f00-4dde-4e7e-b7c4-fdbc4126b6e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3b6e252a8c434a99432bcece6493b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:26:13.961073 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf2f00-4dde-4e7e-b7c4-fdbc4126b6e5 service nova] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:26:13.961353 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf2f00-4dde-4e7e-b7c4-fdbc4126b6e5 service nova] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:26:13.961625 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf2f00-4dde-4e7e-b7c4-fdbc4126b6e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:26:13.971258 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdf2f00-4dde-4e7e-b7c4-fdbc4126b6e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:26:13.972902 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdf2f00-4dde-4e7e-b7c4-fdbc4126b6e5 service nova] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:26:13.982870 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1456/2880] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:26:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:26:18.630970 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249ea32-4c14-47a5-9066-9ce4a16ec74d None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:26:18.631457 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249ea32-4c14-47a5-9066-9ce4a16ec74d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:26:18.631567 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249ea32-4c14-47a5-9066-9ce4a16ec74d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:26:18.637730 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=19 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:26:18.650855 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-6249ea32-4c14-47a5-9066-9ce4a16ec74d None None] MFA Rules not processed for user `bd758d5b21684027b0d199021df0ad2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:26:18.652237 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6249ea32-4c14-47a5-9066-9ce4a16ec74d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:26:18.710447 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1425/2881] 10.222.0.42 () {58 vars in 967 bytes} [Mon Jul 4 09:26:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:26:18.755603 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdf2f00-4dde-4e7e-b7c4-fdbc4126b6e5 service nova] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:26:18.757076 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-4bdf2f00-4dde-4e7e-b7c4-fdbc4126b6e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:26:18.762528 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=97 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:26:18.826731 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdf2f00-4dde-4e7e-b7c4-fdbc4126b6e5 service nova] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:26:18.832553 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309c9dde-6347-42d3-a45c-037f96fdada0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59d8698c45fb46259765eb3c8de2297f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:26:18.833200 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c9dde-6347-42d3-a45c-037f96fdada0 service swift] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:26:18.833483 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c9dde-6347-42d3-a45c-037f96fdada0 service swift] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:26:18.833759 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c9dde-6347-42d3-a45c-037f96fdada0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:26:18.842254 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309c9dde-6347-42d3-a45c-037f96fdada0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:26:18.845317 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309c9dde-6347-42d3-a45c-037f96fdada0 service swift] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:26:18.853033 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1457/2882] 10.222.0.42 () {60 vars in 1384 bytes} [Mon Jul 4 09:26:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 04 09:26:22.203113 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6249ea32-4c14-47a5-9066-9ce4a16ec74d None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:26:22.222520 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6249ea32-4c14-47a5-9066-9ce4a16ec74d None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:26:22.229133 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb82b0-d9dd-4d57-8a4d-ae92d5516b42 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46ec1a2091f1434cabc69066eb3b6725', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:26:22.230206 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb82b0-d9dd-4d57-8a4d-ae92d5516b42 service placement] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:26:22.230692 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb82b0-d9dd-4d57-8a4d-ae92d5516b42 service placement] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:26:22.231404 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb82b0-d9dd-4d57-8a4d-ae92d5516b42 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:26:22.234191 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-5edb82b0-d9dd-4d57-8a4d-ae92d5516b42 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:26:22.254318 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edb82b0-d9dd-4d57-8a4d-ae92d5516b42 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:26:22.256274 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edb82b0-d9dd-4d57-8a4d-ae92d5516b42 service placement] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:26:22.272940 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1426/2883] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:26:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:26:25.688731 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309c9dde-6347-42d3-a45c-037f96fdada0 service swift] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:26:25.690215 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-309c9dde-6347-42d3-a45c-037f96fdada0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:26:25.704264 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309c9dde-6347-42d3-a45c-037f96fdada0 service swift] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:26:25.708769 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecd34b7-5951-4a32-a58b-d038bfccb764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:26:25.709672 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd34b7-5951-4a32-a58b-d038bfccb764 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:26:25.709954 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd34b7-5951-4a32-a58b-d038bfccb764 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:26:25.710228 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd34b7-5951-4a32-a58b-d038bfccb764 admin admin] PATH_INFO: `/v3/users/54de34583d5544d28f52c5fdb08e1e38` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:26:25.711408 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecd34b7-5951-4a32-a58b-d038bfccb764 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54de34583d5544d28f52c5fdb08e1e38)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:26:25.713408 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecd34b7-5951-4a32-a58b-d038bfccb764 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:26:25.763338 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-5ecd34b7-5951-4a32-a58b-d038bfccb764 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54de34583d5544d28f52c5fdb08e1e38'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:26:25.770451 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-5ecd34b7-5951-4a32-a58b-d038bfccb764 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54de34583d5544d28f52c5fdb08e1e38'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:26:25.771299 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-5ecd34b7-5951-4a32-a58b-d038bfccb764 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54de34583d5544d28f52c5fdb08e1e38'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:26:25.771936 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-5ecd34b7-5951-4a32-a58b-d038bfccb764 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54de34583d5544d28f52c5fdb08e1e38'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:26:25.783980 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-5ecd34b7-5951-4a32-a58b-d038bfccb764 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54de34583d5544d28f52c5fdb08e1e38'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:26:25.797223 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1458/2884] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:26:25 2022] DELETE /identity/v3/users/54de34583d5544d28f52c5fdb08e1e38 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:26:25.987960 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb82b0-d9dd-4d57-8a4d-ae92d5516b42 service placement] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:26:25.998996 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb82b0-d9dd-4d57-8a4d-ae92d5516b42 service placement] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:26:26.083709 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e4b910-be44-47e1-b2c1-50041d296a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:26:26.084646 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e4b910-be44-47e1-b2c1-50041d296a73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:26:26.084933 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e4b910-be44-47e1-b2c1-50041d296a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:26:26.085330 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e4b910-be44-47e1-b2c1-50041d296a73 admin admin] PATH_INFO: `/v3/projects/38da9300b49a48668f9c8815c2c9a715` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:26:26.086516 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e4b910-be44-47e1-b2c1-50041d296a73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38da9300b49a48668f9c8815c2c9a715)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:26:26.088709 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e4b910-be44-47e1-b2c1-50041d296a73 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:26:26.139715 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-85e4b910-be44-47e1-b2c1-50041d296a73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38da9300b49a48668f9c8815c2c9a715', 'request_id': 'req-85e4b910-be44-47e1-b2c1-50041d296a73'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:26:26.146225 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-85e4b910-be44-47e1-b2c1-50041d296a73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38da9300b49a48668f9c8815c2c9a715', 'request_id': 'req-85e4b910-be44-47e1-b2c1-50041d296a73'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:26:26.155090 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-85e4b910-be44-47e1-b2c1-50041d296a73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38da9300b49a48668f9c8815c2c9a715', 'request_id': 'req-85e4b910-be44-47e1-b2c1-50041d296a73'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:26:26.166789 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-85e4b910-be44-47e1-b2c1-50041d296a73 admin admin] The token cache is being invalidate because project 38da9300b49a48668f9c8815c2c9a715 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:26:26.167083 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-85e4b910-be44-47e1-b2c1-50041d296a73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:26:26.167742 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-85e4b910-be44-47e1-b2c1-50041d296a73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:26:26.169657 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1427/2885] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:26:25 2022] DELETE /identity/v3/projects/38da9300b49a48668f9c8815c2c9a715 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:26:26.173924 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecd34b7-5951-4a32-a58b-d038bfccb764 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:26:26.175379 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-5ecd34b7-5951-4a32-a58b-d038bfccb764 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:26:26.188832 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecd34b7-5951-4a32-a58b-d038bfccb764 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:26:26.246844 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6a18f5-d919-40b9-b0c5-849462c48a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:26:26.247734 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a18f5-d919-40b9-b0c5-849462c48a28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:26:26.248048 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a18f5-d919-40b9-b0c5-849462c48a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:26:26.248327 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a18f5-d919-40b9-b0c5-849462c48a28 admin admin] PATH_INFO: `/v3/users/97ecb1dfc3344d85bf90d598e8c12f2f` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:26:26.249539 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6a18f5-d919-40b9-b0c5-849462c48a28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97ecb1dfc3344d85bf90d598e8c12f2f)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:26:26.251484 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6a18f5-d919-40b9-b0c5-849462c48a28 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:26:26.256125 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:26:26.300101 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-3a6a18f5-d919-40b9-b0c5-849462c48a28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97ecb1dfc3344d85bf90d598e8c12f2f'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:26:26.307982 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-3a6a18f5-d919-40b9-b0c5-849462c48a28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97ecb1dfc3344d85bf90d598e8c12f2f'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:26:26.308746 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-3a6a18f5-d919-40b9-b0c5-849462c48a28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97ecb1dfc3344d85bf90d598e8c12f2f'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:26:26.309498 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-3a6a18f5-d919-40b9-b0c5-849462c48a28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97ecb1dfc3344d85bf90d598e8c12f2f'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:26:26.329257 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-3a6a18f5-d919-40b9-b0c5-849462c48a28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97ecb1dfc3344d85bf90d598e8c12f2f'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:26:26.346721 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1459/2886] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:26:26 2022] DELETE /identity/v3/users/97ecb1dfc3344d85bf90d598e8c12f2f => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:26:26.540252 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e4b910-be44-47e1-b2c1-50041d296a73 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:26:26.541866 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-85e4b910-be44-47e1-b2c1-50041d296a73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:26:26.560114 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e4b910-be44-47e1-b2c1-50041d296a73 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:26:26.581373 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:26:26.620922 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1f1ee9-582f-4f12-932c-e9c8c744b685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:26:26.621802 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f1ee9-582f-4f12-932c-e9c8c744b685 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:26:26.622082 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f1ee9-582f-4f12-932c-e9c8c744b685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:26:26.622341 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f1ee9-582f-4f12-932c-e9c8c744b685 admin admin] PATH_INFO: `/v3/projects/8b65cbe443ec4d95a1d1012007413d1d` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:26:26.623680 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1f1ee9-582f-4f12-932c-e9c8c744b685 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b65cbe443ec4d95a1d1012007413d1d)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:26:26.625786 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1f1ee9-582f-4f12-932c-e9c8c744b685 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:26:26.676126 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-da1f1ee9-582f-4f12-932c-e9c8c744b685 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b65cbe443ec4d95a1d1012007413d1d', 'request_id': 'req-da1f1ee9-582f-4f12-932c-e9c8c744b685'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:26:26.681981 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-da1f1ee9-582f-4f12-932c-e9c8c744b685 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b65cbe443ec4d95a1d1012007413d1d', 'request_id': 'req-da1f1ee9-582f-4f12-932c-e9c8c744b685'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:26:26.690344 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-da1f1ee9-582f-4f12-932c-e9c8c744b685 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b65cbe443ec4d95a1d1012007413d1d', 'request_id': 'req-da1f1ee9-582f-4f12-932c-e9c8c744b685'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:26:26.701721 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-da1f1ee9-582f-4f12-932c-e9c8c744b685 admin admin] The token cache is being invalidate because project 8b65cbe443ec4d95a1d1012007413d1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:26:26.702141 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-da1f1ee9-582f-4f12-932c-e9c8c744b685 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:26:26.702777 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-da1f1ee9-582f-4f12-932c-e9c8c744b685 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:26:26.704376 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1428/2887] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:26:26 2022] DELETE /identity/v3/projects/8b65cbe443ec4d95a1d1012007413d1d => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:26:29.543977 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786fbcf1-fb1c-4885-9f09-6b98b6ed28f5 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:26:29.544532 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786fbcf1-fb1c-4885-9f09-6b98b6ed28f5 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:26:29.544532 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786fbcf1-fb1c-4885-9f09-6b98b6ed28f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:26:29.562444 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-786fbcf1-fb1c-4885-9f09-6b98b6ed28f5 None None] MFA Rules not processed for user `4944622f3e8d49f284b3bdff7bc9a568`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:26:29.563713 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-786fbcf1-fb1c-4885-9f09-6b98b6ed28f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:26:29.622149 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1460/2888] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jul 4 09:26:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:26:36.698829 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=40,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:26:38.994550 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96464bf-16b6-4d56-a13f-b5c628e5a535 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:26:38.995184 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96464bf-16b6-4d56-a13f-b5c628e5a535 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:26:38.995184 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96464bf-16b6-4d56-a13f-b5c628e5a535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:26:39.014604 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-e96464bf-16b6-4d56-a13f-b5c628e5a535 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:26:39.015842 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e96464bf-16b6-4d56-a13f-b5c628e5a535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:26:39.077876 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1429/2889] 10.222.0.70 () {58 vars in 1016 bytes} [Mon Jul 4 09:26:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:26:39.122433 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786fbcf1-fb1c-4885-9f09-6b98b6ed28f5 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:26:39.125097 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-786fbcf1-fb1c-4885-9f09-6b98b6ed28f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:26:39.208315 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786fbcf1-fb1c-4885-9f09-6b98b6ed28f5 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:26:39.216154 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0396d1-60e4-444c-bab8-92c6f0b52f51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3b6e252a8c434a99432bcece6493b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:26:39.216783 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0396d1-60e4-444c-bab8-92c6f0b52f51 service nova] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:26:39.217066 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0396d1-60e4-444c-bab8-92c6f0b52f51 service nova] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:26:39.217688 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0396d1-60e4-444c-bab8-92c6f0b52f51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:26:39.227245 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0396d1-60e4-444c-bab8-92c6f0b52f51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:26:39.228886 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0396d1-60e4-444c-bab8-92c6f0b52f51 service nova] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:26:39.238654 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1461/2890] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:26:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:26:42.262261 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b2449-8d58-4842-8ac4-dfe1e38570cd None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:26:42.262864 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b2449-8d58-4842-8ac4-dfe1e38570cd None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:26:42.262864 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b2449-8d58-4842-8ac4-dfe1e38570cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:26:42.282354 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-7f8b2449-8d58-4842-8ac4-dfe1e38570cd None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:26:42.283589 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-7f8b2449-8d58-4842-8ac4-dfe1e38570cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:26:42.293209 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1430/2891] 10.222.0.70 () {58 vars in 1016 bytes} [Mon Jul 4 09:26:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:26:42.309365 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0396d1-60e4-444c-bab8-92c6f0b52f51 service nova] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:26:42.311945 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-eb0396d1-60e4-444c-bab8-92c6f0b52f51 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:26:42.336448 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0396d1-60e4-444c-bab8-92c6f0b52f51 service nova] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:26:42.342941 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ed088b-328f-43c8-a293-84aaef028844 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3b6e252a8c434a99432bcece6493b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:26:42.343583 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed088b-328f-43c8-a293-84aaef028844 service nova] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:26:42.343898 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed088b-328f-43c8-a293-84aaef028844 service nova] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:26:42.344168 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed088b-328f-43c8-a293-84aaef028844 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:26:42.352721 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ed088b-328f-43c8-a293-84aaef028844 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:26:42.354296 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ed088b-328f-43c8-a293-84aaef028844 service nova] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:26:42.359615 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:26:42.364979 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1462/2892] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:26:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:26:45.356632 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053fb6e8-9518-4a9c-ab89-136a49340956 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:26:45.357165 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053fb6e8-9518-4a9c-ab89-136a49340956 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:26:45.357165 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053fb6e8-9518-4a9c-ab89-136a49340956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:26:45.376592 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-053fb6e8-9518-4a9c-ab89-136a49340956 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:26:45.377789 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-053fb6e8-9518-4a9c-ab89-136a49340956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:26:45.385843 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1431/2893] 10.222.0.70 () {58 vars in 1016 bytes} [Mon Jul 4 09:26:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:26:45.401610 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ed088b-328f-43c8-a293-84aaef028844 service nova] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:26:45.413082 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ed088b-328f-43c8-a293-84aaef028844 service nova] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:26:45.419011 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a147917c-3a8b-4205-b1f5-9b9a71e32038 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3b6e252a8c434a99432bcece6493b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:26:45.419631 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a147917c-3a8b-4205-b1f5-9b9a71e32038 service nova] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:26:45.419929 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a147917c-3a8b-4205-b1f5-9b9a71e32038 service nova] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:26:45.420216 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a147917c-3a8b-4205-b1f5-9b9a71e32038 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:26:45.428842 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a147917c-3a8b-4205-b1f5-9b9a71e32038 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:26:45.430463 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a147917c-3a8b-4205-b1f5-9b9a71e32038 service nova] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:26:45.440646 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1463/2894] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:26:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:26:48.541425 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211ad581-2464-48f1-85ed-383587e59cc8 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:26:48.541914 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211ad581-2464-48f1-85ed-383587e59cc8 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:26:48.542108 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211ad581-2464-48f1-85ed-383587e59cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:26:48.560050 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-211ad581-2464-48f1-85ed-383587e59cc8 None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:26:48.561253 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-211ad581-2464-48f1-85ed-383587e59cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:26:48.569250 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1432/2895] 10.222.0.70 () {58 vars in 1016 bytes} [Mon Jul 4 09:26:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:26:48.585714 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a147917c-3a8b-4205-b1f5-9b9a71e32038 service nova] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:26:48.598107 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a147917c-3a8b-4205-b1f5-9b9a71e32038 service nova] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:26:48.604913 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bba2876-e7b3-46e1-a816-176bc9cd983a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3b6e252a8c434a99432bcece6493b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:26:48.605556 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba2876-e7b3-46e1-a816-176bc9cd983a service nova] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:26:48.605842 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba2876-e7b3-46e1-a816-176bc9cd983a service nova] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:26:48.606119 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba2876-e7b3-46e1-a816-176bc9cd983a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:26:48.614766 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bba2876-e7b3-46e1-a816-176bc9cd983a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:26:48.616409 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bba2876-e7b3-46e1-a816-176bc9cd983a service nova] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:26:48.625931 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1464/2896] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:26:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:26:51.737866 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc410e5-3b54-4873-a914-984e0e562f8d None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:26:51.738366 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc410e5-3b54-4873-a914-984e0e562f8d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:26:51.738473 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc410e5-3b54-4873-a914-984e0e562f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:26:51.758564 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-adc410e5-3b54-4873-a914-984e0e562f8d None None] MFA Rules not processed for user `04cf7e50af2f41cdb2f3d808072f7c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:26:51.759777 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-adc410e5-3b54-4873-a914-984e0e562f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:26:51.768821 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1433/2897] 10.222.0.70 () {58 vars in 1016 bytes} [Mon Jul 4 09:26:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:26:51.785395 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bba2876-e7b3-46e1-a816-176bc9cd983a service nova] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:26:51.796610 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bba2876-e7b3-46e1-a816-176bc9cd983a service nova] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:26:51.802385 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dd4956-285b-40d3-9897-897ea2853c05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3b6e252a8c434a99432bcece6493b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:26:51.803015 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd4956-285b-40d3-9897-897ea2853c05 service nova] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:26:51.803300 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd4956-285b-40d3-9897-897ea2853c05 service nova] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:26:51.803576 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd4956-285b-40d3-9897-897ea2853c05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:26:51.811850 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dd4956-285b-40d3-9897-897ea2853c05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:26:51.813484 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dd4956-285b-40d3-9897-897ea2853c05 service nova] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:26:51.823109 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1465/2898] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:26:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:27:01.753031 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=39 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:27:01.818833 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=18 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:27:09.160562 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab501114-b11f-4d8b-8854-7aa42608148d None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:27:09.161080 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab501114-b11f-4d8b-8854-7aa42608148d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:27:09.161342 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab501114-b11f-4d8b-8854-7aa42608148d None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:27:09.162921 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1434/2899] 10.222.0.42 () {54 vars in 921 bytes} [Mon Jul 4 09:27:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:27:09.168890 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadebef6-a20f-4e05-84c1-ece31fa27306 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:27:09.169329 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadebef6-a20f-4e05-84c1-ece31fa27306 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:27:09.169450 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadebef6-a20f-4e05-84c1-ece31fa27306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:27:09.188611 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-cadebef6-a20f-4e05-84c1-ece31fa27306 None None] MFA Rules not processed for user `af3b6e252a8c434a99432bcece6493b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:27:09.189929 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-cadebef6-a20f-4e05-84c1-ece31fa27306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:27:09.200041 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1466/2900] 10.222.0.42 () {58 vars in 1018 bytes} [Mon Jul 4 09:27:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:27:09.210531 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab501114-b11f-4d8b-8854-7aa42608148d None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:27:09.212380 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ab501114-b11f-4d8b-8854-7aa42608148d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:27:09.269935 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab501114-b11f-4d8b-8854-7aa42608148d None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:27:09.274436 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde0d23a-60ef-4818-9351-971fbd2f0e39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:27:09.275089 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0d23a-60ef-4818-9351-971fbd2f0e39 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:27:09.275376 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0d23a-60ef-4818-9351-971fbd2f0e39 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:27:09.275677 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0d23a-60ef-4818-9351-971fbd2f0e39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:27:09.287580 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde0d23a-60ef-4818-9351-971fbd2f0e39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:27:09.289111 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde0d23a-60ef-4818-9351-971fbd2f0e39 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:27:09.300643 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1435/2901] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:27:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:27:19.183118 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:27:19.295679 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=26 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:27:19.906782 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadebef6-a20f-4e05-84c1-ece31fa27306 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:27:19.908725 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-cadebef6-a20f-4e05-84c1-ece31fa27306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:27:19.923128 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadebef6-a20f-4e05-84c1-ece31fa27306 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:27:19.927997 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4b4033-a368-4ce7-8191-eb6fbf5501ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:27:19.928905 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b4033-a368-4ce7-8191-eb6fbf5501ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:27:19.929187 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b4033-a368-4ce7-8191-eb6fbf5501ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:27:19.929434 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b4033-a368-4ce7-8191-eb6fbf5501ba admin admin] PATH_INFO: `/v3/users/4944622f3e8d49f284b3bdff7bc9a568` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:27:19.930668 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4b4033-a368-4ce7-8191-eb6fbf5501ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=4944622f3e8d49f284b3bdff7bc9a568)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:27:19.932648 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4b4033-a368-4ce7-8191-eb6fbf5501ba admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:27:19.981130 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-dd4b4033-a368-4ce7-8191-eb6fbf5501ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4944622f3e8d49f284b3bdff7bc9a568'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:27:19.988937 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-dd4b4033-a368-4ce7-8191-eb6fbf5501ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4944622f3e8d49f284b3bdff7bc9a568'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:27:19.989794 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-dd4b4033-a368-4ce7-8191-eb6fbf5501ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4944622f3e8d49f284b3bdff7bc9a568'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:27:19.990403 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-dd4b4033-a368-4ce7-8191-eb6fbf5501ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4944622f3e8d49f284b3bdff7bc9a568'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:27:20.001899 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-dd4b4033-a368-4ce7-8191-eb6fbf5501ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4944622f3e8d49f284b3bdff7bc9a568'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:27:20.014006 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1467/2902] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:27:19 2022] DELETE /identity/v3/users/4944622f3e8d49f284b3bdff7bc9a568 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:27:20.187844 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde0d23a-60ef-4818-9351-971fbd2f0e39 service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:27:20.198753 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde0d23a-60ef-4818-9351-971fbd2f0e39 service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:27:20.256420 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f1d8ca-c51e-4aee-a513-afdecda8e363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:27:20.257274 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f1d8ca-c51e-4aee-a513-afdecda8e363 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:27:20.257555 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f1d8ca-c51e-4aee-a513-afdecda8e363 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:27:20.257829 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f1d8ca-c51e-4aee-a513-afdecda8e363 admin admin] PATH_INFO: `/v3/projects/2c5012cbd4ae457693899afbc6b58401` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:27:20.259109 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f1d8ca-c51e-4aee-a513-afdecda8e363 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c5012cbd4ae457693899afbc6b58401)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:27:20.261052 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f1d8ca-c51e-4aee-a513-afdecda8e363 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:27:20.310217 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-87f1d8ca-c51e-4aee-a513-afdecda8e363 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c5012cbd4ae457693899afbc6b58401', 'request_id': 'req-87f1d8ca-c51e-4aee-a513-afdecda8e363'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:27:20.315664 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-87f1d8ca-c51e-4aee-a513-afdecda8e363 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c5012cbd4ae457693899afbc6b58401', 'request_id': 'req-87f1d8ca-c51e-4aee-a513-afdecda8e363'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:27:20.324222 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-87f1d8ca-c51e-4aee-a513-afdecda8e363 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c5012cbd4ae457693899afbc6b58401', 'request_id': 'req-87f1d8ca-c51e-4aee-a513-afdecda8e363'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:27:20.335413 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-87f1d8ca-c51e-4aee-a513-afdecda8e363 admin admin] The token cache is being invalidate because project 2c5012cbd4ae457693899afbc6b58401 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:27:20.335735 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-87f1d8ca-c51e-4aee-a513-afdecda8e363 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:27:20.336384 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-87f1d8ca-c51e-4aee-a513-afdecda8e363 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:27:20.337946 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1436/2903] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:27:20 2022] DELETE /identity/v3/projects/2c5012cbd4ae457693899afbc6b58401 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:27:30.010540 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:27:30.332689 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:28:29.934503 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4b4033-a368-4ce7-8191-eb6fbf5501ba admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:28:29.936314 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-dd4b4033-a368-4ce7-8191-eb6fbf5501ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:28:30.003410 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4b4033-a368-4ce7-8191-eb6fbf5501ba admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:28:30.052270 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f1d8ca-c51e-4aee-a513-afdecda8e363 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:28:30.053684 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-87f1d8ca-c51e-4aee-a513-afdecda8e363 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:28:30.062987 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7745d470-1346-4796-a19d-7f22a9dc039e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:28:30.063645 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7745d470-1346-4796-a19d-7f22a9dc039e service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:28:30.063973 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7745d470-1346-4796-a19d-7f22a9dc039e service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:28:30.064249 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7745d470-1346-4796-a19d-7f22a9dc039e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:28:30.066113 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-7745d470-1346-4796-a19d-7f22a9dc039e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:28:30.076407 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7745d470-1346-4796-a19d-7f22a9dc039e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:28:30.077862 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7745d470-1346-4796-a19d-7f22a9dc039e service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:28:30.087408 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1468/2904] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:28:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:28:30.124883 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f1d8ca-c51e-4aee-a513-afdecda8e363 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:28:30.129364 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817d7860-b2f6-4b8b-8471-7564457938ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:28:30.130131 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d7860-b2f6-4b8b-8471-7564457938ed service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:28:30.130412 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d7860-b2f6-4b8b-8471-7564457938ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:28:30.130686 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d7860-b2f6-4b8b-8471-7564457938ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:28:30.132816 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-817d7860-b2f6-4b8b-8471-7564457938ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:28:30.205682 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817d7860-b2f6-4b8b-8471-7564457938ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:28:30.207177 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817d7860-b2f6-4b8b-8471-7564457938ed service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:28:30.219170 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1437/2905] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:28:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 09:28:31.422534 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7745d470-1346-4796-a19d-7f22a9dc039e service neutron] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:28:31.424307 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-7745d470-1346-4796-a19d-7f22a9dc039e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:28:31.435719 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7745d470-1346-4796-a19d-7f22a9dc039e service neutron] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:28:31.440191 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7202aca8-9c6d-44d4-b7ab-0a72d351c1e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db0575f076240559f64e9548b56ffeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:28:31.441011 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7202aca8-9c6d-44d4-b7ab-0a72d351c1e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:28:31.441368 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7202aca8-9c6d-44d4-b7ab-0a72d351c1e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:28:31.441718 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7202aca8-9c6d-44d4-b7ab-0a72d351c1e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:28:31.443624 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-7202aca8-9c6d-44d4-b7ab-0a72d351c1e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:28:31.458459 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7202aca8-9c6d-44d4-b7ab-0a72d351c1e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:28:31.459907 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7202aca8-9c6d-44d4-b7ab-0a72d351c1e7 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:28:31.472740 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1469/2906] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:28:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:28:32.057469 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817d7860-b2f6-4b8b-8471-7564457938ed service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:28:32.059220 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-817d7860-b2f6-4b8b-8471-7564457938ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:28:32.081280 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817d7860-b2f6-4b8b-8471-7564457938ed service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:28:32.087765 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b860831f-d4d1-43bb-93f6-04f0e1d4d56f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3b6e252a8c434a99432bcece6493b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:28:32.088508 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b860831f-d4d1-43bb-93f6-04f0e1d4d56f service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:28:32.088792 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b860831f-d4d1-43bb-93f6-04f0e1d4d56f service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:28:32.089084 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b860831f-d4d1-43bb-93f6-04f0e1d4d56f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:28:32.093009 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b860831f-d4d1-43bb-93f6-04f0e1d4d56f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:28:32.108278 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b860831f-d4d1-43bb-93f6-04f0e1d4d56f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:28:32.110480 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b860831f-d4d1-43bb-93f6-04f0e1d4d56f service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:28:32.125094 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1438/2907] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:28:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:28:39.224497 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7202aca8-9c6d-44d4-b7ab-0a72d351c1e7 service neutron] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:28:39.226621 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-7202aca8-9c6d-44d4-b7ab-0a72d351c1e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:28:39.297668 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7202aca8-9c6d-44d4-b7ab-0a72d351c1e7 service neutron] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:28:39.302363 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c0d3f-b572-4de6-a5b1-7abbbcebcdf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:28:39.303240 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c0d3f-b572-4de6-a5b1-7abbbcebcdf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:28:39.303556 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c0d3f-b572-4de6-a5b1-7abbbcebcdf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:28:39.303829 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c0d3f-b572-4de6-a5b1-7abbbcebcdf7 admin admin] PATH_INFO: `/v3/users/9e90ac63942941da8f8cd00e874613a1` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:28:39.305667 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2c0d3f-b572-4de6-a5b1-7abbbcebcdf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e90ac63942941da8f8cd00e874613a1)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:28:39.307097 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2c0d3f-b572-4de6-a5b1-7abbbcebcdf7 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:28:39.364199 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-6a2c0d3f-b572-4de6-a5b1-7abbbcebcdf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e90ac63942941da8f8cd00e874613a1'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:28:39.364199 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:28:39.373740 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-6a2c0d3f-b572-4de6-a5b1-7abbbcebcdf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e90ac63942941da8f8cd00e874613a1'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:28:39.374389 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-6a2c0d3f-b572-4de6-a5b1-7abbbcebcdf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e90ac63942941da8f8cd00e874613a1'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:28:39.375025 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-6a2c0d3f-b572-4de6-a5b1-7abbbcebcdf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e90ac63942941da8f8cd00e874613a1'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:28:39.387291 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-6a2c0d3f-b572-4de6-a5b1-7abbbcebcdf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e90ac63942941da8f8cd00e874613a1'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:28:39.399403 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1470/2908] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:28:39 2022] DELETE /identity/v3/users/9e90ac63942941da8f8cd00e874613a1 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:28:39.590798 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b860831f-d4d1-43bb-93f6-04f0e1d4d56f service nova] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:28:39.602651 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b860831f-d4d1-43bb-93f6-04f0e1d4d56f service nova] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:28:39.667024 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa82c073-f422-489f-8fbf-d1a82d1c4df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:28:39.667903 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82c073-f422-489f-8fbf-d1a82d1c4df0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:28:39.668190 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82c073-f422-489f-8fbf-d1a82d1c4df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:28:39.668432 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82c073-f422-489f-8fbf-d1a82d1c4df0 admin admin] PATH_INFO: `/v3/projects/44cd2bf7c0614eb88fbcd3bbe07cd4d0` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:28:39.669669 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa82c073-f422-489f-8fbf-d1a82d1c4df0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44cd2bf7c0614eb88fbcd3bbe07cd4d0)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:28:39.671608 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa82c073-f422-489f-8fbf-d1a82d1c4df0 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:28:39.713694 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:28:39.728323 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-aa82c073-f422-489f-8fbf-d1a82d1c4df0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44cd2bf7c0614eb88fbcd3bbe07cd4d0', 'request_id': 'req-aa82c073-f422-489f-8fbf-d1a82d1c4df0'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:28:39.733637 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-aa82c073-f422-489f-8fbf-d1a82d1c4df0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44cd2bf7c0614eb88fbcd3bbe07cd4d0', 'request_id': 'req-aa82c073-f422-489f-8fbf-d1a82d1c4df0'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:28:39.742104 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-aa82c073-f422-489f-8fbf-d1a82d1c4df0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44cd2bf7c0614eb88fbcd3bbe07cd4d0', 'request_id': 'req-aa82c073-f422-489f-8fbf-d1a82d1c4df0'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:28:39.753102 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-aa82c073-f422-489f-8fbf-d1a82d1c4df0 admin admin] The token cache is being invalidate because project 44cd2bf7c0614eb88fbcd3bbe07cd4d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:28:39.753381 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-aa82c073-f422-489f-8fbf-d1a82d1c4df0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:28:39.754008 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-aa82c073-f422-489f-8fbf-d1a82d1c4df0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:28:39.755552 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1439/2909] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:28:39 2022] DELETE /identity/v3/projects/44cd2bf7c0614eb88fbcd3bbe07cd4d0 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:28:39.759769 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c0d3f-b572-4de6-a5b1-7abbbcebcdf7 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:28:39.761412 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-6a2c0d3f-b572-4de6-a5b1-7abbbcebcdf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:28:39.774685 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c0d3f-b572-4de6-a5b1-7abbbcebcdf7 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:28:39.832452 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950fe4cb-d0e3-4833-83c8-e613d54e855b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:28:39.833314 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950fe4cb-d0e3-4833-83c8-e613d54e855b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:28:39.833587 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950fe4cb-d0e3-4833-83c8-e613d54e855b admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:28:39.833862 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950fe4cb-d0e3-4833-83c8-e613d54e855b admin admin] PATH_INFO: `/v3/users/605437a314d74faabe18a36861a0ddc6` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:28:39.835156 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950fe4cb-d0e3-4833-83c8-e613d54e855b admin admin] RBAC: Authorizing `identity:delete_user(user_id=605437a314d74faabe18a36861a0ddc6)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:28:39.837371 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950fe4cb-d0e3-4833-83c8-e613d54e855b admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:28:39.888554 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-950fe4cb-d0e3-4833-83c8-e613d54e855b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '605437a314d74faabe18a36861a0ddc6'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:28:39.897182 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-950fe4cb-d0e3-4833-83c8-e613d54e855b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '605437a314d74faabe18a36861a0ddc6'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:28:39.897802 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-950fe4cb-d0e3-4833-83c8-e613d54e855b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '605437a314d74faabe18a36861a0ddc6'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:28:39.898476 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-950fe4cb-d0e3-4833-83c8-e613d54e855b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '605437a314d74faabe18a36861a0ddc6'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:28:39.910122 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-950fe4cb-d0e3-4833-83c8-e613d54e855b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '605437a314d74faabe18a36861a0ddc6'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:28:39.922009 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1471/2910] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jul 4 09:28:39 2022] DELETE /identity/v3/users/605437a314d74faabe18a36861a0ddc6 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:28:40.111315 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa82c073-f422-489f-8fbf-d1a82d1c4df0 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:28:40.112900 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-aa82c073-f422-489f-8fbf-d1a82d1c4df0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:28:40.125973 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa82c073-f422-489f-8fbf-d1a82d1c4df0 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:28:40.186986 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c562759-c3da-4806-9c1f-081177ac2531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04cf7e50af2f41cdb2f3d808072f7c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd20857aebd945c0a3035c21bf5f767e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:28:40.187904 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c562759-c3da-4806-9c1f-081177ac2531 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:28:40.188215 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c562759-c3da-4806-9c1f-081177ac2531 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:28:40.188491 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c562759-c3da-4806-9c1f-081177ac2531 admin admin] PATH_INFO: `/v3/projects/daf30f6331b74d40aa344d35053d0d98` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:28:40.189734 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c562759-c3da-4806-9c1f-081177ac2531 admin admin] RBAC: Authorizing `identity:delete_project(project_id=daf30f6331b74d40aa344d35053d0d98)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:28:40.191708 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c562759-c3da-4806-9c1f-081177ac2531 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:28:40.239621 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5c562759-c3da-4806-9c1f-081177ac2531 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'daf30f6331b74d40aa344d35053d0d98', 'request_id': 'req-5c562759-c3da-4806-9c1f-081177ac2531'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:28:40.245447 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5c562759-c3da-4806-9c1f-081177ac2531 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'daf30f6331b74d40aa344d35053d0d98', 'request_id': 'req-5c562759-c3da-4806-9c1f-081177ac2531'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:28:40.253787 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5c562759-c3da-4806-9c1f-081177ac2531 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'daf30f6331b74d40aa344d35053d0d98', 'request_id': 'req-5c562759-c3da-4806-9c1f-081177ac2531'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:28:40.265527 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5c562759-c3da-4806-9c1f-081177ac2531 admin admin] The token cache is being invalidate because project daf30f6331b74d40aa344d35053d0d98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:28:40.265812 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5c562759-c3da-4806-9c1f-081177ac2531 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:28:40.266448 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5c562759-c3da-4806-9c1f-081177ac2531 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:28:40.268039 dv-cinder-844563-4-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1440/2911] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jul 4 09:28:40 2022] DELETE /identity/v3/projects/daf30f6331b74d40aa344d35053d0d98 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:28:49.918535 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=65 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:28:50.262768 dv-cinder-844563-4-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=64,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:30:57.616371 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950fe4cb-d0e3-4833-83c8-e613d54e855b admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:30:57.618708 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-950fe4cb-d0e3-4833-83c8-e613d54e855b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:30:57.765437 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950fe4cb-d0e3-4833-83c8-e613d54e855b admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:30:57.827778 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875946b4-78f3-4784-930d-0107379e0b27 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46ec1a2091f1434cabc69066eb3b6725', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd015d4f3d9d4464983ff561e8e08523c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:30:57.828475 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875946b4-78f3-4784-930d-0107379e0b27 service placement] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:30:57.828752 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875946b4-78f3-4784-930d-0107379e0b27 service placement] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:30:57.829014 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875946b4-78f3-4784-930d-0107379e0b27 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:30:57.831021 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-875946b4-78f3-4784-930d-0107379e0b27 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:30:57.842371 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875946b4-78f3-4784-930d-0107379e0b27 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:30:57.843986 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875946b4-78f3-4784-930d-0107379e0b27 service placement] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:30:57.854419 dv-cinder-844563-4-smb devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1472/2912] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jul 4 09:30:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:31:07.850221 dv-cinder-844563-4-smb devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}